a2) United States Patent
`US 8,998,815 B2
`(10) Patent No.:
`
` Venkatramanetal. (45) Date of Patent: Apr. 7, 2015
`
`
`US008998815B2
`
`(54) WEARABLE HEART RATE MONITOR
`
`(71) Applicant: Fitbit, Inc., San Francisco, CA (US)
`
`(72)
`
`Inventors: Subramaniam Venkatraman, Walnut
`Creek, CA (US); Shelten Gee Jao Yuen,
`Berkeley, CA (US)
`
`(73) Assignee: Fitbit, Inc., San Francisco, CA (US)
`
`(*) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21) Appl. No.: 14/295,059
`:
`Filed:
`
`(22)
`(65)
`
`Jun. 3, 2014
`Prior Publication Data
`US 2014/0275854 Al
`Sep. 18, 2014
`
`Related U.S. Application Data
`(63) Continuation of application No. 14/292,673, filed on
`May 30, 2014, which is a continuation-in-part of
`application No. 13/924,784,filed on Jun. 24, 2013.
`(60) Provisional application No. 61/662,961, filed on Jun.
`22, 2012, provisional application No. 61/752,826,
`filed on Jan. 15, 2013, provisional application No.
`61/946,439,
`filed on Feb. 28, 2014, provisional
`application No. 61/955,045, filed on Mar. 18, 2014,
`provisional application No. 61/973,614, filed on Apr.
`1, 2014, provisional application No. 61/830,600, filed
`on Jun.
`3,
`2013, provisional
`application No.
`62/001,624,
`filed on May 21, 2014, provisional
`application No. 62/001,585, filed on May 21, 2014.
`
`(51)
`
`Int. Cl.
`AGIB 5/02
`AGIB 5/024
`A6IB 5/00
`A61B 5/0205
`A6IB 5/11
`AOIB 5/0245
`A61B 5/0402
`
`(2006.01)
`(2006.01)
`:
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`
`(52) U.S. CL
`CPC wee AG6IB 5/02405 (2013.01); AGIB 5/721
`(2013.01); A461B 5/0205 (2013.01); A6IB
`5/1118 (2013.01); A6IB 5/681 (2013.01); AOIB
`5/742 (2013.01); A6IB 5/1123 (2013.01); A6IB
`5/02416 (2013.01); A6IB 5/0245 (2013.01);
`AO6IB 5/0402 (2013.01); A61B 5/6831
`(2013.01); A61B 5/6824 (2013.01)
`(58) Field of Classification Search
`USPC viececesesssesseeseseesensees 600/300, 301, 500, 503
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`4,367,752 A
`1/1983 Jimenez etal.
`4,771,792 A
`9/1988. Seale
`(Continued)
`FOREIGN PATENT DOCUMENTS
`
`EP
`
`8/2012
`1721237 B1
`OTHER PUBLICATIONS
`USNotice of Allowance (Corrected Notice of Allowability), dated.
`Dec. 31, 2014, issued in U.S. Appl. No. 14/292,669.
`(Continued)
`
`Primary Examiner — Michael D’Angelo
`(74) Attorney, Agent, or Firm — Weaver Austin Villeneuve
`& Sampson LLP
`
`ABSTRACT
`(57)
`A biometric monitoring device is used to determine a user’s
`heart rate by using a heartbeat waveform sensor and a motion
`detecting sensor. In some embodiments, the device collects
`collecting concurrent output data from the heartbeat wave-
`form sensor and output data from the motion detecting sensor,
`detects a periodic component of the output data from the
`motion detecting sensor, and uses the periodic componentof
`the output data from the motion detecting sensor to remove a
`corresponding periodic componentfrom the output data from
`the heartbeat waveform sensor. From this result, the device
`maydetermine andpresentthe user’s heart rate.
`
`13 Claims, 29 Drawing Sheets
`
`Optical
`PPG Signal
`
`Motion
`Signal
`
`
`
`
`Multi-Spectra
`Tracker
`
`
`Track
`Selector
`
`
`
`Heart Rate
`
`Activity
`Discriminator
`
`1
`
`APPLE 1005
`
`APPLE 1005
`
`1
`
`

`

`US 8,998,815 B2
`
`Page 2
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`8/1991 Thornton
`5,036,856 A
`4/1992 Koyamaetal. wc. 600/500
`5,101,831 A *
`6/1994 Hauck et al. cece. 607/20
`5,318,597 A *
`4/1998 Loetal.
`5,738,104 A
`10/2000 Stephan etal.
`6,131,076 A
`6/2001 Amanoetal. occ 600/531
`6,241,684 BL*
`7/2002 Puolakanahoet al.
`6,418,394 BL
`6/2003 Montagninoetal.
`6,583,369 B2
`5/2004 Turcott
`6,731,967 Bl
`2/2006 Parker et al.
`6,997,882 Bl
`5/2009 Tran
`7,539,532 B2
`5/2010 Gardiner etal.
`7,720,306 B2
`10/2011 Dickinson
`8,040,758 Bl
`4/2012 Smith etal.
`8,152,745 B2
`7/2012 Tsao etal.
`8,211,503 B2
`1/2013 Mannheimeretal.
`8,346,328 B2
`2/2013 Yudovskyetal.
`8,386,042 B2
`5/2013 Bourgetet al.
`8,444,578 B2
`7/2013 Yuen etal.
`8,475,367 Bl
`8,579,827 B1* 11/2013 Rulkovetal. wu. 600/503
`8.792.981 B2
`7/2014 Yudovskyet al.
`8,920,332 B2
`12/2014 Hong etal.
`8,945,017 B2
`3/2015 Venkatraman etal.
`8,948,832 B2
`2/2015 Hongetal.
`8,954,135 B2
`2/2015 Yuen et al.
`8,956,303 B2
`2/2015 Hongetal.
`2001/0044588 Al
`11/2001 Mault
`2003/0163710 Al
`8/2003 Ortiz etal.
`2004/0236227 Al
`11/2004 Gueissaz
`3005/0054940 Al
`3/2005 Almen
`2005/0245793 Al
`11/2005 Hilton et al.
`2006/0195020 Al
`8/2006 Martin etal.
`2008/0097221 Al
`4/2008 Florian
`2009/0012433 Al
`1/2009 Fernstrom etal.
`2009/0292332 Al
`11/2009 Lietal.
`2010/0106044 Al
`4/2010 Linderman
`2010/0152600 Al
`6/2010 Droitcour etal.
`2010/0204550 Al
`8/2010 Heneghan etal.
`2010/0249633 Al
`9/2010 Droitcour et al.
`3010/0274100 Al
`10/2010 Behar et al.
`2010/0292568 Al
`11/2010 Droitcour etal.
`2010/0298650 Al
`11/2010 Moonetal.
`2010/0298651 Al
`11/2010 Moonetal.
`2010/0298653 Al
`11/2010 McCombie etal.
`2010/0298661 Al
`11/2010 McCombieetal.
`2010/0331145 Al
`12/2010 Lakovicet al.
`2010/0331657 Al
`12/2010 Mensingeretal.
`2011/0009727 Al
`1/2011 Mensingeret al.
`2011/0032105 Al
`2/2011 Hoffman etal.
`2011/0066010 Al
`3/2011 Moonetal.
`20120083714 Al
`4/2012 Yuen etal,
`2012,
`uen et al.
`5012/0083715 Al
`4/2012 Yuen et al.
`sohoooeaoss ‘i
`toot yuen “ at
`2012/0084054 Al
`4/2012 Yuen et al.
`2012/0123232 Al
`5/2012 Najarian etal.
`2012/0150074 Al
`6/2012 Yanevet al.
`2012/0172733 Al
`7/2012 Park
`2012/0226471 Al
`9/2012 Yuen etal.
`2012/0226472 Al
`9/2012 Yuen etal.
`2012/0232432 Al
`9/2012 Kahnet al.
`2012/0245439 Al
`9/2012 Andre et al.
`3012/0255875 Al
`10/2012. Vicente et al.
`soealean ‘I bots igenetal
`2013/0009779 Al
`1/2013 Wittlinget al.
`2013/0073254 Al
`3/2013 Yuenetal.
`2013/0073255 Al
`3/2013 Yuen etal.
`2013/0077826 Al*
`3/2013 Cowperthwaite et al.
`2013/0080113 Al
`3/2013 Yuenetal.
`2013/0106684 Al
`5/2013 Weastetal.
`2013/0151196 Al
`6/2013 Yuen etal.
`2013/0158369 Al
`6/2013 Yuen etal.
`2013/0211265 Al
`8/2013 Bedingham etal.
`
`.... 382/103
`
`8/2013 Kaiseretal.
`2013/0218053 Al
`3/2014 Ahmedetal.
`2014/0073486 Al
`4/2014 Huetal.
`2014/0099614 Al
`4/2014 Yuen et al.
`2014/0107493 Al
`§/2014 Brumbacketal.
`2014/0135631 Al
`§/2014 Brumbacketal.
`2014/0142403 Al
`8/2014 Sull et al.
`2014/0241626 Al
`9/2014 Beckman
`2014/0275821 Al
`9/2014 Hongetal.
`2014/0275852 Al
`9/2014 Venkatraman et al.
`2014/0276119 Al
`9/2014 Hongetal.
`2014/0278139 Al
`9/2014 Hong et al.
`2014/0288390 Al
`9/2014 Hongetal.
`2014/0288391 Al
`9/2014 Hongetal.
`2014/0288392 Al
`9/2014 Richardset al.
`2014/0288435 Al
`9/2014 Venkatraman et al.
`2014/0288436 Al
`9/2014 Venkatraman et al.
`2014/0288438 Al
`10/2014 Hongetal.
`2014/0303523 Al
`12/2014 Hongetal.
`2014/0378786 Al
`12/2014 Brumbacketal.
`2014/0378787 Al
`12/2014 Hongetal.
`2014/0378872 Al
`1/2015 Hongetal.
`2015/0025393 Al
`1/2015 Hongetal.
`2015/0025394 Al
`OTHER PUBLICATIONS
`:
`:
`US Notice of Allowance (Corrected Notice of Allowability), dated
`Dec. 31, 2014, issued in U.S. Appl. No. 14/295,158.
`US Office Action, dated Dec. 24, 2014, issued in U.S. Appl. No.
`14/295,076.
`US Notice of Allowance (Corrected Notice of Allowability), dated
`Jan.
`5.2015.
`i
`din US. Appl. No.
`14/295.122
`ee
`eeeay eee
`ee
`U.S. Appl. No. 14/481,020, Sep. 9, 2014, Hongetal.
`US. Appl. No. 14/481,762, Sep. 9, 2014, Honget al.
`U.S. Appl. No. 14/484, 104, Sep. 11, 2014, Brumbacketal.
`US. Appl. No. 14/507,173, Oct. 6, 2014, Honget al.
`U.S. Appl. No. 14/507, 184, Oct. 6, 2014, Honget al.
`US Notice of Allowance, dated Nov. 19, 2014, issued in U.S. Appl.
`No. 13/924,784.
`US Office Action, dated Oct. 22, 2014, issued in U.S. Appl. No.
`14/290,884.
`:
`:
`:
`x NorteOFAllowance, dated Sep. 23, 2014, issued in U.S. Appl.
`Perna
`.
`oe
`US Notice of Allowance (Corrected Notice of Allowability), dated
`Oct. 14, 2014, issued in U.S. Appl. No. 14/292,669.
`US Notice of Allowance, dated Oct. 14, 2014, issued in U.S. Appl.
`No. 14/295,144.
`US Notice ofAllowance, dated Dec. 3, 2014, issued in U.S. Appl. No.
`14/295, 144.
`US Notice of Allowance, dated Sep. 26, 2014, issued in U.S. Appl.
`No. 14/295,158.
`US Notice ofAllowance,dated Dec. 8, 2014,issued in U.S. Appl. No.
`14/292,673
`rare
`:
`:
`x ereotalowanee, dated Nov. 24, 2014, issued in U.S. Appl.
`US Office Action, dated Sep. 29, 2014, issued in U.S. Appl. No.
`14/154,009.
`US Office Action, dated Nov. 25, 2014, issued in U.S. Appl. No.
`14/154,019.
`US Office Action, dated Dec. 10, 2014, issued in U.S. Appl. No.
`14/484, 104.
`US Office Action, dated Dec. 4, 2014, issued in U.S. Appl. No.
`14/216,743.
`:
`:
`:
`:
`LeenaOfiiceAction, datedNov. 21, 2014,issuedinU.S. Appl. No.
`US Office Action, dated Oct. 7, 2014, issued in U.S. Appl. No.
`14/481,762.
`US Final Office Action, dated Dec. 19, 2014, issued in U.S. Appl. No.
`14/481,762.
`U.S. Appl. No. 14/214,655, Mar. 14, 2014, Honget al.
`U.S. Appl. No. 14/216,743, Mar. 17, 2014, Honget al.
`USS. Appl. No. 14/250,256, Apr. 10, 2014, Hongetal.
`U.S. Appl. No. 14/290,884, May 29, 2014, Richardsetal.
`U.S. Appl. No. 14/292,669, May 30, 2014, Hongetal.
`U.S. Appl. No. 14/292,673, May 30, 2014, Venkatraman etal.
`
`
`
`
`
`
`
`
`
`
`
`2
`
`

`

`US 8,998,815 B2
`Page 3
`
`(56)
`
`References Cited
`OTHER PUBLICATIONS
`
`Bqadaqadacad
`
`—arara Gq
`
`S. Appl. No. 14/295,076, Jun. 3, 2014, Venkatraman etal.
`S. Appl. No. 14/295,122, Jun. 3, 2014, Venkatraman etal.
`S. Appl. No. 14/295,144, Jun. 3, 2014, Honget al.
`S. Appl. No. 14/295,158, Jun. 3, 2014, Honget al.
`S. Appl. No. 14/295,161, Jun. 3, 2014, Honget al.
`S Office Action, dated Aug. 4, 2014, issued in U.S. Appl. No.
`3/924,784.
`S Office Action, dated Aug. 5, 2014, issued in U.S. Appl. No.
`4/292,673.
`S Office Action, dated Jul. 31, 2014, issued in U.S. Appl. No.
`4/295,122.
`S Office Action, dated Mar. 14, 2014, issued in U.S. Appl. No.
`4/154,009.
`S Office Action, dated Aug. 22, 2014, issued in U.S. Appl. No.
`14/250,256.
`“Activator is One of the Best Cydia iPhone Hacks | Control your
`iPhone with Gestures,” Iphone-tips-and-advice.com, [retrieved on
`Jul. 9, 2013 at http://www.iphone-tips-and-advice.com/activatior.
`html], 10 pp.
`Chudnow, Alan (Dec. 3, 2012) “Basis Wristband Make Its Debut,”
`The Wired Self, Living in a Wired World, published in Health
`[retrieved on Jul. 22, 2013 at http://thewiredself.com/health/basis-
`wrist-band-make-its-debut/], 3pp.
`Cooper, Daniel (Aug. 16th, 2013) Withings Pulse review, http://www.
`engadget.com/2013/08/16/withings-pulse-revew/, 8 pages.
`DesMarais, Christina (posted on Sep. 3, 2013) “Which New Activity
`Tracker is Best for You?” Health and Home, Health & Fitness ,
`Guides & Reviews, [Retrieved on Sep. 23, 2013 at http://www.techli-
`cious.com/guide/which-new-activity-tracker-is-right-for-you/ 4 pp.
`Empson, Rip, (Sep. 22, 2011) “Basis Reveals an Awesome New
`Affordable Heart and Health Tracker You Can Wear on Your Wrist,”
`[retrieved on Sep. 23, 2013 at http://techcrunch.com/2011/09/22/
`basis-reveals-an-awesome-new .
`.
`. ], 3 pp.
`Fitbit User’s Manual, Last Updated Oct. 22, 2009, 15 pages.
`Forerunner® 201 personal trainer owner’s manual, (Feb. 2006)
`Garmin Ltd., 48 pp.
`Forerunner® 301 personal trainer owner’s manual, (Feb. 2006)
`Garmin Ltd., 66 pp.
`Forerunner® 50 with ANT+Sport™wireless technology, Owner’s
`Manual, (Nov. 2007) Garmin Ltd., 44 pp.
`Forerunner® 205/305 Owner’s Manual, GPS-enabledtrainer for run-
`ners, (2006-2008), Garmin Ltd., 80 pp.
`Forerunner® 405CX Owner’s Manual, ““GPS-Enabled Sports Watch
`With Wireless Sync,” (Mar. 2009), Garmin Ltd., 56 pp.
`Forerunner® 110 Owner’s Manual, (2010) “GPS-Enabled Sport
`Watch,” Garmin Ltd., 16 pp.
`Forerunner® 210 Owner’s Manual, (2010) “GPS-Enabled Sport
`Watch,” Garmin Ltd., 28 pp.
`
`Forerunner® 410 Owner’s Manual, (Jul. 2012) “GPS-Enabled Sport
`Watch With Wireless Sync,” Garmin Ltd., 52 pp.
`Forerunner® 10 Owner’s Manual (Aug. 2012), Garmin Ltd., 10 pp.
`Forerunner® 310XT Owner’s Manual, Multisport GPS Training
`Device, (2009-2013), Garmin Ltd., 56 pp.
`Forerunner® 405 Owner’s Manual,
`(Mar. 2011) “GPS-Enabled.
`Sport Watch With Wireless Sync,”. Garmin Ltd., 56 pp.
`Forerunner® 910XT Owner’s Manual, (Jan. 2013) Garmin Ltd., 56
`Pp.
`Garmin Swim™ Owner’s Manual (Jun. 2012), 12 pp.
`Larklife, User Manual, (2012) Lark Technologies, 7 pp.
`Lark/Larkpro, User Manual, (2012) ““What’s in the box,” Lark Tech-
`nologies, 7 pp.
`Lifetrnr, User Manual (2003, specific date unknown), NB new bal-
`ance®, Implus Footcare, LLC, 3 pages.
`Nike+ FuelBand GPS Manual, User’s Guide (Product Release Date
`Unknown, downloadedJul. 22, 2013), 26 pages.
`Nike+SportBand. User’s Guide, (Product Release Date Unknown,
`downloaded Jul. 22, 2013), 36 pages.
`Nike+SportWatch GPS Manual, User’s Guide, Powered by
`TOMTOM,(Product Release Date Unknown, downloaded Jul. 22,
`2013), 42 pages.
`“Parts ofYour Band,” (Product Release Date Unknown, downloaded.
`Jul. 22, 2013) Jawbone UP Band, | page.
`Polar WearLink® + Coded Transmitter 31 Coded Transmitter W.I.N.
`D. User Manual, Polar® Listen to Your Body, Manufactured by Polar
`Electro Oy, 11 pages.
`Rainmaker, (Jun. 25, 2012, updated Feb 16, 2013) “Garmin Swim
`watch In-Depth Review,” [retrieved on Sep. 9, 2013 at http://www.
`derainmaker.com/2012/06/garmin-swim-in-depth-review.html,
`38
`Pp.
`Rainmaker, (Jul. 25, 2013) “Basis B, Watch In-Depth Review,”
`[retrieved on Feb. 4, 2014 at http://www.dcrainmaker.com/2013/07/
`basis-bl -review.html], 56 pp.
`“Withings pulse, Quick Installation Guide” (Jul. 24, 2013) Withings
`Pulse QIG,v 1.3, withings.com/pulse, 16 pages.
`Zijlstra, Wiebren, (2004)“Assessmentof spatio-temporal parameters
`during unconstrained walking,” Eur JAppl Physiol, 92:39-44.
`U.S. Appl. No. 14/599,039, filed Jan. 16, 2015, Venkatraman et al.
`US Notice ofAllowance, dated Feb. 6, 2015, issued in U.S. Appl. No.
`14/290,884.
`US Office Action, dated Jan. 23, 2015, issued in U.S. Appl. No.
`14/507, 184.
`US Office Action, dated Jan. 26, 2015, issued in U.S. Appl. No.
`14/295,161.
`US Office Action, dated Jan. 27, 2015, issued in U.S. Appl. No.
`14/507,173.
`US Notice of Allowance, dated Jan. 21, 2015, issued in U.S. Appl.
`No. 14/154,009.
`
`* cited by examiner
`
`3
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 1 of 29
`
`US 8,998,815 B2
`
`
`
`/puejus]
`
`JBAIBSJO
`
`SSOISHMA
`
`JOAIBOSUBIL
`
`SoeUe}y|
`Jasonel
`UuoNoeJ9}U|
`
`Jas)
`
`JOSSS90ig
`
`oujewolg
`
`SJOSUBS
`
`je}UsUUOAUZ
`
`SIOSUAS
`
`Loinbi4
`
`4
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 2 of 29
`
`US 8,998,815 B2
`
`Wzainbi4 suoyng
`
`juowyoepy-
`
`pueg
`
`
`
`:POuJdIA]JUsWIAANDES
`
`dsei9
`
`doopueyooy
`
`
`
`
`
`Aiowapedeyspueq
`
`5
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 3 of 29
`
`US 8,998,815 B2
`
`gzainbiy
`
`suo}yng
`
`
`
`puegjuowyseny
`
`saBieyy
`
`Bune.
`
`ssaoey
`
`sosuasg
`
`UOISNAOLd
`
`
`
`Bursnopyaajaeq
`
`
`
`‘winuluin}y‘1293$)
`
`
`
`(oye‘onselg=”
`
`dse|5
`
`
`
`doo’]pueyoo
`
`
`
`2POYJIIAJUSUIDINDIIS
`
`
`
`
`
`AJOWsWodeyspueg
`
`6
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 4 of 29
`
`US 8,998,815 B2
`
`doduleW
`
`Aeldsiq
`
`UOISNA}O1dg
`
`Josuag
`
`Ozainbiy
`
`une
`
`os
`
`$
`.
`seca lp Sinan ein thinecimineenee atinneni MeneameeS
`
`en
`wi
`eas
`va
`en
`eine
`or
`wn
`nn
`
`aneerent.i
`
`
`
`puegjuowyseny
`
`7
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 5 of 29
`
`US 8,998,815 B2
`
`
`Bulyooiq-346179A99}01q
`
`Buyysoiq-34yB17S559SSS9A1}99}01d
`
`jeayeyjussedsueiy
`[BueyeWyuasedsueiy
` 10}99}2@p0}0OUd
`Sere:+epaBZSNESneonaea
`ericpeePeaEGSeeOaRUINSgSSSSSSNETDs
`LSEaepocceaeccrnrerene
`(ASSNPicniceseORNNSSSaNad10}99}9p0}0UdZA
`TSSeeEEENpEDUARNNNNNRENESOUNDERSENpoLEUSSe
`
`pan
`
`deainbi4
`
`saa“be
`
`‘saounos464
`
`I
`
`J0AC7]
`
`a/qixe|4
`
`aod
`
`od
`
`veainbi4
`
`saa“be
`
`
`
`‘saounosyy6r4q
`
`19Ke7}
`
`leas
`
`leas
`
`8
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 6 of 29
`
`US 8,998,815 B2
`
`juaiedsueiy
`
`Ayjeando
`
`iaAe7y
`
`aunbi4
`
` 9¢€
`
`Jo}Na}apo}oud
`
`
`
`sda“be
`
`
`
`‘goounosjYybrq
`
`
`
`yoysegpinbiy
`
`-O1NSS3id
`
`@ARISUAS
`
`@AIS@YUPY
`
`Apog
`
`8d1ANq
`
`9
`
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 7 of 29
`
`US 8,998,815 B2
`
`LEDs
`
`
`teen”°
`
`‘\.
`
`Photodetector
`
`SmartWatch
`
`LEDs
`
`Photodetector
`
`
`
`Body
`
`Light Pipe
`
`Body
`
`°
`Figure 4B
`
`Artery/Vein
`wu
`
`Protrusion Detail
`
`‘j
`
`
`
`Optically
`Opaque Light
`Pipe Support
`
`Figure 4C
`
`Light Pipes
`
`10
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 8 of 29
`
`US 8,998,815 B2
`
`
`
`14Bry]0}payoyepsoepins
`
`|
`
`@ZIWIXEWZO}10}09}99q/aD1NOS
`Buijdnoyxn|4[pe
`
`
`La
`
`us
`
`
`
`34617paun,-yjdaq
`
`
`
`
`
`sy}Buaeso4adigUUMddid467paziwndo
`
`
`
`SdSeLNSpainojyucg
`
`JOJIJapoj}oUd
`
`
`
`covennoen seononennonensnenn oonosnnen vosonec
`
`
`
`
`
`
`
`
`
`NKApog|~-yoyequews
`
`11
`
`
`
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 9 of 29
`
`US 8,998,815 B2
`
`Band-Mounted Optical
`Sensors and Light
`Emitters
`
`
`
`
`
`Display
`
`
`
`Side-Mounted Optical
`Heart Rate Detection .
`Sensors and/or
`Emitters
`
`
`
`
`
`Wristband
`
`Figure 6B”
`
`12
`
`12
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 10 of 29
`
`US 8,998,815 B2
`
`BdIASpjoapisalySessaud
`
`
`
`SplWO)JUSWSINSBOLYH&axe]O}
`
`
`
`
`
`uooe}epeesLeeyjeoydopa}unow
`
`Jas
`
`
`
`pejajeqsyeyWeeH|
`
`widgg/=yeyyeeH
`
`2enbi4
`
`13
`
`13
`
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 11 of 29
`
`US 8,998,815 B2
`
`User-Set Alarm Window
`
`|
`
`Deep Sleep
`
`
`
`|
`
`
`
`
`5am
`
`6:45am
`
`Light Sleep
`
`
`
`
`
`
`Smart Alarm is Triggered
`by a Light Sleep State
`During Alarm Window
`
`Onset
`
`Figure 8
`
`
`
`Detected?
`
`User is
`active
`
`sedenta
`
`Initiate high sampling
`rate HR detection to
`reduce motion artifacts
`
`nitiate low sampling
`rate HR detection to
`
`
`
`fg
`
`;
`
`
`
`
`
`ftbit
`72:45 pm
`
`Um 116 lyse
`
`Figure 9
`
`14
`
` Motion
`Aciviy Lewet: | figh |
`
`peefithit
`&:16 pm
`
`|
`
`HR 73 bere
`
`Activity Levei Low ;
`
`
`
`
`
`14
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 12 of 29
`
`US 8,998,815 B2
`
`SSB[SIIAA
`
`OLeinbi4
`
`
`
`solaaqBuojuoy
`
`JBUOSIId
`
`94ANSAYJOdAIssed
`
`
`
`segajpuepyajoAoig
`
`15
`
`15
`
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 13 of 29
`
`US 8,998,815 B2
`
`Intensity & On/
`Off Control
`
`Light Source
`intensity & On/
`Off Control
`
`DAC/GPIOs
`
`Light Source
`
`es
`2
`
`\
`
`)
`
`y
`3
`2
`
`sin
`
`Analog
`Signal
`
`|Conditioningi ADC
`
`Figure 11B
`
`
`
`-
`
`soon
`ource
`
`Light Source
`
`Intensity & On/
`Off Control
`
`MCU
`{ ——__——_ }
`i
`|
`
`| | { | | | I
`
`= 5
`
`Skin
`
`Figure 11C
`
`16
`
`16
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 14 of 29
`
`US 8,998,815 B2
`
`| | | |
`
`jue
`
`a| ||2cllaSlOmioh
`
`—!
`|=oO|c | |
`
`
` Light Source
`Intensity & On/
`Off Control
`
`Pena eeEEEaOnE UENO OEE
`
`
`
`
`igna
`
`.
`Figure 11D
`
`LoL
`
`’
`
`Ski
`.
`
`%
`°
`2
`
`7
`
`
`
`MCU
`; ——_— 1
`
`
`
`|
`Light Source
`Intensity & On/
`|
`eae
`|
`
`
`
`Off Control
`
`
`|
`Light
`
`Detector
`
`|
`
`!
`
`! | |
`
`|
`
`;
`
`
`
`Demodulator
`
`| | |
`
`kin
`Ski
`
`Figure 11E
`j
`
`
`
`Light Source|oo[O77 1
`
`
`
`Intensity & On/
`DACI/GPIOs|
`|
`
`
`Off Control
`
`
`Light
`Detector
`
`|
`
`| | | |
`
`
`
`| TTT 4
`
`Skin
`'
`
`Figure 11F
`
`17
`
`17
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 15 of 29
`
`US 8,998,815 B2
`
`ee
`
`Light
`Detector
`
`
`
`MCU
`
`
`| —— 1
`Light Source
`
`Intensity & On/ |DACIGPIOs|
`Off Control
`
`
`
`
`
`
`
`
`
` Demodulator
`
`Figure 11G
`
`18
`
`18
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 16 of 29
`
`US 8,998,815 B2
`
`Heart Rate
`Sensor
`
`Communication Circuitry
`(e.g., Wireless radio)
`
`Processor
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Display
`
`
`
`Figure 12A
`
`Location Sensor
`(e.g., GPS)
`
`
`
`Processor
`
`Display
`
`Figure 12B
`
`Heart Rate
`Sensor
`
`Altitude
`Sensor
`
`
`
`
`
`
`
`
`Communication Circuitry
`(e.g., wireless radio)
`
`Skin Conductance/
`Wet Sensor
`
`
`
`
`
`
`
`
`
`
`Physiological
`Sensors
`
`Environmental
`Sensors
`
`Location
`Sensors
`
`
`
`
`
`
`Processor
`
`
`
`
`Figure 12C
`
`19
`
`19
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 17 of 29
`
`US 8,998,815 B2
`
`Optical
`PPG Signal
`
`|
`
`Spectra Estimatoree eee wt
`
`Track
`Selector
`
`
`
`Multi-Spectra
`Tracker
`
`
`
`Motion
`Signal
`
`|; [ Peak
`
`Activity
`Discriminator
`
`{
`Spectra Estimator
`_-_— SS a
`
`Figure 13A
`
`Opacal PPG
`
`ignal
`
`Spectra
`
`Estimator
`
`Multi-Spectra
`
`Tracker
`
`Track Selector
`
`
`
`
`
`
`
`
`Motion
`Signal
`
`Spectra
`Estimator
`
`Activity
`Discriminator
`
`Heart Rate
`
`Heart Rate
`
`Figure 13B
`
`Connection
`
`
` Anaiog
`
`
`Processor
`
`
`
`Figure 14A (Prior Art)
`
`Analog
`Connection
`
`
`
`
`
`Digital
`Connection
`
`Application
`Processor
`
`Sensor
`Processor
`
`Figure 14B
`
`20
`
`20
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 18 of 29
`
`US 8,998,815 B2
`
`Application
`
`Sensor 3A
`Sensor 3B
`
`Application
`Processor
`
`Processor
`Processor ...
`
`Figure 14C
`
`Sensor
`Processor 1
`
`Sensor
`Processor 2
`Sensor
`Processor 3
`
`Sensor
`
`Figure 14D
`
`21
`
`21
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 19 of 29
`
`US 8,998,815 B2
`
`
`
`Stroke
`Detection
`
`
`Stroke Type
`Detection
`
`
` Tum
`
`Detection
`
`
`Update Summary of
`Metrics
`
`
`
`User
`
`Finished
`Swimming?
`
`
`
`Figure 15A
`
`22
`
`22
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 20 of 29
`
`US 8,998,815 B2
`
`
`
`Detection
`
`Detection
`
`Stroke Count
`
`Detection
`
`
`
`
`Stroke Type +Detection
`
`Metrics
`
`
`
`Update Summary of
`
`User
`
`Finished
`Swimming?
`
`Figure 15B
`
`23
`
`23
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 21 of 29
`
`US 8,998,815 B2
`
`Detection
`
`Detection
`
`Stroke Count
`Detection
`
`Update Summary of
`Metrics
`
`
`
`
`
`
`
`
`
`
`
`User
`Finished
`Swimming?
`
`Figure 15C
`
`24
`
`24
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 22 of 29
`
`US 8,998,815 B2
`
`troke Count
`Detection
`
`Detection
`
`Detection
`
`
`
`
`
`
`
`
`
`Update Summary of
`Metrics
`
`
`User
`Finished
`Swimming?
`
`Figure 15D
`
`25
`
`25
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 23 of 29
`
`US 8,998,815 B2
`
`
`
`Trigger
`
`
`Output Signal
`
`Differential
`Amplifier or
`Instrumentation
`Amplifier
`
`
`Output Signal
`Switch Trigger
` & Hold
`
`Reference
`
`Figure 16A
`
`Figure 16B
`
`Output Signal
`
`Figure 16C
`
`26
`
`26
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 24 of 29
`
`US 8,998,815 B2
`
`Trigger 2
`
`
`
`
`Differential
`Amplifier or
`Instrumentation
`Amplifier
`
`Output Signal
`
`Output Signal
`
`Output Signal
`
`Figure 16F
`
`27
`
`27
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 25 of 29
`
`US 8,998,815 B2
`
`Figure 16G
`
`Output Signal \Maser
`Output Signal
`Output Signal
`
`Figure 161
`
`28
`
`28
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 26 of 29
`
`US 8,998,815 B2
`
`Differential
`Amplifier or
`Instrumentation
`Amplifier
`
`Output Signal
`
`peo
`
`Figure 16J
`
`29
`
`29
`
`

`

`U.S. Patent
`
`Apr. 7, 2015
`
`Sheet 27 of 29
`
`US 8,998,815 B2
`
`
`
`JUssaid
`
`
`
`ZLeinbigCELI
`
`BRSJasy
`
`SUILLIS]OG
`
`YHJoAqend
`
`beeeee_ta
`
`{|Buryyoows
`
`
`
`zAUAnOY
`
`
`
`
`
`
`
`
`
`
`aouape9
`
`
`
`days‘6'3)
`
`(aye.
`
`
`
`uleIgOyeauoySBAOWOYAWAQOY,Old
`
`
`
`youdulewogBoueped(s)ioul4
`
`
`
`
`MH‘besO}498)UOHEUILULOS|C]Buisseooid
`
`bULSedLAAnoy
`
`
`‘atl
`
`
`
`Aguenbaiy
`
`ujJeLUOGg
`
`
`
`0}WSAUOD
`
`
`
`Aseuoels6LLL
`
`colt
`
`jeuBis99)
`
`uonoY|
`
`JOSUaS
`
`wndno
`
`
`
`aidwesajduues
`
`
`
`30
`
`30
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 28 of 29
`
`US 8,998,815 B2
`
`
`
`
`
`ASermotioncompensation
`
`Time(s}
`
`Figure18
`
`1200140016001600
`
`TOOO
`
`BOO
`
`400500
`
`eo
`oa
`
`200 at
`
`eo
`co
`Cl
`
`mo
`rm
`™
`
`a
`La)
`"
`
`cn
`a
`
`wo?
`co
`rm
`
`>
`Ww
`a“
`
`Lae
`o3
`saad
`
`(UILU / syeag) Aguanbes.|
`
`(uluys}eaq) Aauwarnbea.4
`
`31
`
`31
`
`

`

`U.S. Patent
`
`Apr.7, 2015
`
`Sheet 29 of 29
`
`US 8,998,815 B2
`
`Running Stationary
`
`
`0
`o
`
`
`©
`Saal
`
`20
`
`co
`oO
`Cc
`Oo
`o»
`Y)
`
`5w
`
`o@ wS
`
`ees
`
`s a
`
`in.
`
`e£o
`
`O
`
`€=
`
`
`v
`pees)
`
`
`N
`—_
`
`
`QO
`oad
`
`x
`
`©
`
`+
`
`(widq) aye1 peep
`
`32
`
`32
`
`

`

`US 8,998,815 B2
`
`1
`WEARABLE HEART RATE MONITOR
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`This application is a continuation of U.S. patent applica-
`tion Ser. No. 14/292,673,
`titled “WEARABLE HEART
`RATE MONITOR”andfiled on May 30, 2014, which is a
`continuation-in-part of U.S. patent application Ser. No.
`13/924,784, titled “PORTABLE BIOMETRIC MONITOR-
`ING DEVICES AND METHODSOF OPERATING SAME”
`
`and filed on Jun. 24, 2013, which claims benefit of priority
`under 35 U.S.C. §119(e) to U.S. Provisional Patent Applica-
`tion No. 61/662,961, titled “WIRELESS PERSONALBIO-
`METRICS MONITOR”and filed on Jun. 22, 2012 and
`61/752,826, titled “PORTABLE MONITORING DEVICES
`AND METHODS OF OPERATING SAME”andfiled on
`
`Jan. 15, 2013; this application also claims benefit ofpriority
`under 35 U.S.C. §119(e) to U.S. Provisional Patent Applica-
`tion No. 61/830,600, titled “PORTABLE MONITORING
`DEVICES AND METHODSOF OPERATING SAME”and
`filed on Jun. 3, 2013, 61/946,439, titled “HEART RATE
`DATA COLLECTION”andfiled on Feb. 28, 2014, 61/955,
`045, titled “GPS POWER CONSERVATIONUSING ENVI-
`RONMENTAL DATA”andfiled on Mar. 18, 2014, 61/973,
`614,
`titled “GPS ACCURACY REFINEMENT USING
`EXTERNAL SENSORS”andfiled on Apr. 1, 2014, 62/001,
`624,
`titled “FITNESS MONITORING DEVICE WITH
`ALTIMETER”andfiled on May 21, 2014, and 62/001,585,
`titled “WEARABLE HEART RATE MONITOR?”andfiled
`on May 21, 2014, all of which are hereby incorporated by
`reference herein in their entireties.
`
`BACKGROUND
`
`Recent consumerinterest in personal health has led to a
`variety of personal health monitoring devices being offered
`on the market. Such devices, until recently, tended to be
`complicated to use and were typically designed for use with
`oneactivity, e.g., bicycle trip computers.
`Recent advances in sensor, electronics, and power source
`miniaturization have allowed the size of personal health
`monitoring devices, also referred to herein as “biometric
`tracking”or “biometric monitoring” devices, to be offered in
`extremely small sizes that were previously impractical. For
`example, the Fitbit Ultra is a biometric monitoring device that
`is approximately 2" long, 0.75" wide, and 0.5" deep; it has a
`pixelated display, battery, sensors, wireless communications
`capability, power source, and interface button, as well as an
`integrated clip for attaching the device to a pocket or other
`portion of clothing, packaged within this small volume.
`The disclosure provides methods and devices for activat-
`ing, in energy efficient ways, HR monitor based on user
`motion and skin proximity. The disclosure also provides
`methods for operating the LED and photo detector of heart
`rate monitors to obtain accurate readingofheart rate tailored
`for different user characteristics such as skin colors.
`
`SUMMARY
`
`One aspect of the disclosure provides methods of deter-
`mining a user’s heart rate when wearing a biometric moni-
`toring device having a plurality of sensors including a heart-
`beat waveform sensor and a motion detecting sensor. The
`methods may remove motion artifacts from heartbeat wave-
`form signals when determining a user’s heart rate. The meth-
`ods may be characterized by the following operations: (a)
`
`2
`collecting concurrent output data from the heartbeat wave-
`form sensorand outputdata from the motion detecting sensor,
`wherein the output data from the heartbeat waveform sensor
`provides information aboutthe user’s heart rate and wherein
`the output data from the motion detecting sensor provides
`information about the user’s periodic physical movements
`other than heartbeats; (b) determining a periodic component
`ofthe output data from the motion detecting sensor; (c) using
`the periodic component of the output data from the motion
`detecting sensor to remove a corresponding periodic compo-
`nent from the output data from the heartbeat waveform sen-
`sor; (d) determining the user’s heart rate; and (e) presenting
`the user’s heart rate. In some implementations, the motion
`detecting sensor is an accelerometer or a gyroscope. In some
`embodiments, the heartbeat waveform sensor may be a pho-
`toplethysmographysensor or an ECGsensor.
`In certain embodiments, the method contains an additional
`operation of removing a harmonic of the correspondingperi-
`odic component from the output data from the heartbeat
`waveform sensor. In such embodiments, the periodic compo-
`nent of the output data from the motion detecting sensor may
`be a fundamental frequency produced from the user’s peri-
`odic movement.
`In certain embodiments,
`the operation
`removing a corresponding periodic componentfrom the out-
`put data from the heartbeat waveform sensorincludes apply-
`ing an adaptive filter to the output data from the heartbeat
`waveform sensor and the output data from the motion detect-
`ing sensor. In certain embodiments, removing a correspond-
`ing periodic component from the output data from the heart-
`beat waveform sensor includes the operation applying an
`adaptive filter function to the output data from the motion
`detecting sensor that minimizes the difference between the
`output data from the heartbeat waveform sensor and the out-
`put data from the motion detecting sensor.
`In some implementations, the method includesthe follow-
`ing additional operations: (1) determining the user’s activity
`level and/oractivity type; and (11) determining parameters of
`the function based on the user’s activity level and/or activity
`type.
`In some implementations, the method includesthe follow-
`ing additional operations: (i) analyzing the output data from
`the motion detecting sensor to infer that the user is substan-
`tially stationary; and (ii) temporarily suspending operation
`(c).
`In some method implementations, the operation collecting
`the output data from the heartbeat waveform sensor includes
`the following operations: (1) pulsing a light source in the worn
`biometric monitoring device at a first frequency; and (ii)
`detecting light from the light source at the first frequency.
`Pulsing the light source at the first frequency may involve
`emitting a succession oflight pulses of substantially constant
`intensity.
`In certain embodiments, presenting the user’s heart rate
`includes presenting the heart rate on the worn biometric
`monitoring device. In certain embodiments, presenting the
`user’s heart rate includes presenting the heart rate on an
`external device that periodically communicates with the worn
`biometric monitoring device.
`Anotheraspect ofthe invention pertains to wearable fitness
`monitoring devices designed or configured to remove motion
`artifacts from heartbeat waveform signals when determining
`auser’s heart rate. Such devices may be characterized by the
`following features: a motion sensor configured to provide
`output corresponding to motion by a user wearing the fitness
`monitoring device; a heartbeat waveform sensor; and control
`logic. The control logic includes instructions for: (a) collect-
`ing concurrent output data from the heartbeat waveform sen-
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`55
`
`60
`
`65
`
`33
`
`33
`
`

`

`US 8,998,815 B2
`
`3
`sor and output data from the motion detecting sensor, wherein
`the output data from the heartbeat waveform sensor provides
`information about the user’s heart rate and wherein the output
`data from the motion detecting sensor provides information
`about the user’s periodic physical movements other than
`heartbeats; (b) determining a periodic componentofthe out-
`put data from the motion detecting sensor; (c) using the peri-
`odic componentof the output data from the motion detecting
`sensor to remove a corresponding periodic component from
`the output data from the heartbeat waveform sensor; (d) deter-
`mining the user’s heart rate; and (e) presenting the user’s
`heart rate.
`
`though not necessarily,
`logic is typically,
`The control
`located on the fitness monitoring device. It may be imple-
`mented as hardware, software, firmware, or any combination
`thereof. The data used by the control logic in executing the
`instructions described herein may be stored (e.g., buffered)
`by associated memory, registers, and the like, which may be
`entirely resident on the device orpartially resident on a paired
`secondary device. Examples of suitable architectures for
`implementing the control logic are presented below with
`referenceto, e.g., FIGS. 11A-G, 12A-C, 13A-B, and 14A-D.
`In some devices, the motion detecting sensor is an accel-
`erometer or a gyroscope.
`In certain embodiments,
`the
`device’s heartbeat waveform sensor is a photoplethysmo-
`graphic sensor having (i) a periodic light source,(11) a photo
`detector positioned to receive periodic light emitted by the
`light source after interacting with the user’s skin, and (iti)
`circuitry determining the user’s heart rate from output of the
`photo detector. In some implementations, the photoplethys-
`mographic sensor includes two periodic light sources strad-
`dling the photo detector. In some implementations, the pho-
`toplethysmographic sensor additionally includes a housing
`having a recess in which the photo detector is disposed. The
`housing of the photoplethysmographic sensor may have a
`second recess in which the periodic light source is disposed.
`In some designs, the housing protrudes at least about 1 mm
`above a base surface of the wearable fitness monitoring
`device arranged to press against the user’s skin when worn.
`Further,
`the photoplethysmographic sensor further may
`include a spring configured to resist compression when the
`protruding housing presses against the user’s skin.In certain
`embodiments,
`the photoplethysmographic
`sensor
`also
`includes an IMLfilm overthe photo detector andthe periodic
`light source. In certain embodiments,
`the periodic light
`source is an LED.
`In some embodiments, the device’s control logic includes
`instructions for removing a harmonic of the corresponding
`periodic component from the output data from the heartbeat
`waveform sensor; in such cases the periodic componentofthe
`output data from the motion detecting sensor may be a fun-
`damental frequency produced from the user’s periodic move-
`ment.
`
`In some implementations, the instructions for removing a
`corresponding periodic componentfrom the output data from
`the heartbeat waveform sensorincludeinstructionsfor apply-
`ing an adaptive filter to the output data from the heartbeat
`waveform sensor and the output data from the motion detect-
`ing sensor. In some implementations, the instructions for
`removing a corresponding periodic componentfrom the out-
`put data from the heartbeat waveform sensorinclude instruc-
`tions for applying an adaptivefilter function to the output data
`f