a2) United States Patent
`US 6,513,532 B2
`(10) Patent No.:
`Maultet al.
`(45) Date of Patent:
`Feb. 4, 2003
`
`
`US00651
`
`32B2
`353
`
`(54) DIET AND ACTIVITY-MONITORING
`DEVICE
`
`(52) US. Co cecesceeeeneeeeneneeeees 128/921; 600/595
`(58) Field of Search oi... 600/595, 587,
`600/300, 301; 128/920-9211
`
`(75)
`Inventors: James R. Mault, Evergreen, CO (US);
`Edwin Pearce, San Francisco, CA
`=
`‘
`>
`?
`6
`Cited
`Ref
`
`
`(US); David Gilmore, San Francisco, encrences©Ne(66)
`CA (US); Roshi Givechi, San
`U.S. PATENT DOCUMENTS
`
`Francisco, CA (US); Jeanne Ragan,
`3,972,038 A
`7/1976 Fletcher et al.
`......... 340/189 M
`Plymouth, MI (US); Andrzej
`4,100,401 A
`7/1978 Tutt etal.
`.....
`v 235/92 T
`vn
`Tani,
`--
`Net
`
`4,101,071 A
`7/1978. Brejnik et al.
`235/92 ML
`okoskiewict Menlo Park; we CA
`
`4,117,834 A
`10/1978 McPartlandetal.
`........ 128/2 S
`rimmer,
`San Francisco,
`both o
`
`4,159,416 A
`.........
`235/02 MT
`(US)
`6/1979 Brejnik et al.
`
`4,192,000 A
`3/1980 Lipsey... eee 364/415
`4,212,079 A
`7/1980 Segar et al.
`sessceeseeen 364/900
`4,221,959 A
`9/1980 Sessier
`
`4,224,952 A
`9/1980 Sidorenkoetal. ........... 128/782
`4,244,020 A
`1/1981 Ratcliff...
`.. 364/413
`
`4,321,674 A
`.. 364/413
`3/1982 Kramesetal.
`4,353,375 A
`.. 128/782
`10/1982 Colburn etal.
`
`4,380,802 A
`.. 364/900
`4/1983 Segar et al.
`
`4,387,777 A
`6/1983
`. 177/43
`(List continued on next page.)
`
`.
`(73) Assignee: Healthetech, Inc., Golden, CO (US)
`
`(*) Notice:
`
`Subject to anydisclaimer, the term of this
`patent is extended or adjusted under 35
`USC. 154(b) by 0 days.
`
`(60)
`
`.
`(21) Appl. No.: 09/745,373
`4
`*
`.
`(22) Filed:
`Dec, 23, 2000
`(65)
`Prior Publication Data
`Sng mmc
`ae
`US 2001/0049470 Al Dec. 6, 2001
`Related U.S. Application Data
`Provisional application No. 60/251,179, filed on Dec. 5,
`2000, provisional application No. 60/243,621, filed on Oct.
`26, 2000, provisional application No. 60/240,185, filed on
`Oct. 13, 2000, provisional application No. 60/230,860,filed
`on Oct. 7, 2000, provisional application No. 60/234,866,
`filed on Sep. 22, 2000, provisional application No. 60/212,
`319, filed on Jun. 16, 2000, provisional application No.
`60/209,921, filed on Jun. 7, 2000, provisional application
`No. 60/207,051, filed on May 25, 2000, provisional appli-
`cation No. 60/207,089, filed on May 25, 2000, provisional
`application No. 60/201,902, filed on May 4, 2000, provi-
`sional application No. 60/200,428,filed on Apr. 28, 2000,
`provisional application No. 60/195,779, filed on Apr. 10,
`2000, provisional application No. 60/194,126, filed on Apr.
`3, 2000, provisional application No. 60/179,882,filed on
`Feb. 2, 2000, provisional application No. 60/178,979,filed
`on Jan. 28, 2000, and provisional application No. 60/177,
`016, filed on Jan. 19, 2000.
`
`Primary Examiner—Kevin Shaver
`Assistant Examiner—Navin Natnithithadha
`(74) Attorney, Agent, or Lirm—Gitford, Krass, Groh,
`Sprinkle, Anderson & Citkowski, P.C.
`(57)
`ABSTRACT
`
`Adiet and activily-monitoring device includes a timer which
`outputs a time-indicative signal. A body activity monitor
`monitors the bodyactivity of a subject and outputs a signal
`indicative of the body activity. A consumption notation
`control is provided which the subject may operate to indicate
`when they consume food. Anactivity calculator receives the
`body activity signal and determines a body activity level for
`the subject. A consumption calculator communicates with
`the consumption notation control and receives the time-
`indicalive signal. The consumption calculator determines
`and stores the times when the consumption location control
`is operated.
`
`(51)
`
`Int. Ch? one GO6F 17/00; A61B 5/103;
`A61B 5/112
`
`
`39 Claims, 8 Drawing Sheets
`
`BODY
`ACTIVITY
`MONITOR
`32
`
`
`
`
`
`TIMER
`a4
`
`
`
`
`
`
`
`MODE
`CONSUMPTION
`CONTROL
`NOTATION
`
`CONTROL
`38
`
`36
`
`
`
`
`
`
`
`
`COMMUNICATION
`MEMORY
`TRANSCEIVER
`
`
`44
`42
`
`
`DISPLAY
`
`40
`
`
`
`
`0001
`
`Apple Inc.
`APL1057
`U.S. Patent No. 8,923,941
`FITBIT, Ex. 1057
`
`Apple Inc.
`APL1057
`U.S. Patent No. 8,923,941
`
`0001
`
`FITBIT, Ex. 1057
`
`

`

`US 6,513,532 B2
`
`Page 2
`
`5,729,479 A
`3/1998 Golan veeesscesssscessees 364/709.02
`
`5,788,655 A *
`8/1998 Yoshimuraetal. ..
`600/587
`oe ‘
`5,819,735 A
`10/1998 Mansfield et al.
`128/630
`
`7een f
`5,827,179 A
`10/1998 Lichter et al.
`....
`600/300
`
`*
`:
`>
`9.
`4199.
`rc
`4,629,015 A
`an “
`i908 mown os
`4,650,218 A
`2836312 A
`LL/1998 M
`4,686,624 A
`SBIIIs A
`11/1998 Sheple srrteeness
`
`4,796,182 A
`oiinpapel
`!
`prey
`4,803,625 A
`5,845,263 A
`12/1998 Camaisa et al.
`
`4807169 A
`5,876,351 A
`a00 Rohde........
`2
`
`4.823.808 A
`aeace ‘
`conan
`ahoog ne et al.
`4,853,854 A
`5008
`301
`Oe
`-
`own
`4,855,942 A
`ae A
`eos me a
`» 434/236
`4,855,945 A
`018603 A
`7/1990 Brown
`4,891,756 A
`e951 300 A
`9/1990 Brown
`4,894,793 A
`eosS10 A
`9/1990 Menill a
`
`4,911,256 A
`aaa
`ocd hee
`ve Se
`4.924380 A
`5,987,493 A
`11/1999 Rangan ct al. 709/105
`
`4951197 A
`5,989,188 A
`11/1999 Birkhoelzer etal.
`. 600/300
`
`4054054 A
`......... 600/587
`5,989,200 A * 11/1999 Yoshimura et al.
`4.966.155 A
`-- 600/300
`5,997,476 A
`12/1999 Brown .........
`5,012,411 A
`Coeog “
`toco Reet et al.
`Sono
`5,033,561 A
`wete
`|
`in0Z ..
`"eens
`5,173,588 A
`6,024,281 A
`2/2000 Shepley ..
`» 235/375
`5933500 A
`6,024,699 A
`2/2000 Surwit etal. .....
`--- 600/300
`5,263,491 A
`........---- 600/301
`6,030,342 A
`2/2000 Amanoet al.
`
`5,307,263 A
`vee 1705/2
`6,032,119 A
`2/2000 Brownet al.
`5387164 A
`3/2000 Moore wesssecsseees
`wa. 128/898
`6,032,676 A
`en
`3/2000 Douglas et al. v.00... 600/300
`6,039,688 A
`5,388,043 A
`ion
`8
`5308688 A
`6,040,531 A
`3/2000 Miller-Kovachet al.
`177/25.16
`S860 A
`6,042,383 A
`3/2000 Herron wesccessevesseesseees 434/238
`
`S41264 A
`6,045,513 A
`4/2000 Stone et ale seseeeee 600/508
`
`S454701 A
`6,077,193 A
`6/2000 Buhlerctal.
`vs 482/8
`235/375
`12/1995 Shepley....
`5,478,989 A
`6,083,006 A
`7/2000 Coffman ..
`434/127
`|
`oe
`6,095,949 A
`.. 482/4
`8/2000 Arai wesseeessee
`.
`364/566
`1/1996. Smith et al.
`5,495,402 A
`>
`
`
`; 8/2000-Raymondetal.6,095,985 A . 600/513
`
`
`
`
`
`5,542,420 A 8/1996_Goldmanetal. 128/630 me, )
`
`
`
`. 7058/2
`ue
`pd
`oe
`6,101,478 A
`8/2000 Brown .
`6/1997 Goldman........
`. 33/15 D
`J
`5,640,774 A
`ve
`oe
`
`600/300
`10/2000 Adams .........
`sags
`"
`6,135,950 A
`5,673,691 A
`10/1997 Abramset al. .
`128/630
`199,
`‘
`;
`
`-. 128/710
`10/2000 Richardson etal. ww... 600/300
`10/1997 Sellers .....
`6,135,951 A
`5,678,562 A
`11/1997 Gump 364/709.01
`10/2000 Caimes we.ccescseseeccees 600/300
`5691927 A
`6,139,494 A
`
`1/1998 Williams,II......... w. 128/630
`5,704,350 A
`
`v. 128/732
`5,722,418 A
`B/199B BO veeseceeeeeeeeeeee
`
`
`
`U.S. PATENT DOCUMENTS
`.
`6
`y ose ee ct al. ene yes
`
`3) 986 Ratcliff etal.
`.
`seta5
`.cccee eee ce eee ee
`vee
`ALCILTT
`
`12/1986 Fried et al. veecceseeee 177/25
`
`. 283/67
`3/1987 Hawke.....
`8/1987 Blum etal. wc. wa 364/415
`1/1989 Duboff oe 364/413.29
`2/1989 Futal.
`| 364/413.03
`_ 364/715.01
`2/1989 Overbeck
`
`4/1989 Clegg et al. ecscsssseeen 128/773
`
`. 364/413.01
`8/1989 Beharet al.
`.
`
`8/1989 Bianco ..
`364/561
`
`....
`364/709.02
`8/1989 Sakai
`1/1990 Williams, II .......... 364/413.29
`1/1990 Ikemoto etal. ........ 364/709.03
`
`we 177/25.16
`3/1990 Attikiouzel
`.....
`..... 364/413.29
`5/1990 Gerbaulet el al.
`8/1990 Mellinger
`364/413.2
`
`9/1990 Madsen et ol364/413-20
`10/1990. Jackson seessesccsevvseeseses 128/671
`4/1991 Policastro et al.
`..... 364/413.04
`177/25.16
`7/1991 Hettinger.....
`
`
`12/1992 Harrah .....
`235/114
`‘8/1993. Kretsch et al... 304/413.29
`
`11/1993 Thornton veesscssersseeeees 128/774
`4/1994 Brown vecssesssseseeee 364/413.09
`2/1995 Brown, Js
`482/9
`
`ce
`Way
`°T
`2/1995 Hettinger .........06 364/413 ,29
`3/1995 Laniado
`128/660.02
`5/1908 Dennison 364/413.01
`
`
`
`
`
`
`
`
`
`
`
`
`
`* cited by examiner
`
`0002
`
`FITBIT, Ex. 1057
`
`0002
`
`FITBIT, Ex. 1057
`
`

`

`U.S. Patent
`
`Feb.4, 2003
`
`Sheet 1 of 8
`
`US 6,513,532 B2
`
`FIG - 1
`
`Remote Server
`
`26
`
` Computer
`
`0003
`
`FITBIT, Ex. 1057
`
`0003
`
`FITBIT, Ex. 1057
`
`

`

`U.S. Patent
`
`Feb.4, 2003
`
`Sheet 2 of 8
`
`US 6,513,532 B2
`
`FIG -2
`
`32
`
`BODY
`ACTIVITY
`MONITOR
`
`TIMER
`
`
`
`MODE
`CONTROL
`38
`
`MEMORY
`
`42
`
`CPU
`
`30
`
`DISPLAY
`40
`
`0004
`
`CONSUMPTION
`NOTATION
`CONTROL
`36
`
`a4
`
`COMMUNICATION
`TRANSCEIVER
`
`FITBIT, Ex. 1057
`
`0004
`
`FITBIT, Ex. 1057
`
`

`

`U.S. Patent
`
`Feb.4, 2003
`
`Sheet 3 of 8
`
`US 6,513,532 B2
`
`FIG - 3A
`FIG - 3B
`
`0005
`
`FITBIT, Ex. 1057
`
`0005
`
`FITBIT, Ex. 1057
`
`

`

`U.S. Patent
`
`Feb.4, 2003
`
`Sheet 4 of 8
`
`US 6,513,532 B2
`
`GPS 82
`ANTENNA
`
`Exercise
`Equipment
`Monitoring
`
`Device 108
`
`
`
`
`Respiration
`Sensor
`105
`
`|.
`
`
`
`
`
` GPS-BASED
`
`BODY
`ACTIVITY
`MONITORgo
`
`
`FIG - 4
`
`Audio/Video
`input
`95
`inp
`
`
`
`CONSUMPTION
`NOTATION
`CONTROL
`(Button)
`
`%%
`
`|
`
`I I
`
`Heart Rate |
`Sensor
`‘
`ae
`109} §‘ -
`~
`“be
`
`.
`
`_ —
`
`
`
`i)
`_!
`|
`|
`
`CACULATOR
`
`CONSUMPTION
`“CALCULATOR
`96
`CPU
`
`
`
`
`
`a
`ManualInput
`MODE 18]
`CONTROL
`
`92
`
`MEMORY
`
`COMMUNICATION
`TRANSCEIVER
`
`98
`112
`
`
`
`
`DISPLAY
`
`0006
`
`FITBIT, Ex. 1057
`
`0006
`
`FITBIT, Ex. 1057
`
`

`

`U.S. Patent
`
`Feb.4, 2003
`
`Sheet 5 of 8
`
`US 6,513,532 B2
`
`
`
`
`
`OHIWHS‘ebeq‘Wuyjsdes9)gIsepyeeig
`
`
`
`(FO“IWWing‘sexe|4Uelgy}sepjeaig
`
`
`
`
`
`[Spoo}esooydOo}yoIID]Wo}ysNnD
`
`SUWO}Y
`02:002:2
`
`L#
`
`G-9ld
`
`OO}
`
`oul
`
`aSb
`
`6o7uondunsuos
`
`Ou
`
`
`s9010Ypoo4
`
`uonecc7]uomeingsw,
`
`
`
`
`
`[Spoo}asooydOjYOIIQ]Wosna
`
`
`
`
`
`(9409yIQ‘deumAoyng)gqyoun]
`
`(ayeysJamogeueuRg/e}ejo90YyD)¥youn]
`
`
`
`
`WAS)OL‘:0OG:Z1
`
`
`
`
`(ax05Jaq‘ezzZIga6BapsaoisZ)||4euulg
`(9405191egpees)Z|seuuiq
`
`
`BUOZZId4sAuUuoLSe:0Sz:9
`
`
`
`[NUSLUMBIA0}YOO]Wwoysng
`
`
`
`(yjwiys‘eueueg)qyOBUS
`
`(suoman614)>yoeuS
`
`aWOH$0:0SS°6
`
`
`
`[SPpoo}SSOOYDO}YOO]WO}sND
`
`
`
`(suopman614)9yoeUS
`
`(e6uei9}gyoeus
`
`(addy)yyoeus
`BIO$0:08S-€
`
`
`
`[Spoo]SsooyodoO}YOIIQ]yoRUSWOYsND
`
`
`
`
`
`
`
`udwi4-¢®salCy‘yaynoyBuuuny=G7-06:9
`
`
`[dewMalaO}yOI]0]UOHEDOTUMOUNUQ=OSGS-OLE
`clOL89FVGvomDlBBD
`ckOlL89PVCuouDlBYG
`BWeZZIqSAUCLObs-Bb:9
`
`BULL“SAJaAa7ALAIOY
`
`cOl
`
`uoyeso7awl
`
`
`
`Bo]uone907
`
`
`
`Bunnuwog9z:g-00:8
`
`BOOGL-82:8
`
`BOZEIG-OO
`
`
`
`WAS00:1-OS:11
`
`SWOH0€:9-
`
`awoH00:8-ShiZ
`
`
`
`sBe|4pooy
`
`AWanoy
`
`[9A]
`
`
`
`
`
`BunNWUWwedg90:9-ZEeSG
`
`
`
`
`
`ewOH§SL:9-00:9
`
`
`
`SWOHOO0:0L-Of8
`
`0007
`
`FITBIT, Ex. 1057
`
`0007
`
`FITBIT, Ex. 1057
`
`
`

`

`U.S. Patent
`
`Feb.4, 2003
`
`Sheet 6 of 8
`
`US 6,513,532 B2
`
`FIG -6
`
`
`
`Running
`Shoes
`126
`
`
`
`
`Stationary
`Bike
`
`
`4130
`
`Road Bike
`
`
`
`
`POSITION 435
`ACTIVITY
`DISCRIMINATOR
`
`
`
`
`
`
`1
`
`
`
`Heart Rate
`Sensor,
`
`
`Bopy‘4
`ACTIVITY
`
`MONITOR
`
`
`Motion Sensor ca
`= Bh Oo
`
`I !
`
`activity ‘4
`||CACULATOR
`
`CONSUMPTION
`
`CONTROL |"|CONSUMPTION NOTATION
`
`
`CONTROL
`|
`CALCULATOR
`
`!—Crt
`!
`(
`)
`Button
`
`
`
`U
`
`
`
`
`MEMORY
`
`
`COMMUNICATION
`TRANSCEIVER
`
`
`DISPLAY
`
`84
`
`0008
`
`FITBIT, Ex. 1057
`
`0008
`
`FITBIT, Ex. 1057
`
`

`

`U.S. Patent
`
`Feb.4, 2003
`
`Sheet 7 of 8
`
`US 6,513,532 B2
`
`aayAeunyy JGPUBIOUINW
`
`
`
`
`\
`Granger Ave
`
`
`HHed4
` Bfooklan Ave
`
`Sycamore Pi
`
`0009
`
`FITBIT, Ex. 1057
`
`0009
`
`FITBIT, Ex. 1057
`
`

`

`U.S. Patent
`
`Feb.4, 2003
`
`Sheet 8 of 8
`
`FIG -9
`
`US 6,513,532 B2
`
`0010
`
`FITBIT, Ex. 1057
`
`0010
`
`FITBIT, Ex. 1057
`
`

`

`US 6,513,532 B2
`
`1
`DIET AND ACTIVITY-MONTTORING
`DEVICE
`
`This application claims priority from U.S. provisional
`patent applications Ser. Nos. 60/177,016, filed Jan. 19, 2000;
`60/178,979, filed Jan. 28, 2000; 60/179,882, filed Keb. 2,
`2000, 60/195,779, filed Apr. 10, 2000; 60/194,126, filed Apr.
`3, 2000; 60/209,921, filed Jun. 7, 2000; 60/200,428,filed
`Apr. 28, 2000; 60/201,902, filed May 4, 2000; 60/207,089,
`filed May 25, 2000; 60/207,051, filed May 25, 2000; 60/212,
`319, filed Jun. 16, 2000; 60/234,866, filed Sep. 22,2000;
`60/230,860, filed Sep. 7, 2000; 60/240,185, filed Oct. 13,
`2000; 60/243,621, filed Oct. 26, 2000 and 60/251,179, filed
`Dec. 5, 2000, all of which are incorporated herein in their
`entirety by reference. ‘This application also claims priority
`from U.S. patent application Scr. Nos. 09/685,625, filed Oct.
`10, 2000; 09/630,398, filed Aug. 2, 2000; 09/669,125 filed
`Sep. 25, 2000; 09/684,440 filed Oct. 10, 2000; and 09/721,
`382 filed Nov. 22, 2000, are also incorporated herein in their
`entirety by reference.
`FIELD OF THE INVENTION
`
`The present invention relates generally to activity moni-
`tors and diet monitors and, more specifically, to a device that
`combines both diet and activity monitoring.
`BACKGROUND OF THE INVENTION
`
`1s
`
`40
`
`2
`expenditure (REE) and activity energy expenditure (AEE),
`ie. TEE=AEE+REE. Weight
`loss occurs if total energy
`expenditure (TLE) exceedstotal caloric intake over a given
`time period. As discussed by Remmereit in U.S. Pat. No.
`6,034,132, 70 percent of total energy expenditure for a
`typical person is due to their resting metabolic rate (RMR).
`In a conventional diet program, RMRis estimated from the
`height, weight, age, and gender of the person, for example
`using the Harris-Benedict equation. This equation, well
`knownto those skilled in the nutritionalarts, is given in US.
`Pat. No. 5,839,901 to Karkanen, and in U.S. Pat. No.
`5,639,471 to Chait et al. There are serious inadequacies in
`using the Harris-Benedict equation (or any similar cquation)
`in a weight loss program. The Harris-Benedict equation
`provides only an estimated RMR,whichis an average value
`for people of similar height, weight, age, and gender.
`However, due to natural variations in physiology, the equa-
`tion maynot be accurate for a specific individual.
`Conventional weight loss programsuse an estimatedtotal
`energy expendilure (TEE) based on estimates of activity
`levels, and estimates of resting energy expenditure (REL)
`from the Harris-Benedict equation. However, unless the
`resting energy expenditure (REE) and the activity energy
`expenditure (AEE) are estimated accurately,
`the person’s
`caloric balance cannot be known accurately, and the oult-
`come of a weight loss program is likely to be unsatisfactory.
`Some uscrs attempt to track their activity energy expen-
`diture (AEE), either for weight
`loss or general
`fitness
`purposes. In the simplest approach the individual maintains
`an exercise log of activitics conductcd, such as distanccs
`walked or jogged. Various graphs and tables can then
`provide an estimate of the calories burned during these
`activities. As with recording consumption, an individual
`may fail
`to accurately record the type and duration of
`activity undertaken leading to inaccurate recordation. Also,
`an individual may not know how far or fast they ran or
`walked. A variety of pedometers are available to assist with
`this task. Pedometers include some type of stride counter in
`order to count the numberofstridcs or paces taken by the
`individual. The devices may be calibrated to allow them to
`determine the distance traveled with reasonable accuracy.
`Through the use of timers,
`they may also be able to
`determine the speed and duration of activity. Pedometers
`typically fail to take into consideration changesof elevation,
`changes in length of stride and changes in intensity. For
`5 example, a runner may combine slow walking with brisk
`running during an exercise session. By combining total
`number of strides and duration of activity, the pedomcter
`may only determine average speed, not instantaneous speed.
`USS. Pat. Nos. 6,002,982 and 6,148,262 to Fry; U.S. Pat.
`No. 6,013,007 to Root et al; U.S. Pat. Nos. 6,009,138 to
`Slusky; and U.S. Pat. Nos. 6,032,108 to Seiple et al each
`disclose improved activity monitors utilizing a global posi-
`tioning system (GPS). The devices track an individual’s
`position over time, using the GPS network. Byperiodically
`or instantaneously comparing position and time, such a
`device is capable of determining a performance profile with
`better accuracy than a typical pedometer.
`Devices are also available for monitoring and tracking,
`heart rate. The most popular of these devices are sold by
`Polar Electro Oy of Finland. These heart rate monitors
`includes a wristwatch-style display unit and a chest strap
`with a heart rate sensor. The chest strap and display unit
`communicate wirelessly. ‘The devices are capable of accu-
`ratcly monitoring heart rate, which corrclates reasonably
`well with exercise intensity. Advanced devices include the
`ability to track heart rate overtime so that a heart rate profile
`may be produced.
`
`Management of dict, health, and fitncss has drawn
`increasing amounts of attention as their importance has been
`recognized, and as consumers around the world have
`struggled to balance busy lives with fitness and properdiet.
`Despite the recognized importance of good health,
`consumers, on average, are becoming increasingly obese.
`This has resulted in a strong demand for devices and
`methods that assist
`individuals in setting and reaching
`dietary and fitness goals. Currently available devices and
`methods fail to mect the necds of avcrage consumers.
`There are serious problems with conventional weight loss
`
`
`programs. Weight changeis related to the user’s net caloric
`
`
`balance, the difference between caloric intake and caloric
`expenditure. However, determination of caloric intake and
`caloric expenditure are both problematic.
`There are numerousdifficulties in accurately determining
`caloric intake. In some diet programsprinted or electronic
`lists are used that provide the nutrition content of a wide
`variety of food. ‘he consumer keeps a diet log ofall foods
`consumed cach day in order to determine their total nutri-
`tional intake. These systems typically are laborious to use
`and only the most dedicated consumer will accurately use ;
`these approaches. For example, a consumer must take the
`time to accurately record the foods consumed each day.
`Obviously, recognition of foods consumed is most accurate
`if done at the time the foods are consumed. However, many
`individuals [eel too rushed to record the foods consumed at
`the time and postpone recordingforlater in the day or week.
`Also, some consumers arc cmbarrasscd to be observed
`recording food intake during or following a meal. This also
`motivates the user to wait to record their consumption until
`later. Obviously, accuracy suffers the more time passes
`between consumption and recordation. An individual may
`entirely forget that they had a snack or two earlier in the day
`or week, leading to undercounting of consumption.
`Determining total cnergy expenditure is also difficult. The
`total energy expenditure of a person comprises a resting
`metabolic component and a physical activity component.
`Total energy expenditure (TEE) is the sumofresting energy
`
`55
`
`60
`
`65
`
`0011
`
`FITBIT, Ex. 1057
`
`0011
`
`FITBIT, Ex. 1057
`
`

`

`US 6,513,532 B2
`
`3
`Each of the above-discussed activity monitors fails to
`consider the dietary intake portion of total health manage-
`ment. Instead, they are directed merely to activity monitor-
`ing. In light of this, there remains a need for a device that
`combines activity monitoring and dict monitoring, that is
`easy to use and provides accurate results.
`SUMMARYOF THE INVENTION
`
`4
`movement as well as the direction and intensity of the
`movement. The motion sensor may form part of the wrist-
`watch orbelt or clothing mounted monitoring device or may
`be part of a separate accessory that communicates with the
`monitoring device. For example, if the monitoring device
`according to the present invention takes the form of a belt or
`clothing mounted housing, the accelerometer may be dis-
`posed in the housing and sense motion of the housing.
`Because the housing is attached to the subject’s belt or
`clothing, motion of the housing correlates with movement of
`the subject. Once again, the body activity monitor may be
`calibrated to determine activity related energy expenditure
`using an indirect calorimeter.
`As another alternative,
`the body activity monitor may
`include multiple modesfor recording of variety of activities,
`such as swimming, biking, and use of stationary exercise
`equipment. The body activity monitor may then be placed in
`the mode corresponding to an activity that
`the subject
`undertakes. ‘The subject presses a start button and the body
`activity monitor will record the duration of the activity. The
`monitoring device may then determine an activity level
`based on the duration of the activity and the estimated
`intensity. The activity level may be adjusted by the user to
`increase the accuracy of the estimate. Alternatively, the body
`activity monitor portion of the monitoring device may
`communicate with the exercise equipment or system of
`equipment being used by the subject to allow transfer of
`accurate data related to exercise. As one simple alternative,
`the bodyactivity monitor may allow the subject to create
`time-stampedexercise flags, corresponding to when exercise
`is undertaken. To create an exercise flag, the subject manipu-
`lates a control on the monitoring device at the time of the
`activity. Later, the time or the duration of the activity may be
`recalled and an actual activity level be entered for tracking
`purposes.
`It is preferred that the monitoring device according to the
`present invention forms part of the system including a local
`remote computing device to which data from the monitoring,
`device may be downloaded for further manipulation. Tor
`example, at the end of the day, the subject may download
`data from the monitoring device to a home PC. The subject
`maythen viewthe activily and consumption data and have
`it during the day. The subject may then be prompted to
`provide additional information about cvcnts such as cxcrcise
`and food flags. This data may be used as part of a determi-
`nation of total caloric balance and as part of a weight loss
`program.
`The monitoring device according to the present invention
`also preferably includes a consumption notation control for
`use by the subject to indicate when the subject consumes
`food. This consumption notation control preferably provides
`a very simple meansfor the subject to note when consump-
`tion occurs and avoids the embarrassment and difficulty of
`recording the actual foods consumed during or immediately
`following consumption of the foods. In one embodiment of
`the present invention, the subject manipulate a control on the
`monitoring device each time they consume food, whether
`the food is a snack or a meal. The monitoring device records
`the time the control was manipulated and creates a “food
`flag”. Later, the subject may use the food flags to help them
`recall what
`they ate. Software on the local or remote
`computing device mayassist in theses determinations by
`presenting options on what was consumed based on past
`bchavior and software scttings. Altcrnatively, food flags may
`also have a duration component. For example, a subject may
`manipulate the consumption notation control once at the
`beginning of the consumption event and againat the end of
`
`
`
`
`
`The present invention improves on the prior art by pro-
`viding a combination diet and activity monitoring device for
`
`monitoring both the consumption andactivity of the subject.
`
`The effectiveness of weight management programs may be
`improved through a more accurale determination of caloric
`balance. Improved determination of caloric balance may be
`obtained by more accurate determinations of total energy
`expenditure, (the sum of resting energy expenditure and
`activity energy expenditure) and caloric intake. The present
`invention focuses on improving the determination of activity
`energy expenditure and caloric intake. Resting energy
`expenditure, the energy expended by an individual at rest,
`maybe accurately determined using an indirect calorimeter,
`such as described in co-pending patent application Ser. No.
`09/630,398, incorporated herein by reference. As discussed
`in this application, resting energy expenditure is based on
`resting metabolic rate. Resting metabolic rate changes over
`ime, especially when the subject changes their diet or
`exercise patterns. Therefore, it is preferable to periodically
`measure resting metabolic rate so that accurate determina-
`ions of resting encrgy expenditure arc available during a
`weight management program.
`Determinationofactivity energy expenditure, which com-
`bined with resting energy expenditure providestotal energy
`expenditure, may be obtained by monitoring a subject’s
`activity on a regular basis. The monitoring device according
`o the present invention includes a body activity monitor for
`monitoring the body activity of the subject. The body
`activity monitor is operable to output a signal indicative of
`he subject’s body activity. An activity calculator may also
`be provided, which receives the activity; indicative signal
`and determines a bodyactivity level and/or energy expen-
`diture for the subject. The body activity monitor may be
`integral with the monitoring device, or may be part of an
`auxiliary device. For example,
`the monitoring device
`according to the present invention may take the form factor
`of a wristwatch-style device or a belt or clothing-mounted
`monitor. In a wristwatch-style device,
`the bodyactivity
`monitor may comprise a heart rate monitor, monitoring the
`heart rate of the subject.
`‘The heart rate of the subject
`increases with activity and decreases when the subject is
`resting. By calibrating the activity monitor, the subject’s 5
`aclivily level and activily related energy expenditure maybe
`determined. The activity monitor may be calibrated using an
`indirect calorimeter, as described in co-pending patent appli-
`cation Ser. No. 09/684,440, incorporated herein byrefer-
`ence. The heart
`rate monitor may form part of the
`wristwatch-style monitoring device and sense heart rate in
`the subject’s wrist or other appendage. Alternatively, a
`separate heart rate sensor may be provided such as a chest
`strap, that communicates with the monitoring device, pref-
`erably using a wireless link. A belt or clothing mounted
`monitoring device may also include a heart rate monitor as
`the body activity monitoring portion.
`‘The body activity monitor which forms part of the moni-
`toring device according to the present invention mayaltcr-
`natively comprise a motion sensor such as a mechanical
`pendulum ora single or multi axis accelerometer. An accel-
`erometer is preferred as it may provide information on body
`
`5,
`
`3o
`
`35
`
`40
`
`55
`
`60
`
`65
`
`0012
`
`FITBIT, Ex. 1057
`
`0012
`
`FITBIT, Ex. 1057
`
`

`

`US 6,513,532 B2
`
`6
`FIG. 6 is a schematic of yet another embodiment of a
`monitoring device according to the present invention;
`FIG.7 is a vicw ofa strect level map illustrating a running
`route as tracked by the activity monitoring portion of one
`embodiment of the present invention;
`FIG.8 is a view of a street level map illustrating a location
`indicator to assist a subject in locating where activity and/or
`consumption took place;
`FIG. 9 is a perspective view of an additional embodiment
`of a diet activity monitoring device according to the present
`invention mounted on the belt of a subject and illustrating
`wireless communication with a personal digital assistant;
`and
`FIG. 10 is a front elevational view of an additional
`embodiment of a monitoring device according to the present
`invention.
`
`DETAILED DESCRIPTION OF THE
`PRETERRED EMBODIMENTS
`
`5
`the consumption event. The duration of the event provides
`additional data for use in determining what foods were
`consumed. As anotheralternative, the consumption notation
`control may include and audio and/or video recording
`device, allowing the subject to make audio and/or video
`notations as to what was consumed. For example,
`the
`monitoring device may include a recording mechanism such
`as a digital recording means. In addition to or altcrnatively
`to the food flags,
`the subject may make a brief audio
`recording as to what was consumed. Alternatively, or addi-
`tionally the monitoring device may include a video record-
`ing system such as a miniaturized camera. The subject may
`then photograph what was consumed to allow an accurate
`determination of consumption at a later time. The use of
`audio or video recording allows additional functionality. Tor
`example,
`the local or remote computing device may be
`operable to provide voice recognition on downloaded audio
`files from the monitoring device. Then, the subject’s audi-
`tory notes may be transcribed into written text for later
`reference by the user. Altcrnatively, the software maydetcr-
`mine what foods were consumed based on the auditory
`notation. Similar functionality may be provided with video
`recordings suchas digital pictures. The digital pictures may
`be transmitted to a remote site where an administrative
`person reviews the picture and records what was consumed
`and transmits this recording back to the subject. This maybe
`provided on a subscription basis. Allernatively, software
`could be provided which performs an image analysis on the
`digital picture to assist in determining the foods consumed.
`As another alternative, the monitoring device according to
`the present invention mayinclude a scanning device to allow
`it to scan and record bar codes and similar coded markings.
`This functionality may be incorporated into the digital
`camera or may be separate. Also, the scanner may form a
`separate unit from the remainder of the monitoring device
`and communicate with the monitoring device through a wire
`or wireless connection. The bar code scanning may be used
`to scan foods to be consumed as well as other information
`such as data concerning exercise.
`The monitoring device according to the present invention
`preferably also includes a timer that outputs a time indica-
`tive signal for use in time stamping food flags and exercise
`flags and for use in tracking activity during the day.
`The diet and activity monitoring device may communi-
`cate with local and remote computers using a wired or
`wireless connection, as well as through transfer of memory
`For purposes of this disclosure, local computer 22 and
`modules. The local or remote computers may allow addi-
`PDA 24 are defined to include all computing devices,
`tional or easier access to advance functions, such as diet and
`whether portable or stationary. ‘This definition includes, but
`activity tracking over longer periods of time.
`is not limited to, electronic books,
`laptop and handheld
`BRIEF DESCRIPTION OF THE DRAWINGS
`computers, cellular phones, pagers, desktop computers, and
`wearable computers. Communication may be provided
`FIG. 1 is a view of a first embodiment of a diet and
`between the monitoring device 10 and the PDA 24, with the
`activity monitoring device and system schematically illus-
`PDA24later communicating with the local computer 22, or
`trating communication between the device and local and
`vice versa. The monitoring device 10 may also interconnect
`remote computers;
`with remote server 26. For example, the monitoring device
`FIG. 2 is a schematic for a diet and activity monitoring
`10 may communicate with a web page running on a remote
`device according to the present invention;
`server via the Internet.
`‘The monitoring device 10 may
`FIG. 3A is a front elevational view of a second embodi-
`include cellular or other wireless or wired communication
`ment of a dict and activity monitoring device according to
`capability so as to interconnect with the Internet either
`6oa
`the present invention;
`continuously or periodically. Communication with a remote
`FIG. 3B isarear elevational view of the strap portion of
`server 26 maybe via the local computer 22 or PDA 24. The
`the diet and activity monitoring device of FIG. 3A;
`monitormg device 10 may also include some type of
`FIG. 4 is a schematic of another embodiment of a moni-
`memory chip or memory module that may be removed from
`toring device according to the present invention;
`the monitoring device 10 and inserted into the local com-
`puter 22 or the PDA 24 for transfer of data.
`FIG. 5 is a sample screen view of a local or remote
`computing device showing one version of a displayof diet-
`The compact size and wearability of the monitoring
`and activity-related data;
`device 10 allows the subject to conveniently carry the device
`
`FIG.1 illustrates a wrist-mounted embodiment of a diet
`and activity monitoring device 10 according to the present
`invention. Communication with remote and local computing
`devices is also shown schematically. The monitoring device
`10 includes a case or housing 12 which connectsto the wrist
`of a subject using a wristband 14. A display 16 is arranged
`on the front of the case 12 so that it can be periodically
`vicwed bythe subject. At Icast one control, such as button
`18, is provided for controlling functions of the monitoring
`device 10. Additional controls, such as button 20, may also
`be provided. The monitoring device 12 is designed to be
`worn or carried by the subject during their daily activity to
`allow convenient and continuous monitoring of their daily
`activities and dietary consumption. The monitoring device
`10 preferably includes the capability to communicate with
`local and remote computers using anyof a variety of wired
`and wircless approaches. For cxamplce,
`the monitoring
`device 10 may communicate with local computer 22 by
`interconnecting a wire between the computer 22 and the
`device 10, or by “docking” the monitoring device 10 into a
`communications dock associated with computer 22. The
`monitoring device 10 may communicate with a personal
`digital assistant (PDA) 24 by docking therewith, or by
`wireless communication, such as infrared communication or
`with a wired connection.
`
`3o
`
`35
`
`40
`
`ano
`
`55
`
`65
`
`0013
`
`FITBIT, E