as) United States
`a2) Patent Application Publication (0) Pub. No.: US 2004/0152957 Al
`(43) Pub. Date:
`Aug. 5, 2004
`Stivoricet al.
`
`US 20040152957A1
`
`(54) APPARATUS FOR DETECTING, RECEIVING,
`DERIVING AND DISPLAYING HUMAN
`PHYSIOLOGICAL AND CONTEXTUAL
`INFORMATION
`
`filed on Jun. 23, 2000, now Pat. No. 6,605,038, which
`is a continuation-in-part of application No. 09/595,
`660, filed on Jun. 16, 2000.
`
`(76)
`
`Inventors: John Stivoric, Pittsburgh, PA (US);
`Christopher Pacione, Pittsburgh, PA
`(US); Eric Teller, Pittsburgh, PA (US);
`David Andre, Pittsburgh, PA (US);
`Christopher Kasabach, Pittsburgh, PA
`(US); Scott Boehmke, Wexford, PA
`(US); Suresh Vishnubhatla, Wexford,
`PA (US); Scott Safier, Pittsburgh, PA
`(US); Jonathan Farringdon,
`Pittsburgh, PA (US); Raymond
`Pelletier, Pittsburgh, PA (US)
`
`Correspondence Address:
`Philip E. Levy, Esq.
`Metz Lewis LLC
`18th Floor
`11 Stanwix Street
`
`Pittsburgh, PA 15222 (US)
`
`(21) Appl. No.:
`
`10/682,759
`
`(22)
`
`Filed:
`
`Oct. 9, 2003
`
`Related U.S. Application Data
`
`(63) Continuation-in-part of application No. 09/923,181,
`filed on Aug. 6, 2001, now abandoned, which is a
`continuation-in-part of application No. 09/602,537,
`
`(60) Provisional application No. 60/417,163, filed on Oct.
`9, 2002.
`
`Publication Classification
`
`Tint. C07 ieee eccceeeeeseeennneeeceesnneeeeenneeeee A61B 5/00
`(SV)
`(52) US. C1. ee eeeecseessseseecsecnecneeeneess 600/300; 128/903
`
`(57)
`
`ABSTRACT
`
`A monitoring apparatus that includes a sensor device and an
`1/O device in communication with the sensor device that
`generates derived data using the data from the sensor device.
`The derived data cannot be directly detected by the associ-
`ated sensors. Alternatively, an apparatus that
`includes a
`wearable sensor device and an I/O device in communication
`with the sensor device that includes meansfor displaying
`information and a dial for entering information. Alterna-
`tively, an apparatus for tracking caloric consumption and
`caloric expenditure data that includes a sensor device and an
`1/O device in communication with the sensor device. The
`sensor device includes a processor programmedto generate
`data relating to caloric expenditure from sensor data. Alter-
`natively, an apparatus for tracking caloric information for an
`individual that utilizes a plurality of classification identifiers
`for classifying meals consumedby the individual, each of
`the classification identifiers having a corresponding caloric
`amount.
`
`
`Local Telco
`
`
`
`
`Telco
`
`Computer
`
`
`
`
`
`45
`
`
`Central
`
`
`The Internet
`Monitoring
`
`Unit
`
`User Location
`
`APPLE 1024
`
`APPLE 1024
`
`1
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 1 of 47
`
`US 2004/0152957 A1
`
`0€
`
`feyjUuaD
`
`BuvoyuoyJOUIS}U]OUL
`_wunoe—
`
`
`
`SS
`
`ooja]1e907]
`
`co709
`
`C7WV
`yy
`
`qJayndwo4y3O101
`Wee
`
`SSOISIINA
`
`a01Aaq
`
`sosuas
`
`80IAEq
`
`uol}e007]as
`
`}Old
`
`2
`
`
`
`
`
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 2 of 47
`
`US 2004/0152957 A1
`
`(2
`
`06%
`
`BI
`
`a/v
`
`
`
`JBYBAUOD|
`
`Ol
`
`YNDD
`
`Bujuonlpuod
`:;sayyduiy.vt
`
`ol.
`
`Josuas
`
`3
`
`
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 3 of 47
`
`US 2004/0152957 A1
`
`&G6
`
`qs6~
`
`96
`
`S/EMOIPPIN
`
`—:J8N8S.
`
`OJEMSIPPIW
`
`J8AI8S
`
`SJEMS|PPIW
`
`JONES
`
`SLL-
`
`OLL
`
`OO}
`
`aeseqeieq
`
`J8AIBS
`
`4IOMION
`
`aHe10jS
`
`06
`
`{peo7
`
`Jeourjeg
`
`JJeMosy
`
`$8
`
`08-
`
`SZOZ
`
`6Ola
`
`4
`
`
`
`
`
`
`
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 4 of 47
`
`US 2004/0152957 A1
`
`G6
`
`qS6
`
`96
`
`Slemelppi
`
`IONS
`
`olemMal|pPl\\\|
`
`JONES
`
`SJEMO|PPII
`
`JONaS
`
`osehaseesel
`
`eJeMeiPPI\|
`SleMesl[ppIW
`SJEMS|PPIIN
`
`J8ANaS
`
`JONES
`
`JeNes
`
`peo7
`
`Jeourjeg
`
`.08SZ
`
`OL
`
`06°
`
`
`
`-|ygourjeg
`
`peo?
`
`Sob
`
`Se
`
`eseqeieq
`
`J@AI8S
`
`JOLIN
`
`IOMION
`
`QBeI0}S
`
`aseqejeq
`
`JaNes
`
`YIOMJON
`
`abe10js
`
`ySls
`
`5
`
`
`
`
`
`
`
`
`
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 5 of 47
`
`US 2004/0152957 Al
`
`a——
`ja > @on0eo4
`
`150 -
`
`
` Excellent
`
`
`Very Good
`
`Good
`
`Fair
`
`Poor
` Problem
`
`Solver How You Feel
`
`
`
`6
`
`

`

`ae
`
`wa Pane
`== 5
`~ O~—
`Ow AAT
`TS RA~~
`
`Patent Application Publication Aug. 5, 2004 Sheet 6 of 47
`
`US 2004/0152957 Al
`
`ES oh GD XM
`
`1100
`Saw ne
`ee
`<= op ~~
`oS pee
`<= Ae
`
`7
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 7 of 47
`
`US 2004/0152957 Al
`
`Your Health Manager
`
`_ 2 2600 ST O45
`
`28
`
`an~n~. 2/00
`
`nan 2900
`
`1211121344/5 1617
`
`1849 110111
`
`HULL
`
`TTUT
`
`7
`31/4/5]6]
`
`10)11])12 113|14
`
`17} 18}19|}20] 21
`24|25|26|27)
`
`8
`
`

`

`= 35min 15min SGP SP
`255
`260-
`ay
`asp[12]1]2[3[4[5[6[7[a9Fowlfasf[s[67 [alana
`
`High
`
`Patent Application Publication Aug. 5, 2004 Sheet 8 of 47
`
`US 2004/0152957 Al
`
`Your Health Manager
`
`|
`
`9
`
`

`

`~~ Thr. 10min. —
`
`~~ 4
`
`ho
`
`US 2004/0152957 Al
`
`\ 305
`
`L
`
`7
`
`Patent Application Publication Aug. 5, 2004 Sheet 9 of 47
`
`+|Temp/12]12/3[4{5|6[7[8[9fojrsfie]1[2[3JaJsJo[7[a[9frojsipia
`
`10
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 10 of 47
`
`US 2004/0152957 Al
`
`Febste
`
`lllFH KL.CCBRIGGG
`SI\\B\\\
`=.WWWAN
`Peii
`FEWR—LDCC"
`
`11
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 11 of 47
`
`US 2004/0152957 Al
`
`350
`
`|
`
`|
`
`Of
`
`| [Gee~ ~~
`
`
`~Seiaeoe
`ye
`LLILLLLELILELELILELLLLLLy
`Y
`g
`|
`Your Health Manager.
`PO 76%: wa 302%
`, —~ 210
`o
`
`
`
`
`UY | Mon=Tues Wed Thurscb Fri Sat sun y
`
`
`
`
`
`
`A TT Sleep Jun13jJun14 pJun15|Jun16Jun10) Jun14) Jun12) l
`4
`[gree Ee
`ys isy Vey| wel wily
`] _ So in UUs IA = ]
`}
`O poy Up=UV=G=peUp /
`Qa Geea7 |
`y
`355
`Y
`G
`MITJWITIFIS|S
`L
`y
`y
`1}e2l3}4]s]e6]7
`
`
`
`
`
`GY 13|14819} 10/11] 121 /
`y)
`15|16]
`17/18}
`19]
`20]
`21
`y
`y
`22
`23 24|25|26|
`27|
`28
`y
`4
`ee
`aG).
`
`
`
`GY
`
`
`
`mete
`
`ocd,
`
`12
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 12 of 47
`
`US 2004/0152957 Al
`
`
`
`13
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 13 of 47
`
`US 2004/0152957 Al
`
`
`
`14
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 14 of 47
`
`US 2004/0152957 Al
`
`15
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 15 of 47
`
`US 2004/0152957 Al
`
`475
`
`610
`
`440
`
`16
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 16 of 47
`
`US 2004/0152957 A1
`
`
`
`UOd|BUeSsOL
`
`qlsyv
`
`Buribseyooy
`
`YWNID
`
`WENOL
`
`J8]}NO
`
`OLY
`
`|JOABOSUBLL
`
`C8PBL8P
`
`6+‘Sls
`
`17
`
`17
`
`
`
`
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 17 of 47
`
`US 2004/0152957 A1
`
`xnj4yeOH
`
`Ses
`
`SIX
`
`00S
`
`OS?
`
`S09
`
`S6S
`
`|siosuesgHSDdwyyesyo/duy+sto
`|
`
`||otS|WVHS
`SorOLSjo00"7ere00SO19
`
`8S.Svs
`
`sIxy©ossja00y3~SOISIIM»))SSS
`
`
`JOSUaSduiyTalli
`
`8dIA9Q
`
`sey~Lrawsiain}-[oua|06
`098"gog7{_t0n1000HJH_||
`
`:02gunPuyf+seneosuess4|Bulssao0lg
`——LseBury4_Jeaua
`S6rve|saying|SOs
`32S|
`
`eyng--{_duwFy°?8
`Bujuonpuod/sey!s
`
` |sas
`‘JOAUG
`
`nounjeseyY
`02‘DId
`
`06S
`
`S2v
`
`009
`
`JOJE|IOSO
`
`abeljor
`
`JoyeinBay
`
`18
`
`18
`
`
`
`
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 18 of 47
`
`US 2004/0152957 A1
`
`OSZ
`
`ONLLNdWOO
`
`30130
`
`-GaYIM
`
`NOILLOANNOO
`
`092
`
`
`
`-SSSTSHIM-
`
`NOLLOANNOO
`
`ALINIXO¥d
`
`ONISNSS
`
`AOIAAG
`
`
`
`OrdFJIULOVLSenge
`
`|
`
`gol
`
`le“Oi4
`
`
`
`oez—7)Tglanv
`
`
`
`‘GELWNSIA
`
`LNdLNO
`
`002
`
`SO0Z
`
`LNdNI
`
`TWOIDOTOISAHd
`_(S)HOSNSS
`
`O12
`
`_“WANVIN
`
`AYLNA
`
`WNLXALNOO
`
`(S)HOSNAS
`
`19
`
`SeZ~
`
`GtZ
`
`—NOWOVHYALNI
`
`AOIASG-OL-S0IASG
`
`LIOMdx3
`
`OcL~_
`
`N3AQGdIH
`
`FOSC-OL-30IAgG
`
`|
`NOILOVY3LNI
`
`19
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 19 of 47
`
`US 2004/0152957 Al
`
`\
`
`1022
`
`OT,
`
`810
`
`20
`
`20
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 20 of 47
`
`US 2004/0152957 Al
`
`21
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 21 of 47
`
`US 2004/0152957 Al
`
`
`
`FIG. 26
`
`22
`
`22
`
`

`

`ISHOSNASHSD|dO07LNSHHNDfjHILTSS¥dM07OrbNy:
`628026“zgoetnd
`YNITSSITSYIMYOGSYIM~-9V4H3INI
`
`
`
`
`BRvOERS|MONONAeaLIVa5ananioo||Pacis][.-Y3MOd
`
`
`086—~{__YOSN3S.903__|Jvuols||3WATOd!FS26~[SHOSNISONNOS/LHOMLNSIGINYeeeeT0ge8018—~{SYOSNaSdL}-—no,|SER
`
`S00l"0001~TwosnasAUINIXO¥d
`
`uOH[EaNUSSVENOTH—{aw}OWviva||faMe
`
`
`
`YIONGSNVELGNNOS~-YSATHO
`YOLOINNOONid¥JOVUAINIGSN
`
`UaAgOSNVUL4S66“0S”[WOSNASSONVOBAMI
`VNNGINYKY”
`cog~|HaLaWouTTI00V|wadsNd|G16ol
`
`LINN|YOLVTHOSO
`
`
`
`ZO]|9OS-NON
`
`
`
`Patent Application Publication
`
`Aug. 5, 2004 Sheet 22 of 47
`
`US 2004/0152957 A1
`
`O/¥3aSnNe
`
`OLOL
`
`.
`
`O16
`
`Fame
`
`23
`
`
`
`sv0l1190ALE
`
`0S6
`
`JOVIIOA
`
`YOLVINDSY
`
`
`
`
`
`-ONISS3Z00¥d.G6
`
`Y3SN1
`
`GLOL~}HOLIMS
`
`CuVOENO
`sq3/d01
`Ze‘Dis
`
`ae713834
`
`0€01
`
`G2OLGEOL
`
`AULINOUIO
`
`23
`
`
`
`
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 23 of 47
`
`US 2004/0152957 Al
`
`
`
`FIG. 28
`
`24
`
`24
`
`

`

`Patent Application Publication
`
`Aug. 5, 2004 Sheet 24 of 47
`
`US 2004/0152957 A1
`
`G26
`
`oAWaSNKk
`
`
`
`olcnyO10st[esonosNvaLANOSwinud+
`FosnasYaooringuunoLaidssvamo1}]a28260
`
`ia000)~TYOSN3SALINIKOUd
`
`YINITSS3T3HIMHOG3HIM
`
`
`YOLOANNOONid)|A[_SovSuSINTASN
`a8V0686HOLINOWAYALIVEGEG
`
`
`
`SUOLSINUSHLEYuallySSvdMO1-}—]_dVaNVIVO
`
`VNNGINYWIABOSNVELJU
`$66066
`
`0888028SHOSNASdil
`
`
`SHOSNISGNNOS/LHONINSIGWV
`C06YALSWOYT1F00V434408G\608Fane
`
`
`695“LHOSNASJONVC3dINI
`086YOSNAS994
`JOVIUSING
`
`
`GLOL~JHOLIMSsqqvagn_.
`ZL01-_90S-NON
`YILYIANODJOVYOLS
`
`yaSN:GHVOENO6¢e‘Sis
`LINN|HOLYTHIOSO|ONISSSOOUdSSL
`
`006138394
`G20L GEdt
`
`yoOSOL_
`
`JOVHOLS||ANaLLVaWW
`0g0L:
`
`O16
`
`¥34jNg
`
`OvOl
`
`WVY90ud
`
`25
`
`18008
`
`HALHIANOD
`
`AMLINOUID
`
`25
`
`
`
`
`
`
`

`

`
`
`26
`
`

`

`
`
`27
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 27 of 47
`
`US 2004/0152957 Al
`
`28
`
`

`

`
`
`29
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 29 of 47
`
`US 2004/0152957 Al
`
`|
`
`pate FIG. 35A
`
`PRIORART
`
`1110
`
`|
`
`1100ye FIG. 358
`
`
`_
`
`PRIORART
`
`eee: iii
`
`.
`
`805
`
`FIG. 35C
`
`| ett
`
`"FIG. 35D FIG. 35E
`
`FIG. 35F
`
`FIG. 35G
`
`FIG. 35H
`
`30
`
`30
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 30 of 47
`
`US 2004/0152957 Al
`
`1100.
`
`FIG. 36A
`
`1140B
`
`FIG. 36B
`
`
`
`
`
`U8 FIG. 36D
`
`1130A
`
`.
`
`805
`1130B
`
`|
`
`1110
`
`195A4pcts411358 FIG. 36E
`
`pi,TActsEISFig, 36G
`SG owe Bs
`835
`840
`1110
`
`805
`;
`1130B
`1130A
`ScA a, oot
`835
`840
`111
`
`31
`
`31
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 31 of 47
`
`US 2004/0152957 Al
`
`~ 805
`
`32
`
`32
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 32 of 47
`
`US 2004/0152957 Al
`
`FIG. 38A
`
`FIG. 38B
`
`
`
`
`
`
`33
`
`FIG. 38C
`
`FIG. 38D
`
`33
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 33 of 47
`
`US 2004/0152957 Al
`
`FIG. 39A
`
`
`
`
` FIG. 39C
`
`FIG. 39B
`
`34
`
`34
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 34 of 47
`
`US 2004/0152957 Al
`
`1160A
`
`
`
`
`FIG. 39D
`
`1155
`
`1155
`
`1160A |
`
`805
`
`~/
`
`1135A
`
`1160B
`
`FIG. 39E
`
`SL ric(Fo |
`
`
`
`FIG. 39F
`
`35
`
`35
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 35 of 47
`
`US 2004/0152957 Al
`
`1170A)1150 we\OS
`
`
`
`
`|
`
`¥
`A
`
`1155
`
`1160B
`810
`
`1155
`
`805
`
`\ 27
`AY
`
`FIG. 39G
`
`36
`
`36
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 36 of 47
`
`US 2004/0152957 Al
`
`
`
`37
`
`37
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 37 of 47
`
`US 2004/0152957 Al
`
` REDRAW
`
`
`>
`
`SCREEN
`
`WAIT FOR
`> USER INPUT
`
`6200
`
`
`
`[6800
`
`SYSTEM
`COMMAND
`
`[7406
`
`
`
`CLOCKWISE
`ROTATE
`
`
`
`
`
`
`CHECKTHE TYPE OF
`
`PREVIOUS
`
`|
`THEHOTSPOT
`
`HOTSPOT
`HOTSPOT
`(e,g. HYPERLINK, MENU]|"NEXT SCREEN"
`
`
`
`
`
`_.
`OR
`SELECTION, TOGGLE)
`
`EXECUTE RELEVANT||“PREVIOUS SCREEN"
`CODE
`
`
`
`7600
`
`FIG. 42
`PRIOR ART
`
`38
`
`38
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 38 of 47
`
`US 2004/0152957 Al
`
`i 2750 2400
`Pf
`YOU ADDED 360 CALORIES
`TO TODAY'S TOTAL!
`
`FIG. 43B
`
`
`
`88 BuRNEO 5
`
`
`CALORIES. 4 CALORIES
`CONSUMED
`
`
`
`
`
`
`FIG. 43C
`
`39
`
`39
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 39 of 47
`
`US 2004/0152957 Al
`
`
` APPLE CHIPS, DRIED
`APPLE SRANBERRRYJUI...
`¢
`BUTTON YY
`
`
`
`APPLEPIE, LITTLE DE.
`
`40
`
`40
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 40 of 47
`
`US 2004/0152957 Al
`
`CALORIC
`
`DENSITY
`
`FIG. 43G
`
`A1
`
`41
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 41 of 47
`
`US 2004/0152957 Al
`
`CALORIC
`DENSITY |
`
`1250
`
`
`FIG. 43H
`
`42
`
`42
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 42 of 47
`
`US 2004/0152957 Al
`
`INDIVIDUAL ADAPTATION: DIARY DCIvs. GRID DCI(CP)
`
`4000
`
`3500
`
`woSSooe
`
`2500
`
`2000
`
`1500
`
`ESTIMATE 1000
`
`DIARYBASED
`CORRELATION = 0.5732 GF 1500
`
`|
`
`FIG. 43I
`
`500
`
`3000
`2009 2500
`1500
`1000
`ADAPTIVE GRID BASEDESTIMATE
`
`3600
`
`4000
`
`DIARY vs. QUICK ESTIMATE, EACH CIRCLE IS A MEAL,:
`NO NORMALIZATION
`
`-2500“=2006
`
`5
`
`400
`
`500
`
`600
`
`GUESSES
`
`700
`
`800
`
`900
`
`1000
`
`43
`
`1000
`
`500
`
`=Oa
`
`d
`
`oe 85 g
`FIG. 43)
`
`100
`
`200
`
`300
`
`.
`
`43
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 43 of 47
`
`US 2004/0152957 A1
`
`Szel—0¢etFOVLION
`
`|
`ONISSIOOUdole
`
`HOLOSNNOO-—{|INAYOLVTIIOSO3OVSUSLNISHIMQHVH
`
`
`Seeogel0061
`|-—{__
`VNNBINYNITSS3T3HIMTOLVOd
`
`
`
`HSZZN@/HAONIYHAAGS26by
`|
`ShelOrel
`proldea{wa}[ann|[nemova
`
`st¢b~Nowina|SHSAING
`
`|olZLosel
`OLELAOVYOLS
`WVHDOHdO9Et
`JOIASGAYALLVE
`|__13S34
`
`
`GSE
`
`SOC}
`
`44
`
`
`asvavivG
`
`SLEb"|SoNauasaH
`
`_SOELADVYHOLS
`
`~Viva
`
`~.JORG
`
`44
`
`
`
`
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 44 of 47
`
`US 2004/0152957 Al
`
`
`
`FIG. 45
`
`45
`
`45
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 45 of 47
`
`US 2004/0152957 A1
`
`ozstYSANaS
`
`LOWY
`
`SzS}39Ig0
`
`ONILNdNOO
`
`or“Old
`
`OLSL
`
`|I
`
`|
`
`|S{St
`
`GOSL
`
`Oezt
`
`!!JOIad
`1|DNILAdWOO
`1O6Zb
`||
`0021LOZb
`
`OIAO/!SOSNSS
`INAWdINOA
`ASlOWsx3S
`
`!
`
`
`
`Q0SI771L--------------------------J
`
`JOIAgG
`
`_0€2t
`
`46
`
`46
`
`
`
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 46 of 47
`
`US 2004/0152957 A1
`
`Oz9L
`
`
`
`WHLINOD1V—-LSOd
`
`{|YOssa20ud
`
`LySls
`
`
`
`YOLOALACLXALNOD
`
`SOL andino
`
`SO9/
`
`0091
`
`
`
`WOUSGSASSTANNVHS
`
`
`
`
`
`
`
`. QNVWLVGMOSNES|
`
`NOILVINYOINISIHVYDSOWAG
`
`47
`
`47
`
`
`
`

`

`Patent Application Publication Aug. 5, 2004 Sheet 47 of 47
`
`US 2004/0152957 A1
`
`S09}
`
`0091
`
`OZ9L
`
`
`
`ASYANS1S0Od
`
` AYNLIGNAdXa©
`yOssa90ud
`
`87Sls
`
`SLOL
`
`
`
`YOLI31LA0LXALNOD
`
`
`
`NOILVINMOANISIHdVYSOWSa
`
`NVYING‘USS
`
`48
`
`
`
`
`
`‘dH‘OVSA“PASH‘OVSL‘SAV
`
`48
`
`
`
`
`
`

`

`US 2004/0152957 Al
`
`Aug. 5, 2004
`
`APPARATUS FOR DETECTING, RECEIVING,
`DERIVING AND DISPLAYING HUMAN
`PHYSIOLOGICAL AND CONTEXTUAL
`INFORMATION
`
`CROSS REFERENCE TO A RELATED
`APPLICATION
`
`[0001] This application claims the benefit of U.S. Provi-
`sional Application No. 60/417,163 filed on Oct. 9, 2002.
`
`FIELD OF THE INVENTION
`
`[0002] The present invention relates to an apparatus which
`includes one or more sensors for collecting data relating to
`an individual’s physiological state and various contextual
`parameters and a data input and output device for enabling
`the individual to enter information and for displaying infor-
`mation to the individual. In particular, the invention, accord-
`ing to one aspect, relates to an apparatus and method for
`tracking caloric consumption and/or caloric expenditure of
`an individual.
`
`BACKGROUND OF THE INVENTION
`
`[0003] Research has shownthat a large numberof the top
`health problems in society are either caused in whole or in
`part by an unhealthy lifestyle. More and more, our society
`requires people to lead fast-paced, achievement-oriented
`lifestyles that often result in poor eating habits, high stress
`levels, lack of exercise, poor sleep habits and the inability to
`find the time to center the mind and relax. Recognizing this
`fact, people are becoming increasingly interested in estab-
`lishing a healthier lifestyle.
`
`[0004] Traditional medicine, embodied in the form of an
`HMOorsimilar organizations, does not have the time, the
`training, or the reimbursement mechanism to address the
`needs of those individuals interested in a healthier lifestyle.
`There have been several attempts to meet the needs of these
`individuals, including a perfusion of fitness programs and
`exercise equipment, dietary plans, self-help books, alterna-
`tive therapies, and most recently, a plethora of health infor-
`mation websites on the Internet. Each of these attempts are
`targeted to empower the individual to take charge and get
`healthy. Each of these attempts, however, addresses only
`part of the needs of individuals seeking a healthier lifestyle
`and ignores many of the real barriers that most individuals
`face whentrying to adopt a healthier lifestyle. These barriers
`includethe fact that the individualis often left to himself or
`herself to find motivation, to implementa plan for achieving
`a healthier lifestyle, to monitor progress, and to brainstorm
`solutions when problemsarise; the fact that existing pro-
`grams are directed to only certain aspects of a healthier
`lifestyle, and rarely come as a complete package; and the
`fact
`that recommendations are often not
`targeted to the
`unique characteristics of the individual or his life circum-
`stances.
`
`SUMMARYOF THE INVENTION
`
`[0005] The present invention relates to an apparatus for
`monitoring human status parameters that includes a sensor
`device in electronic communication with at least one sensor
`
`adapted to generate data indicative of at least a first param-
`eter of the individual and an I/O device in electronic
`communication with the sensor device. The I/O device
`
`receives the data indicative of at least a first parameter from
`the sensor device and data indicative of a second parameter
`of the individual generated by a second sensor. At least one
`of the first parameter and the second parameter are physi-
`ological. The I/O device generates derived data using the
`data indicative of at least a first parameter and the data
`indicative of a second parameter, wherein the derived data
`comprises a third parameter of the individual that is an
`individual status parameter that cannot be directly detected
`by the at least one sensor or the second sensor. The I/O
`device further includes means for displaying information
`based on the third parameter.
`
`[0006] The I/O device may further include means for
`enabling the individual to enter information relating to the
`individual into the I/O device. The third parameter of the
`individual may any one of physical activity, sleep activity,
`nutrition activity, mind centering activity, stress level, meta-
`bolic rate, and oxygen consumption rate. Specifically, the
`third parameter may be data relating to caloric expenditure
`of said individual. In such an embodiment, the I/O device
`may include means for enabling the individual
`to enter
`information relating to calories consumedbythe individual,
`and the I/O device may generate caloric consumption data
`using the information relating to calories consumed. Infor-
`mation based on the caloric expenditure data and the caloric
`consumption data, such as energy balance data, a rate of
`weight loss or gain, or information relating to one or more
`goals of said individual may then be displayed. The third
`parameter may also includes data relating to caloric con-
`sumption of said individual. In any embodiment, the infor-
`mation entered into the I/O device may also be used to
`generate the derived data.
`
`In the apparatus, at least one of the at least one
`[0007]
`sensor and the second sensor may be a contextual sensor. In
`addition, the I/O device may further comprise a processor
`for generating the derived data. Alternatively,
`the may
`further comprise a computing device having a processor in
`electronic communication with the I/O device, wherein the
`1/O device generates the derived data by communicating the
`data indicative of at least a first parameter and the data
`indicative of a second parameter to the computing device
`and receiving the derived data from the computing device,
`wherein the processor of the computing device generates the
`derived data.
`
`In an alternate embodiment, the present invention
`[0008]
`relates to an apparatus for detecting at least one of human
`physiological and contextual information from the body of
`a wearerthat includes a sensor device adapted to be worn on
`the body having one or more sensors selected from the group
`consisting of physiological sensors and contextual sensors
`and an I/O device in electronic communication with said
`sensor device. The I/O device includes meansfor displaying
`information and a dial, the dial being supported for rota-
`tional movementabout an external surface of the I/O device.
`The dial enables the wearer to enter information into the I/O
`device. The I/O device may further include at least one
`button that also enables the wearer to enter information into
`the I/O device. The I/O device may also have access to a
`database of reference data, with the dial and the at least one
`button being used to access portions of said reference data.
`
`In one embodiment, the sensor device has a pro-
`[0009]
`cessing unit in electronic communication with and receiving
`
`49
`
`49
`
`

`

`US 2004/0152957 Al
`
`Aug. 5, 2004
`
`mined for each of the classification identifiers based on an
`algorithm, which may be a simple look-up table or may be
`more complicated in addition, the classification identifiers
`may each comprise an indication of an estimated size of a
`meal, such as S, M, Land XL, or may comprise a point value
`based on an estimated size of a meal. Alternatively, each of
`the classification identifiers may be comprise a plurality of
`point values forming a grid, each of the point values being
`based on an estimated size and caloric density associated
`with a meal. The apparatus may further comprise a sensor
`device adapted to be worn on the individual’s body that
`generates data relating to caloric expenditure of the indi-
`vidual, the sensor device being in electronic communication
`with the processor. The processorreceives the caloric expen-
`diture data from the sensor device and generates information
`based on the caloric expenditure data and the caloric con-
`sumption data that may include energy balance data, a rate
`of weightloss or gain,or informationrelating to one or more
`goals of the individual. The sensor device may further
`include a second processor in electronic communication
`with at
`least
`two sensors, at
`least one sensor being a
`physiological sensor, the sensors being adapted to generate
`data indicative of at least a first parameter of the individual
`and a second parameterof the individual,the first parameter
`being physiological. The second processoris programmed to
`generate the caloric expenditure data using the data indica-
`tive of a first parameter and a second parameter. The
`apparatus may also further comprise a computing device
`having software for enabling the individual to enter one or
`more food items for each meal consumed by the individual
`and for associating a second caloric amount with the meal
`based on the food items. The processor in this embodiment
`receiving, for each meal consumedbythe individual over a
`predetermined time period, the second caloric amounts and
`adjusting for each of the classification identifiers the corre-
`sponding caloric amount based on the second caloric
`amounts. The software may include a database of food data
`including the food items and the second caloric amounts.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`{0012] Further features and advantages of the present
`invention will be apparent upon consideration of the fol-
`lowing detailed description of the present invention, taken in
`conjunction with the following drawings,
`in which like
`reference characters refer to like parts, and in which:
`
`FIG.2 isa block diagram of an embodimentof the
`[0014]
`sensor device shown in FIG. 1;
`
`one or more signals from the one or more sensors. The
`processing unit generates data indicative of calories
`expended bythe wearer from at least one of the one or more
`signals,
`the data indicative of calories expended being
`transmitted from the sensor device to the I/O device. The
`information entered by the wearer in this embodiment
`includes data relating to calories consumed by the wearer.
`The apparatus displays caloric expenditure data and caloric
`consumption data, the caloric expenditure data being based
`on the data indicative of calories expended by said wearer
`and the caloric consumption data being based on the data
`relating to calories consumed by the wearer. The I/O device
`may have access to a database of food data including food
`items and associated caloric values, wherein the information
`is entered by the wearer by accessing and selecting specific
`pieces of the food data from said database.
`[0010] The present invention also relates to an apparatus
`for tracking caloric consumption and caloric expenditure of
`an individual that includes a sensor device adapted to be
`worn on an individual’s body and an I/O devicein electronic
`communication with the sensor device. The sensor device
`includes a processor in electronic communication with at
`least two sensors, at least one sensor being a physiological
`sensor, the sensors being adapted to generate data indicative
`of at least a first parameter of the individual and a second
`parameter of the individual, the first parameter being physi-
`ological. The processor is programmed to generate data
`relating to caloric expenditure of the individual using the
`data indicative of a first parameter and a second parameter.
`The I/O device receives the caloric expenditure data from
`the sensor device. The I/O device includes means for
`enabling the individual
`to enter information relating to
`calories consumed by the individual, wherein the informa-
`tion relating to calories consumedis used to generate caloric
`consumption data. The I/O device further includes meansfor
`displaying information based on the caloric expenditure data
`and the caloric consumption data. The I/O device may have
`access to a database of food data comprising food items and
`associated caloric values, the database being used to gener-
`ate the caloric consumption data. The displayed information
`may include energy balance data, a rate of weight loss or
`gain, or information relating to one or more goals of the
`individual. The at least two sensors may be included within
`the sensor device, or at least one of the sensors may located
`separately from the sensor device. At least oneofthe at least
`two sensors may be a contextual sensor. The I/O device may
`be adapted to display one or more suggestions for achieving
`[0013] FIG.1is a diagram of an embodimentof a system
`one or more goals based on the caloric consumption data and
`for monitoring physiological data and lifestyle over an
`the caloric expenditure data.
`electronic network according to the present invention;
`[0011]
`In yet another alternate embodiment, The present
`invention relates to an apparatus for tracking caloric infor-
`mation for an individual that includes means for displaying
`a plurality of classification identifiers for classifying meals
`(0015] FIG.3isa block diagram of an embodimentof the
`consumed by the individual, each of the classification iden-
`central monitoring unit shown in FIG. 1;
`tifiers having a corresponding caloric amount, means for
`selecting, for each meal consumedbythe individual, one of
`the classification identifiers, and a processor for generating
`and storing caloric consumption data for the individual
`based on the caloric amount corresponding to the classifi-
`cation identifier selected by the individual for each meal
`consumed by the individual. The corresponding caloric
`amounts may be generic amounts designed to suit
`the
`general public or maybetailored specifically for the indi-
`vidual. The corresponding caloric amounts maybe deter-
`
`FIG.4 is a block diagram of an alternate embodi-
`[0016]
`ment of the central monitoring unit shown in FIG. 1;
`
`[0017] FIG. 5 is a representation of a preferred embodi-
`mentof the Health Manager web page according to an aspect
`of the present invention;
`
`[0018] FIG. 6 is a representation of a preferred embodi-
`mentof the nutrition web page according to an aspect of the
`present invention;
`
`50
`
`50
`
`

`

`US 2004/0152957 Al
`
`Aug. 5, 2004
`
`[0019] FIG. 7 is a representation of a preferred embodi-
`mentof the activity level web page according to an aspect
`of the present invention;
`
`FIG.28 is a front view of an alternate embodiment
`[0039]
`of a sensor device according to the present invention includ-
`ing an LCD;
`
`[0020] FIG. 8 is a representation of a preferred embodi-
`mentof the mind centering web page according to an aspect
`of the present invention;
`
`[0021] FIG. 9 is a representation of a preferred embodi-
`ment of the sleep web page according to an aspect of the
`present invention;
`
`[0022] FIG. 10 is a representation of a preferred embodi-
`mentof the daily activities web page according to an aspect
`of the present invention;
`
`[0023] FIG. 11 is a representation of a preferred embodi-
`ment of the Health Index web page according to an aspect
`of the present invention;
`
`[0024] FIG. 12 is a front view of a specific embodiment
`of the sensor device shown in FIG.1;
`
`[0025] FIG. 13 is a back view ofa specific embodiment of
`the sensor device shown in FIG.1;
`
`[0026] FIG. 14 isa side view of a specific embodiment of
`the sensor device shown in FIG.1;
`
`[0027] FIG. 15 is a bottom view of a specific embodiment
`of the sensor device shown in FIG.1;
`
`[0028] FIGS. 16 and 17 are front perspective views of a
`specific embodimentof the sensor device shownin FIG.1;
`
`[0029] FIG. 18 is an exploded side perspective view of a
`specific embodimentof the sensor device shownin FIG.1;
`
`[0030] FIG. 19 is a side view of the sensor device shown
`in FIGS. 12 through 18 inserted into a battery recharger
`unit;
`
`[0031] FIG. 20 is a block diagram illustrating all of the
`components either mounted on or coupled to the printed
`circuit board forming a part of the sensor device shown in
`FIGS.12 through 18; and
`
`[0032] FIG. 21 is a block diagram of an apparatus for
`monitoring health, wellness and fitness according to an
`alternate embodiment of the present invention.
`
`[0033] FIG. 22 is a front view of an alternate embodiment
`of a sensor device according to the present invention;
`
`[0034] FIG. 23 is a back view of an alternate embodiment
`of a sensor device according to the present invention;
`
`[0035] FIG. 24 is a cross-sectional view of the sensor
`device shown in FIG. 22 taken along lines A-A;
`
`[0036] FIG. 25 is a cross-sectional view of the sensor
`device shown in FIG. 22 taken along lines B-B;
`
`[0037] FIG. 26 is a cross-sectional view of the sensor
`device shownin FIG.22 taken along lines A-A showing the
`internal components of the housing of the sensor device;
`
`[0038] FIG. 27 is a block diagram illustrating the com-
`ponents mounted on or coupled to the printed circuit board
`forming a part of an embodimentof the sensor device shown
`in FIGS. 22 through 26;
`
`[0040] FIG. 29 is a block diagram illustrating the com-
`ponents mounted on or coupled to the printed circuit board
`forming a part of an alternate embodiment of the sensor
`device shown in FIGS. 22 through 26;
`
`[0041] FIGS. 30 and 31 are isometric views of an alter-
`nate embodimentof a sensor device according to the present
`invention having a housing adapted to be removably
`attached to a flexible section;
`
`[0042] FIG. 32 is an isometric view of a further alternate
`embodiment of a sensor device according to the present
`invention having a housing adapted to be removably
`attached to a flexible section;
`
`[0043] FIG. 33 is an isometric view of an embodiment of
`a sensor device having adjustable operating parameters
`according to an aspect of the present invention;
`
`[0044] FIG. 34 is an isometric view of an alternate
`embodiment of a sensor device according to the present
`invention having a housing having an adhesive material on
`an external surface thereof for removably attaching the
`housing to the body;
`
`[0045] FIGS. 35A and B are cross-sectional views of a
`housing for a prior art sensor device;
`
`[0046] FIGS. 36C through H are cross-sectional views of
`various embodiments of a housing for a sensor device
`according to an aspect of the present invention taken along
`lines C-C in FIG,23.
`
`[0047] FIG. 36Ais a cross-sectional view of a housing for
`a prior art sensor device;
`
`[0048] FIGS. 36B through H are cross-sectional views of
`various embodiments of a housing for a sensor device
`according to an aspect of the present invention taken along
`lines D-D in FIG. 23;
`
`[0049] FIG. 37 is an isometric view of an embodiment of
`a housing for a sensor device according to the present
`invention having a bottom or inner surface having a con-
`cavity in one direction and a convexity in another direction;
`
`[0050] FIGS. 38A through D are cross-sectional views of
`a housing for a sensor device having a flat top surface and
`flat lateral ends;
`
`[0051] FIGS. 39A through F are cross-sectional views of
`various embodiments of a housing for a sensor device
`having surfaces designed to deflect objects and prevent
`movement of the housing;
`
`[0052] FIG. 39Gis a cross-sectional view of the housing
`shown in FIG. 39E attached to a flexible section;
`
`[0053] FIG. 40 is a top plan view of a data input and
`output device according to the present invention;
`
`FIG.41 is a partial cross-sectional view of the data
`[0054]
`input and output device shown in FIG.40 taken along lines
`A-A in FIG. 40;
`
`[0055] FIG. 42 is a block diagram illustrating the opera-
`tion of prior art software that enables a prior art input device
`
`51
`
`51
`
`

`

`US 2004/0152957 Al
`
`Aug. 5, 2004
`
`having a dial and a button to control the operation of a
`computer by identifying and selecting hot spots;
`
`[0056] FIGS. 43A-F is a top plan view ofa data input and
`output device according to an embodimentof the present
`invention in which energy related data for an individual is
`collected or generated by the data input and output device
`and a sensor device in ele