`
`U800865204OB2
`
`(12}
`
`United States Patent
`LeBoeuf et a1.
`
`(10) Patent No.:
`
`[45; Date of Patent:
`
`US 8,652,040 32
`Feb. 18, 2014
`
`(54)
`
`(75)
`
`TELEMETRIC APPARATUS FOR HEALTH
`AND ENVIRONMENTAL MONITOR] NG
`
`Inventors: Steven Francis LeBoenf. Raleigh. NC
`(US): Jesse Berkley Tucker.
`Schenectady. NY (US): Michael
`Edward Aumer. Raleigh. N(‘ (US)
`
`(73}
`
`Assignee: Valence“. lne.. Raleigh. NC (US)
`
`t * 1
`
`Notice:
`
`Subject to an}r disclaimer. the term 0 1'this
`patent
`is extended or adjusted under 35
`U.S.C‘. 154(1)) by 1198 days.
`
`App1.No.: 111811.844
`
`l’iled:
`
`Jun. 12. 2007
`
`4.541.905 A
`4.592.150? A
`4.655.225 A
`5.022.970 A
`5.079.421 A ‘1‘
`5.348.002 A
`5.492.129 A
`5.499.301 A "‘
`5911.308 A
`5.143.260 A
`5.179.631 A
`5.853.005 A “
`6.004.274 A
`6.045.511 A
`6.283.915 B
`6.285.816 Bl
`
`9-"1985 Kuwanzl el al.
`6.31986 Switzer
`41198? Dahncetal.
`61991 Cook elal.
`131992 Knudsen elal.
`9-1994 Caro
`211996 Greenherger
`311996 Stldo eta].
`H998 Singer
`451998 Chung etal.
`14998 Chance
`[251998 Scnnlon
`12-1999 Nolanetal.
`4.12000 Otl ct a1.
`9.2001 Aeeti el al.
`Anderson et :11.
`9-2001
`
`(Continued)
`
`FOR] EIGN PATIENT DOCUMENTS
`
`2505343
`
`381-913
`
`600-459
`
`(21)
`
`(22)
`
`(65)
`
`(an)
`
`(51}
`
`(52)
`
`(58}
`
`(56}
`
`Prior Publication Data
`
`W0
`
`W0 20133038296 Al
`
`332013
`
`US 200810146890 A]
`
`Jun. 19. 2008
`
`011 [HR PUTSLICKFIONS
`
`Related U.S.Applieation Data
`
`Provisional application No. 601905.761. tiled on Mar.
`8. 2007. provisional application No. 601876.128. tiled
`on Dec.
`21. 2006. provisional application No.
`601815.606. [iled on Dec. 19. 2006.
`
`Int. C1.
`.4618 5/00
`U.S. Cl.
`
`(2006.01)
`
`Field of Classification Search
`USPC
`600800—301:38117114114
`Sec application file for complete search history.
`
`6001301
`
`References Cited
`
`U .S. PA'I'IEN'I‘ DOCUMENTS
`
`4.240.882 A
`4.438372 A
`4.521.499 A
`
`[2-1980 Aug et al.
`3-‘1984 Slavin
`6-1985 Switzer
`
`international Search Report and Written Opinion ol'the international
`Searching Authority. corresponding to l’CT'USEflOT-‘JOZ 5114.1mi1od
`May 13. 2003.
`
`(Continued)
`
`13111 ’l‘homson
`
`Primary Examiner
`- Bobby 501121110
`Assistant Exmm'ner
`[74) Arm-meta Agent. or Firm — Myers Rigel Sibleyr 8'.
`saiovec. PA.
`
`(57}
`
`ABSTRACT
`
`Wearable apparatus for monitoring. various physiological and
`environmental factors are provided. Real—time. noninvasive
`health and environmental monitors include a plurality 01‘
`compact sensors integrated within small. low-profile devices,
`such as earpiece modules. Physiological and environmental
`data is collected and wirelessly transmitted into a wireless
`network. where the data is stored andfor processed.
`
`57 Claims. 11 Drawing Sheets
`
`ZOO
`\ SECONDARY
`MODULES
`2m
`
`2111
`
` PORTABLE
`PRIMARY
`TELEEOMMUNICATION
`
`MODULE
`
`SENSOR MODULE
`
`21 2
`
`
`
`21 3
`
`
`ANONYMOUS
`DATABASE
`
`J TRANSMISSION
`
`SYSTEM
`
`
`
` INTERFACE
`
`0001
`
`US. Patent No. 8,652,040
`
`Apple Inc.
`APLlOOl
`
`Apple Inc.
`APL1001
`U.S. Patent No. 8,652,040
`
`0001
`
`
`
`5.289.230 B1
`5.332.858 Bl
`5.351.550 Bl
`5.443.890 Bl
`5.444.474 Bl
`5.454.718 131
`5.458.080 Bl *
`5.470.893 Bl
`5.514.278 Bl
`5.527.711 B1
`5.534.012 Bl
`5.555.852 131
`5.571.117 Bl
`5.505.038 r31
`5.531.195 131
`5.594.180 Bl
`5.750.510 132
`5.893.395 B2
`5.953.435 132
`7.041.052 B2
`7.043.287 Bl
`7054.574 82
`7.088.234 B2
`7.107.088 132
`8.415.959 132*
`200270143242 41*
`2003770007531 41
`200370054712 41
`200370220584 41*
`200470004547 41*
`200470022700 41
`200470120844 41
`200470138578 41
`200470185390 41
`200470219055 41
`200470228494 41*
`200470242975 41
`200570004458 41*
`200570043530 41*
`200570119833 41
`200570148883 41
`200570177034 41*
`200570192515 41*
`200570203349 41
`200570222487 41*
`200570228244 41*
`2005702587715 Al
`200570259811 41*
`
`972001
`1272001
`372002
`972002
`972002
`972002
`[072002
`[072002
`272003
`372003
`372003
`472003
`572003
`872003
`1072003
`272004
`772004
`572005
`1072005
`572005
`572005
`572006
`872005
`972005
`4720 13
`I 072002
`172003
`472003
`1 172003
`172004
`272004
`672004
`772004
`972004
`1 172004
`I 172004
`[272004
`172005
`272005
`72005
`772005
`872005
`972005
`972005
`1072005
`[072005
`1 172005
`1 172005
`
`............... .. 6007300
`
`C110111813 at :11.
`Sato ct al.
`Goldsrein
`501111121: et 31.
`Thomas et al.
`Clifi
`Brown 01 al.
`30050:!
`I-Iibsl 01 81.
`Stivoric et all.
`Hazon ot a].
`Schuizc et al.
`Marbach
`Tailor et ai.
`Taenzer or 8].
`3005011
`Tschupp e! a].
`Schulxe er al.
`Kondo or al.
`Friedrichs or a].
`Khalil ct 81.
`Cane or al.
`Naiio e1 2.1.
`r‘CL‘ii
`................... .. 381771.61
`Lott el :11.
`Nemirovski
`................ .. 6007300
`Boiognesi et a].
`Gaston at a].
`I'Ioneyagcr cl al.
`Appollotal.
`Kim et al.
`'l'ribeisky at :Ll.
`Pineda ot 21].
`Ross et :11.
`Tribe-[sky et :11.
`Smith ........................... .. 381767
`Abreu
`6007437
`Kanayztma el al.
`Buchcrt
`...................... .. 6007473
`Naniknshvili
`13005011
`................... .. 6007323
`Beaumont
`Givens or a].
`.
`.. 6007559
`
`Nanikashvili
`600725
`Miilor ct al.
`Bane!
`.......................... .. 600730l
`Zen el 31.
`Kim et al.
`
`..
`
`
`. 6007559
`3407573. 1
`
`................ .. 3797430
`
`US 8,652,040 B2
`
`Page 2
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`372006 Shalon eta].
`200670064037 A1
`472006 Barret elal.
`200670084378 Al
`672006 Yates elal.
`200670123385 Al
`972006 211210
`200670205083 Al
`972006 K0611: et al.
`200670210058 Al
`[072006 211210
`200670240558 Al
`[172006 Mai:th
`200670246342 Al
`172007 Filkinsctal.
`200770015992 Al"
`272007 Olivcrctai.
`200770027367 741*
`372007 Drinrlnetal.
`200770060800 Al‘
`372007 Dcvaul 01 n].
`20077006311150 Al *
`572007 Grilliot ct :11.
`200770116314 Al‘“
`372008 Doroguskor or a].
`200870076972 Al *
`572008 Banet elal.
`200370114220 AI“
`172009 Yang 618.1.
`200970030350 Al
`.............. .. 600730l
`372009 Nielsen elal.
`200970060645 Al"
`572009 Moroney. [Ilel a].
`6007301
`200970131761 Al‘“
`OTHER PUBLICATIONS
`
`6007407
`6007300
`6007300
`
`34075711
`
`3317367
`
`6007300
`6007301
`
`
`Anpo cl :1]. "Pholocatalyiic Reduction ofCo: Will: 1120 on Titanium
`Oxides Anchored within Microporcs of Zoo-lites: Effects 01'th Struc-
`Iure of the Active Silos and the Addition of PI“ .7? Phys. Chem. B,
`[01:2632-2636(1997).
`Bérsan et 31. “Underslanding the fundamental principles of metal
`oxide based gas sensors; the example of CO sensing wilh l‘inO2
`sensors in the proscnse of humidity" .701777107 5377371375773: Condensed
`11777271974 5:R8 13-11839 (2003 ).
`Boil "Electrochemisz of Semiconductors“ C‘rn‘r'em Separations
`l7(3):87—9l (1998).
`Martins el al. "Zinc oxide as an ozone sensor" Journal oprpr'ieri
`Physics 96(3): 1398-1408 (2004).
`52117101111 1:181."I’holosynlhesis0fCi-I,‘51121T102 Surface from Gaseous
`H30 and COEJ. Chem. 500.. Chem. Commrm. 533-534 (1995).
`Skubal c! 0.1. "Detection and idonti ficalion of gaseous organics using
`a Tit)2 sensor" 707777707 of 10770700779017.17er and Pirorobr‘oiogy A:
`Chemistry 148:103-108 (2002).
`Skubal el‘ al. “Monitoring Ihe Electrical Response of Photoinduwd
`Organic Oxidearion on TiO3 Surfaces" M23105:an submitted 01:1.
`2000 to SPIE 1r1tl. Symposium on Environment & industrial Sensing,
`Boslon. MA. Nov. 5-8. 2000. sponsored by Sl’lIE. 10 pp.
`Zhang el 81. “Development of Chemical Oxygen Demand Orr-Line
`Monitoring System Based on a Photoelectrochemical Degradation
`Principle" Environ. Sci. T907100!" 40(7):.‘1363-2368 (2006}.
`Filrainer. h1tp:.-”itami .com.
`European Search Report corresponding to European Applicmion No.
`078626603 55155 Apr. 25. 2012; 7 pages.
`
`"‘ cilcd by examiner
`
`0002
`
`0002
`
`
`
`US. Patent
`
`Feb. 18, 2014
`
`Sheetl of 11
`
`US 8,652,040 132
`
`100
`
`103
`
`EARPIECE HOUSING
`
`102
`
`EXTERNAL
`
`
`
`PHYSIOLOGICAL
`
`
`
`
`
`k
`
`107
`
`
`MODULE
`COMPONENT
`PROCESSDRI
` 109
`
`
`
`IRANSMIITER/
`RECEIVER
`SOURCE
`
`
`
`104
`FIG. 1
`
`105
`
`
`
`
`
`POWER
`
`0003
`
`0003
`
`
`
`US. Patent
`
`Feb. 18, 2014
`
`Sheet 2 of 11
`
`US 8,652,040 132
`
`200
`
`\
`
`2m
`
`((
`PORTABLE
`m
`
`
`
`TELECOMMUNICATIDN
`
`
`
`PRIMARY
`MODULE
`
`SENSOR MODULE
`
`(c
`
`3)
`
`\_~1
`
`212
`
`
`
`
`1 TRANSMISSION
`SYSTEM
`
`
`
`300
`
`g‘1
`AVG.BREATHINGRATEAVG.PULSERATE
`
`
`
`
`
`
`
`PHYSICALACTIVITYOZONELEVEL
`
`
`
`[ALI]leINTAKE
`
`—I
`(:3
`n:
`
`MIL
`
`Em_
`
`1
`(:3
`:I:
`1.....I
`
`US STATE
`
`REGION
`
`E P
`
`ULSE RATE
`
`0004
`
`0004
`
`
`
`US. Patent
`
`Feb. 18, 2014
`
`Sheet 3 of 11
`
`US 8,652,040 B2
`
`4""
`
`EXTERNAL ENERGY
`(DIREENGN 2)
`[SENSOR-3 — 403
`EXTERNAL ENERGY :
`
`m
`
`405
`
`(GIREENGNH .
`
`4 2
`
`5
`RHYs1oLGG1cNL ENERGY
`
`I ;
`
`(
`
`
`SIGNAL
`
`IRANSMITEER/
`RECEIVER
`_ _ _ _ _ _ _ _ _ _
`
`4,37
`V/ i
`:2 _ _ _ _ _ _
`
`I _ _ _ _ _ _ _ _
`EYYERNAL ENERGY
`
`(GIREcnoN 3)
`
`FIG. 4
`
`sun
`
`506
`
`505
`
`530
`
`519
`
`\\ 0°“ a
`
`__
`
`
`
`0005
`
`0005
`
`
`
`US. Patent
`
`Feb. 18, 2014
`
`Sheet 4 0f 11
`
`US 8,652,040 BZ
`
`630
`
`
`
`625
`
`624
`
`726
`
`0006
`
`0006
`
`
`
`
`US. Patent
`
`Feb. 18, 2014
`
`Sheet 5 ofll
`
`US 8,652,040 32
`
`
`
`
`
`ENERGY SPECTRUM
`
`[RAW WAVEFORM)
`
`
`'-
`
`.LJ-; m...__..
`
`L
`
`ENERGY SPECIRUM
`(AFTER 10W PASS 8; SIMPLE NOISE CANCELING)
`
`
`
`0007
`
`0007
`
`
`
`US. Patent
`
`Feb. 18,2014
`
`Sheet 6 of 11
`
`US 8,652,040 32
`
`
`
`FIG. 10
`
`0008
`
`0008
`
`
`
`US. Patent
`
`Feb. 18, 2014
`
`Sheet 7 of 11
`
`US 8,652,040 132
`
`
`
`0009
`
`0009
`
`
`
`US. Patent
`
`Feb. 18, 2014
`
`Sheet 8 of 11
`
`US 8,652,040 132
`
`1300
`
`\
`
`I306
`
`
`
`
`
`0010
`
`0010
`
`
`
`US. Patent
`
`Feb. 18, 2014
`
`Sheet 9 of 11
`
`US 8,652,040 132
`
`
`
`1600
`
`ego
`
`FIG. 16
`
`0011
`
`0011
`
`
`
`US. Patent
`
`Feb. 18, 2014
`
`Sheet 10 OH]
`
`US 8,652,040 132
`
`1710
`
`
`
`
`1807
`
`1800
`
`0012
`
`0012
`
`
`
`US. Patent
`
`Feb. 18, 2014
`
`Sheet 11 ofll
`
`US 8,652,040 132
`
`SENSORS
`smson MODULE
`
`smsonmonuu
`
`SIDEVIEW
`OF MOUNTED MODULES
`
`3‘
`
`FLASH
`MEMORY
`
`ghlngIOOTH
`
`EXTENDED SENSOR
`
`FIG. I 9
`
`REAL-TIME SAMPLING RATE ENABLES I I HOURS OF OPERATION
`ENDURANEES >12 HOURS WITH REDUCED MEASUREMENT FREQUENCY
`
`CDOEC
`III AMBIENT LIGHTING
`
`
`
`
`
`
`
`
`
`
`III] BLUEEORE MODULE
`
`BODY TEMPERATURE
`
`Cl ACEELEROMEIER
`
`BAROMEIRIE PRESSURE
`
`[III HUMIDITY & AMBIENT
`TEMPERATURE
`
`AMPLIFIER CIRCUITRY
`
`E MD [ONVERTERS
`
`0013
`
`0013
`
`
`
`US 8,652,040 B2
`
`1
`TELEMETRIC APPARATUS FOR HEALTH
`AND ENVIRONMENTAL MONITORING
`
`RELATED APPLICATION
`
`This application claims the benefit of and priority to Us.
`Provisional Patent Application No. 60f905.761. filed Mar. 8.
`2007. US. Provisional Patent Application No. 60f876,128_.
`filed Dec. 21. 2006. and US. Provisional Patent Application
`No. 60!875,606, filed Dec. 19, 2006, the disclosures ofwhich
`are incorporated herein by reference as if set forth in their
`entireties.
`
`l"lIil.[) 01': T1113 INVENTION
`
`The present invention relates generally to health and envi-
`rotunental monitors and. more particularly, to wireless health
`and environment monitors.
`
`BACKGROUND OF Tl IE INVENTION
`
`There is growing market demand for personal health and
`environmental monitors. for example. for gauging overall
`health and metabolism during exercise, athletic training, diet-
`ing. and physical therapy. However. traditional health monj-
`tors and environmental monitors may be bulky. rigid. and
`uncomfortable generally not suitable for use during daily
`physical activity. There is also growing interest in generating
`and comparing health and environmental exposure statistics
`ofthe general public and particular demographic groups. For
`example, collective statistics enable the healthcarc industry
`and medical community to direct healthcare resources to
`where they are most highly valued. However. methods of
`collecting tlieSe statistics may be expensive and laborious.
`often utilizing human-based recordingfanalysis steps at mul-
`tiple sites.
`As such. improved ways of collecting, storing and analyz—
`ing personal health and environmental
`information are
`needed. In addition. improved ways ofdistribttting raw and
`analyzed personal healtlt and environmental in l’onnation are
`desirable to support elforts to enhance licaltltcare quality and
`reduce costs.
`
`SUMMARY
`
`In view of the above discussion. apparatus for monitoring
`various physiological and environmental factors are pro-
`vided. According to some embodiments of the present inven-
`tion. real—time. noninvasive health and environmental moui~
`tors include a plurality of compact sensors integrated within
`small. low—profile devices. Physiological and environmental
`data is collected and wirelessly transmitted into a wireless
`network. where the data is stored andr‘or processed.
`in some embodiments of tlte invention. an earpiece func-
`tions as a physiological monitor. an enviromnental monitor.
`and a wireless personal communicator. The earpiece can take
`advantage of commercially available open—architecture wire
`less paradigms, such as Bluetoothili'. \Vt—Fi. or ZigBee.
`in
`some embodiments. a small. compact earpiece contains at
`least one microphone and one speaker. and is configured to
`transmit information wirelessly to a recording device such as.
`for example. a cell phone. a personal digital assistant (FDA),
`aitdfor a computer. The earpiece contains a plurality of sen-
`sors for monitoring personal health and environmental expow
`sure. Health and euviroutnental information. sensed by the
`sensors is transmitted wirelessly. in real-time. to a recording
`device, capable of processing and organizing the data into
`
`to
`
`15
`
`3U
`
`-
`
`3U
`
`35
`
`4E]
`
`45
`
`50
`
`.
`
`6o
`
`65
`
`2
`
`meaningful displays, such as charts. In some embodiments,
`an earpiece user can monitor health and envirorunental expo-
`sure data in real-time. and may also access records of col-
`lected data throughout the day. week, month, etc.. by observ-
`ing charts and data through an audio-visual display.
`In some embodiments. an earpiece can integrate personal
`physiological and environmental exposure information with
`biofeedback and personal entertainment. In other embodi-
`ments of the present invention. earpiece monitor devices
`enable a variety of networks. applications. games. and busi-
`ness methods.
`
`ltt sotne embodiments of the present invention. a monitor-
`ing apparatus includes a housing configured to be attached to
`the body of a person. one or more physiological sensors and
`one or more envirotunental sensors supported by (within and!
`or on) the housing. Each physiological sensor is configured to
`detect andfor measure physiological infonnation from the
`person, and each environmental sensor is configured to detect
`andfor measure environmental conditions in a vicinity of the
`person wearing the apparatus. The apparatus also includes a
`signal processor that is, configured to receive and process
`signals produced by the physiological and environmental sen-
`sors. A wireless transmitter is responsive to the signal proces-
`sor and is configured to wirelesst transmit physiological and
`environmental sensor signals as processed by the signal pro-
`cessor from the signal processor to a retttote terminal in
`real-time.
`Each physiological sensor is configured to detect andfor
`measure one or tnore ofthe following types of physiological
`information: heart rate. pulse rate, breathing rate, blood flow.
`heartbeat signatures, cardio-pulmonary health, organ health.
`metabolism. electrolyte type auditor concentration. physical
`activity. caloric intakc, caloric metabolism. blood metabolite
`levels or ratios. blood pl I level. physical atidforpsychological
`stress levels audfor stress level indicators, drug dosage andlor
`dosimetry. physiological drug reactions. drug chemistry. bio-
`chemistry. position andfor balance. body strain. neurological
`functioning. brain activity. brain waves, blood pressure. cra-
`nial pressure. hydration level. anscultatory information. aus-
`cultatory signals associated with pregnancy. physiological
`response to infection. skin andt'or core body temperature. eye
`muscle movement. blood volume. inhaled andfor exhaled
`breath volume. physical exertion, exhaled breath physical
`andr‘or chemical composition. the presence andt’or identity
`andfor concentration of vintses andfor bacteria. foreign mat-
`ter in the body. internal toxins. heavy metals in the body.
`anxiety,
`fertility. ovulation. sex hormones. psychological
`mood. sleep pattents. hunger anda'or thirst. hortnone type
`andr‘or concentration. cholesterol. lipids. blood panel. bone
`density. organ andfor body weight. reflex response, sexual
`arousal. mental andfor physical alertness. sleepiness. auscul-
`latory infon'nation, response to external stimuli. swallowing
`volume. swallowing rate. sickness. voice characteristics.
`voice tone. voice pitch, voice volume. vital signs. head tilt.
`allergic reactions.
`inflammation response. auto-immune
`response. ntutagenic response. DNA. proteins. protein levels
`in the blood, water content ofthe blood. pheromones, internal
`body sounds. digestive system functioning. cellular regenera-
`tion response, healing response, stem cell
`regeneration
`response
`Each environmental sensor is configured to detect andx’or
`measure one or tnore of the following types 0 l‘cnvirotunental
`itfl‘ortnation: climate. humidity. temperature. pressure. baro-
`metric pressure, soot density. airborne particle density. air~
`borne particle size. airborne particle shape, airborne particle
`identity. volatile organic chemicals (VOCs). hydrocarbons.
`polycyclic aromatic hydrocarbons (I’AI ls), carcinogens, tox-
`
`0014
`
`0014
`
`
`
`US 8,652,040 B2
`
`3
`
`radiation. X-rays.
`ins, electromagnetic energy. optical
`gamma rays, microwave radiation. terahertz radiation. ultra-
`violet radiation.
`infrared radiation.
`radio waves. atomic
`energy alpha particles, atomic energy beta-particles. gravity.
`light
`intensity.
`light
`frequency.
`light
`flicker.
`light phase.
`omnc. carbon monoxide, carbon dioxide, nitrous oxide. sul-
`fides. airborne pollution. foreign material in the air. viruses,
`bacteria. signatures from chemical weapons. wind. air turbu-
`lence. sound andfor acoustical energy. ultrasonic energy,
`noise pollution. human voices. entimal sounds. diseases
`expelled from others, exhaled breath andfor breath constitu-
`ents ol'others. toxins from others. pheromones from others.
`industrial andfor transportation sounds, allergens. animal
`hair. pollen. exhaust from engines. vapors andtor fumes. fuel,
`signatures formineral deposits andforoil deposits. snow. rain.
`thermal energy. hot surfaces. hot gases. solar energy. hail. ice.
`vibrations. traffic. the number of people in a vicinity of the
`person, coughing andfor sneezing sounds from people in the
`vicinity of the person.
`loudness andfor pitch from those
`speaking in the vicinity ofthe person.
`In some embodiments. the signal processor is configured to
`process signals produced by the physiological and environ-
`mental sensors into signals that can be heard and/“or viewed by
`the person wearing the apparatus. In some embodiments. the
`signal processor is configured to selectively extract environ-
`mental ell‘ects from signals produced by a physiological sen-
`sor audfor selectively extract physiological ellects from sig-
`nals produced by an environmental sensor.
`in some embodiments of the present invention. a monitor-
`ing apparatus configured to be worn by a person includes a
`physiological sensor that is oriented in a direction towards the
`person and an environmental sensor that is oriented in a
`direction away from the person. A butler material is posi-
`tioned between the physiological sensor and envirtnuneutal
`sensors and is configured to selectively reflect andtor absorb
`energy emanating from the environment andfor the person.
`In some embodiments of the present invention. a monitor-
`ing apparatus may include a receiver that is configured to
`receive audio andfor video information from a remote tenni-
`
`nal. and a communication module that is configured to store
`andfor process andJor play audio andJ'or video inlhrmation
`received from the remote terminal. In some embodiments. the
`communication module may be configured to alert (e.g.. via
`audible andtor visible andtor physical alerts) a person wear-
`ing the apparatus when a physiological sensor detects certain
`physiological information from the person andi'or when an
`environmental sensor detects certain environmental in forma-
`
`tion from the vicinity of the person. in some embodiments.
`the comnitmication module is configured to audiny present
`vital sign information to the person wearing the apparatus. In
`some embodiments. the communication module may be con»
`figured to store content generated by the person.
`In seine embodiments of the present invention. a monitor-
`ing apparatus may include a transmitter that is configured to
`transmit signals produced by physiological and environmen-
`tal sensors associated therewith to a gaming device. The
`monitoring apparatus may also be configured to receive feed
`back regarding monitored health and environmental paramn
`eters. As such. personal health and enviromncntal feedback
`can be an active component ofa game.
`In some embodiments. the apparatus is an earpiece module
`that is configured to be attached to the ear ol‘a person. and
`includes a speaker. microphone, and transceiver that is elec«
`tronically connected to the speaker and microphone and that
`permits bidirectional wireless conununicatious between the
`earpiece module and a remote terminal. such as a cell phone.
`The transceiver (cg. a Bluetoothtlc. Wi-Fi. or ZigBee trans-
`
`to
`
`15
`
`3U
`
`-
`
`3U
`
`35
`
`4E]
`
`45
`
`50
`
`.
`
`6d
`
`65
`
`4
`ceiver) is electronically comtected to the signal processor and
`is configured to transmit physiological and enviromnental
`sensor signals from the signal processor to the remote tenni-
`nal. In some embodiments. the earpiece module may include
`an arm that is attached to the housing and that soppons the
`microphone. The arm may be movable betwoeu a stored
`position and an extended. operative position. The arm may
`also include one or more physiological sensor andt‘or envi-
`ronmental sensors.
`
`In some embodiments ol‘the present invention. an earpiece
`module that is configured to be attached to the ear of a person
`includes a first acoustical sensor oriented in a direction
`
`towards a tympanic membrane of the ear and is configured to
`detect acoustical energy emanating front the tympanic mem-
`brane. A second acoustical sensor is oriented in a direction
`away from the person. The signal processor is configured to
`utilize signals produced by the second acoustical signal to
`extract environmental acoustical energy not emanating from
`the tympanic membrane from signals produced by the first
`acoustical sensor. ln sotne embodiments. the earpiece module
`may include an optical emitter tltat directs optical energy
`towards the tympanic membrane, and an optical detector that
`is configured to detect secondary optical energy emanating
`from the tympanic membrane. The signal processor is con-
`figured to extract selected optical energy from the secondary
`optical energy emanating from the tympanic membrane. The
`signal processor may also be configured to extract optical
`noise from the secondary optical energy emanating from the
`tympanic membrane.
`In some embodiments.
`the optical
`detector may include a filter configured to pass secondary
`optical energy at selective wavelengths.
`In some embodiments oI‘the present invention. an earpiece
`module that is configured to be attached to the ear o la person
`includes an optical detector that is configured to detect acous—
`tically modulated blackbody IR radiation emanating from the
`tympanic membrane.
`In some embodiments ol'thc present invention. an earpiece
`module that is configured to be attached to the ear of a person
`includes an optical emitter that directs optical energy towards
`the tympanic membrane. and an optical detector configured to
`detect secondary optical energy emanating from the tympanic
`membrane. in some embodiments. the signal processor may
`be con figured to extract selected optical energy and)ror optical
`noise from the secondary optical energy emanating from the
`tympanic membrane.
`In some embodiments.
`the optical
`detector may include a filter configured to pass secondary
`optical energy at selective wavelengths.
`In some embodiments of the present invention. an earpiece
`module that is configured to be attached to the ear ofa person
`includes an ear hook that is configured to attach to an ear ol'a
`person. One or more physiological sensors andt‘or one or
`more environmental sensors may be supported by the ear
`book. In some embodiments. the book may include a pinna
`cover that is configured to contact a portion of the pinna ol'an
`ear. One or more physiological andfor environmental sensors
`may be supported by the pinna cover.
`In some embodiments ol'the present invention. an earpiece
`module may include an arm that extends outwardly therefrom
`and that supports one or more physiological sensors auditor
`environmental sensors. For example. the arm may be contig-
`ured to support physiological sensors configured to detect
`auditor measurejaw motion andforarterial blood flow near the
`neck of a person wearing the earpiece module.
`In some embodiments ofthe present invention. an earpiece
`module may include an earpiece fitting configured to be
`inserted near or within the ear canal of a person wearing the
`
`0015
`
`0015
`
`
`
`5
`
`earpiece. The earpiece fitting may include one or more physi-
`ological sensors configured to detect intonnation from within
`the ear canal.
`
`US 8,652,040 B2
`
`6
`noise source. As another example. the person may be alerted
`ttpon damage to the tympanic membrane due to loud extemal
`noises.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a block diagram of a telemetric earpiece module
`for physiological and environmental monitoring and personal
`communication. according to some embodiments of the
`present invention.
`FIG. 2 is a block diagram ofa telemetric network for health
`and environmental monitoring through portable telemetric
`sensor modules. such as the earpiece module of FIG. 1.
`according to some embodiments of the present invention.
`FIG. 3 illustrates a graphical user interface for displaying
`data. according to some embodiments of the present inven-
`tion.
`
`FIG. 4 is a block. diagram that illustrates a method of
`extracting physiological and environmental
`infon'nation
`using a plurality of sensors and a signal processor. according
`to some embodiments of the present invention.
`FIG. 5 illustrates an auscultatory signal extraction tech-
`nique according to the methodology illustrated in FIG. 4.
`FIG. 6 illustrates an optical physiological signal extraction
`technique. according to some embodiments of the present
`invention. and wherein optical information scattered from the
`tympanic membrane is digitally compared with acoustical
`energy from the enviromnent to generate an extracted signal
`containing cleaner physiological information than raw opti-
`cal information scattered from the tympanic membrane.
`FIG. ’7 illustrates an optical source detector configuration.
`according to sotue embodiments ofthe present invention. for
`the physiological signal extraction method illustrated in FIG.
`6.
`
`FIG. 8 illustrates experimental auscultatory data obtained
`via the auscttltatory signal extraction approach of FIG. 5.
`FIG. 9 illustrates an earpiece modttle according to sortie
`embodiments ofthe present invention.
`FIG. 10 is a side view of the earpiece module of FIG. 9
`showing a placement ol'physiological sensors. according to
`some embodiments ofthe present invention.
`FIG. 11 is a front view of the earpiece module of FIG. 9
`showing a placement of environmental sensors. according to
`some embodiments of the present invention.
`FIG. 12 is an exploded view ofthe earpiece module ot‘FIG.
`9 showing a location of various physiological sensors,
`according to some embodiments of the present invention.
`FIG. 13 is a side view of a flexible substrate configured to
`place sensors in selected locations in the vicinity of the ear.
`according to some embodiments of the present invention.
`FIGS. l4A-l4B illustrates an earpiece module with an
`adjustable mouthpiece for monitoring physiological and
`environmental
`information near the mouth. according to
`some embodiments of the present invention. wherein FIG.
`14A illustrates the mouthpiece in a stored position and
`wherein FIG. 14B illustrates the mouthpiece in an extended
`operative position.
`FIG. 15 illustrates an earpiece module incorporating vari-
`ous physiological and environmental sensors. according to
`some embodiments of the present invention. and being worn
`by a user.
`FIG. 16 illustrates an earpiece module according to other
`embodiments of the present invention that includes a temple
`module for physiological and environmental monitoring.
`FIG. 17 illustrates a pulse-oxin‘reter configured to be
`attached to an ear of a user and that may be incorporated into
`
`In some embodiments ofthe present invention. an earpiece
`module may include a transmittance pulse oximeter andi'or
`rel ectance pu15e oximeter. For example. the earpiece module
`may include an earlobe clip having a transmittance pulse
`oximeter andt'or
`reflectance pulse oximeter
`supported
`thereby. As another example.
`the earpiece module may
`include a transmitter pulse oximeter andJor reflectance pttlse
`oxirneter supported at the front or back of the car.
`In some embodiments of the prettertt invention. a monitor-
`ing apparatus is an earring. The earring may be configured to
`operate independently ofother monitoring apparatus. such as
`an earpiece module. or tnay operate in conjunction with
`another monitoring apparatus. For example. an earring may
`include one or more physiological sensors configured to
`detect andfor measure physiological infonnation from the
`person. and one or more environmental sensors wnfigured to
`detect andfor measure environmental conditions in a vicinity
`of the person wearing the earring. The earring may also
`include a signal processor that receives and processes signals
`produced by the physiological and environmental sensors.
`and a transmitter that transmits physiological and environ-
`mental sensor signals from the signal processor to a remote -
`terminal in real-time.
`
`to
`
`15
`
`3U
`
`In some embodiments ofthe present invention. a monitor-
`ing apparatus configured to be attached to the ear of a person
`may include a housing containing one or more physiological
`and environmental sensors wherein the housing is configured
`to be positioned in adjacent contacting relationship with the
`temple of the person.
`Monitoring apparatus. according to some embodiments of
`the presont invention. may include various additional devices!
`features. Forexample. a monitoring apparatus may include an
`air sampling system that samples air in a vicinity ofthe person
`wearing the apparatus. In sortie embodiments. one or more
`physiological sensors in a monitoring apparatus may be con-
`figured to detect drowsiness of the person wearing the appa-
`ratus. Au alarm may be provided that is con figured to alert the
`person in response to one or more physiological sensors
`detecting drowsiness. In some embodiments. a monitoring
`apparatus may include a user interface that provides user
`control over one or more ofthe physiological andfor enviroru
`mental sensors. A user interface may be provided on the
`monitoring apparatus or may be included on a remote device
`in wireless communication with the monitoring apparatus. In
`some embodiments. a monitoring apparatus may include a
`user interface that is configured to allow the person to store a
`time mark indicating a particular point in time.
`Monitoring apparatus. according to some embodiments of
`the present invention. may be configured to send a signal to a
`remote terminal when one or more ofthe physiological andfor
`environmental sensors are turned oil‘ by a user andfor when
`one or more of the physiological andfor environmental sen-
`sors malfunction or fail. In some embodiments. a signal may
`be sent to a remote terminal when potentially erroneous data
`has been collected by one or more of the physiological audfor
`environmental sensors. such as when a person wearing a
`monitoring apparatus is surrounded by lottd noises.
`Monitoring apparatus. according to some embodiments of
`the present invention, may be configured to detect damage to
`a portion of the body ofthe person wearing the apparatus. and
`may be configured to alert the person when such damage is
`detected. For example, when a person is exposed to sound
`above a certain level that may be potentially damaging. the
`person is notified by the apparatus to move away from the
`
`3U
`
`35
`
`4E]
`
`45
`
`50
`
`.
`
`6o
`
`65
`
`0016
`
`0016
`
`
`
`US 8,652,040 B2
`
`7
`an earpiece module. according to some embodiments of the
`present invention. The illustrated pulse-oximeter is in trans-
`mission mode.
`
`FIG. 18 illustrates a pulse-oximeter configured to be inte-
`grated into an earpiece module. according to some embodi-
`ments of the present invention. The illustrated pulse-oximeter
`is in reflection mode.
`
`FIG. 19 illustrates a sensor module having a plurality of
`health and environmental sensors and mounted onto a Blue-
`t'ooth headset module. according to some embodiments of the
`present invention.
`1"1G. 20 is a pie chart that graphically illustrates exemplary
`power Usage of an earpiece module for monitoring health and
`environmental exposure, according to some embodiments of
`the present invention.
`
`DE’t‘All..ED unscate't‘ION
`
`The present invention now is described more fully herein-
`after with reference to the accompanying drawings. in which
`preferred embodimen