`
`Advancing Technology
`for Humanity
`
`DECLARATION OF GERARD P. GRENIER
`
`I have never been convicted
`I, Gerard P. Grenier, am over twenty-one (21) years of age.
`of a felony, and I am fully competent to make this declaration. I declare the followingto be true
`to the best of my knowledge,information andbelief:
`
`1.
`
`I am Senior Director of Publishing Technologies of the Institute of Electrical and
`Electronics Engineers, Inc. (“TEEE”).
`
`IEEEis a neutral third party in this dispute.
`
`NeitherI nor IEEEitself is being compensated for this declaration.
`
`Amongmyresponsibilities as Senior Director of Publishing Technologies,I act as a
`custodian of certain records for IEEE.
`
`.
`
`I make this declaration based on my personal knowledge and information contained
`in the business records of JEEE.
`
`Aspart ofits ordinary course of business IEEE publishes and makes available
`technical articles and standards, These publications are made available for public
`download through the IEEE digital library, IEEE Xplore.
`
`It is the regular practice of IEEE to publish articles and other writings including
`article abstracts and make them available to the public through IEEE Xplore. IEEE
`maintains copiesof publications in the ordinary course ofits regularly conducted
`activities.
`
`The articles below, along with their abstracts, have been attached as Exhibits A — C to
`this declaration:
`
`
`
`
`A.|G.S. Gupta, et al. “Design of a Low-cost Physiological Parameter
`Measurement and Monitoring Device” IEEE Instrumentation and
`
`
`
`Measurement Technology Conference Proceedings, May 1 — 3, 2007.
`L. Wangetal., “Multichannel Reflective PPG Earpiece Sensor With
`
`Passive Motion Cancellation” IEEE Transactions on Biomedical Circuits
`
`
`
`and Systems, Vol. 1, Issue 4, December 2007.
`
`
`H.Han, Y. Lee, and J. Kim, “Developmentof a wearable health
`monitoring device with motion artifact reduced algorithm (ICCAS 2007)”
`International Conference on Control, Automation and Systems, 2007,
`
`October 17 — 20, 2007.
`wont
`
`
`
`
`
`445 Hoes Lane Piscataway, NJ 08854
`9001
`
`APL1052
`USS. Patent No. 8,923,941
`
`FITBIT, Ex. 1052
`
`FITBIT, Ex. 1052
`
`
`
`9.
`
`I obtained copies of Exhibits A - C through IEEE Xplore, where they are maintained
`in the ordinary course of IEEE’s business, Exhibits A - C are true and correct copies
`of the Exhibits as it existed on or about October 25, 2016.
`
`10. The article abstracts from IEEE Xplore showsthe date of publication, IEEE Xplore
`populates this information using the metadata associated with the publication.
`
`1 — . G.S. Gupta, et al. “Design of a Low-cost Physiological Parameter Measurement and
`Monitoring Device” was published as part of the IEEE Instrumentation and
`Measurement Technology Conference Proceedings. The IEEE Instrumentation and
`Measurement Technology Conference was held from May 1 — 3, 2007. Attendees of
`the conference were provided copies ofthe publication nolater than the last day of
`the conference. Thearticle is currently available for public download from the IEEE
`digital library, IEEE Xplore.
`
`12, L. Wanget al., “Multichannel Reflective PPG Earpiece Sensor With Passive Motion
`Cancellation” IEEE Transactions on Biomedical Circuits and Systems, Vol. 1, Issue
`4. IEEE Transactions on Biomedical Circuits and Systems, Vol. 1, Issue 4 was
`published in December 2007. Copies of this publication were made available no later
`than the last day of the stated publication month. The article is currently available for
`public download from the IEEEdigital library, IEEE Xplore.
`
`13, H. Han, Y. Lee, and J. Kim, “Development of a wearable health monitoring device
`with motion artifact reduced algorithm (ICCAS 2007)” was published aspart of the
`International Conference on Control, Automation and Systems, 2007. The
`International Conference on Control, Automation and Systems, 2007 was held from
`October 17 — 20, 2007.Attendees of the conference were provided copies ofthe
`publication no later than the last day of the conference. Thearticle is currently
`available for public download from the IEEE digital library, IEEE Xplore.
`
`1 rs. [hereby declare thatall statements made herein of my own knowledgeare true and
`that all statements made on information and belief are believed to be true, and further
`that these statements were made with the knowledge that willful false statements and
`the like are punishable by fine or imprisonment, or both, under 18 U.S.C. § 1001.
`
`I declare under penalty of perjury that the foregoing statements areArue and correct.
`+
`Executed on: AS-Oct Bolg
`
`0002
`
`FITBIT, Ex. 1052
`
`FITBIT, Ex. 1052
`
`
`
`EXHIBIT A
`
`FITBIT, Ex. 1052
`
`FITBIT, Ex. 1052
`
`
`
`10/25/2016
`
`IEEE Xplore Document- Design of a Low-cost Physiological Parameter Measurement and Monitoring Device
`
`IEEE.org | IEEE Xp/ore Digital Library | IEEE-SA | IEEE Spectrum | More Sites
`
`Cart (0) | Create Account | Personal Sign In
`
`Institutional Sign In
`
` BROWSE MY SETTINGS GET HELP WHAT CAN I ACCESS? SUBSCRIBE
`
`
`
`
`
`
`
`
`
`Browse Conferences> Instrumentation and Measureme...
`
`Back to Results | Next>
`
`Rolated Articles
`Design of a Low-cost Physiological Parameter
`
`
`Measurement and Monitoring Device AWBAN-based|Atwenty-fourWearable
`medical
`System for
`|
`hourtele-
`devicesfor
`Health
`nursing
`tele-home
`Monitoring at
`system using
`healthcare
`Home
`arin.
`
`5
`toMewfullilext
`
`6
`Paper
`Citations
`
`184
`Full
`Text Views
`
`4
`Author(s)
`
`G. Sen Guata;
`
`S.C.Mukhopadhyay;
`
`B.S. Devlin;
`
`§.Demidenko
`
`View All Authors
`
`Abstract
`
`Authors
`
`Figures
`
`°
`
`References
`
`Citations
`
`=
`
`Keywords
`
`Metrics
`
`Media
`
`Abstract:
`
`In this paper we present the design of a low-cost system that can be used to monitor physiological parameters, such as temperature and heart rate, of a
`human subject. The system consists of an electronic device which is worn on the wrist and finger, by an elderly or at-risk person. Using several
`sensors to measuredifferent vital signs, the person is wirelessly monitored within his own home. An impact sensor has been used to detectfalls. The
`device detects if a person is medically distressed and sendsan alarm to a receiverunit that is connected to a computer. This sets off an alarm, allowing
`help to be provided to the patient. The deviceis battery powered for use indoors. The device can be easily adapted to monitor athletes and infants. The
`low cost of the devicewill help to lowerthe cost of home monitoring of patients recovering from illness. A prototype of the device has been fabricated
`and extensively tested with very good results.
`
`Publishedin: Instrumentation and Measurement Technology Conference Proceedings, 2007. IMTC 2007. IEEE
`
`Date of Conference: 1-3 May 2007
`
`INSPEC Accession Number: 9717999
`
`Date Added to IEEE Xp/ore: 25 June 2007
`
`DOI: 10.1109/IMTC.2007.378997
`
`ISBN Information:
`
`Print ISSN: 1091-5281
`
`Download PDF
`
`DownloadCilations
`
`View References
`
`
`
`Publisher: IEEE
`
`‘= Contents
`
`|. Introduction
`Manyelderly people dread the idea of being forcedtolive with their adult children, or in a rest home or
`in other sheltered living arrangement. They wantto live independently and keep controlof their own
`lives. Yet at the sametime they know there is a high risk of injury or even death becauseofa fall or
`stroke. With the populationaging in most developing countries, there will be more and moreelderly
`peopleliving alonein future. Such people need to be monitored continuously and provided with
`immediate medical help and attention when required.
`
`Read document
`
`Keywords
`
`Request Permissions
`
`Export
`
`IEEE Keywords
`Biomedical monitoring, Condition monitoring, Patient monitoring, Computerized monitoring, Costs,
`Heart rate measurement, Temperature sensors, Heart rate, Humans, Wrist
`
`Full Text
`
`Abstract
`Authors
`
`Figures
`
`References
`
`Citations
`
`http:/ieeexplore.iese.org/document/4258047/
`
`0004
`
`1/3
`
`FITBIT, Ex. 1052
`
`FITBIT, Ex. 1052
`
`
`
`IEEE Xplore Document - Design of a Low-cost Physlological Parameter Measurement and Monitoring Device
`
`INSPEC: Controlled Indexing
`telemedicine, biomedical telemetry, patient monitoring, physiology
`
`INSPEC: Non-Controlled Indexing
`wireless transmission, low-cost physiological parameter measurement, monitoring device, electronic
`device,vital signs, impact sensor, patients monitoring
`
`Keywords
`
`os we
`
`Author Keywords
`home monitoring, physiological parameters, sensors, wireless transmission
`
`Authors
`
`G. Sen Gupta
`Schoolof Electrical and Electronic Engineering, Singapore Polytechnic, 500
`Dover Road, Singapore. Email: SenGupta@sp.edu.sg
`
`S.C. Mukhopadhyay
`Institute of Information Sciences and Technology, Massey University,
`Palmerston North, New Zealand. Emaik s.c.mukhopadhyay@massey.ac.nz
`
`B.S. Devlin
`Institute of Information Sciences and Technology, Massey University,
`Palmerston North, New Zealand. Email: b.s.deviin@massey.ac.nz
`
`S. Demidenko
`Institute of Information Sciences and Technology, Massey University,
`Palmerston North, New Zealand. Email: s.demidenko@massey.ac.nz
`
`10/25/2016
`
`Share
`
`Alerts
`
`Related Articles
`» Wearable medical
`devices for tele-
`homehealthcare
`K. Hung; ¥.T. Zhang;
`B.T...
`
`» A WBAN-based
`System for Health
`Monitoring at
`Home
`Chris A. Otto; Emil
`Jovan...
`
`» A twenty-four hour
`tele-nursing
`system using a
`i...
`Boo-HoYang;
`Sokwao Rhe..,,
`
`» Lang term remote
`behavioral
`monitoring of
`elderly...
`M. Ogawa; R.
`Suzuki; §. 0...
`
`» A Passive and
`Portable System
`for Monitoring
`Hear...
`D.C. Mack; M.
`Alwan; B.T...
`
`» A Heart Pulse
`Monitoring System
`by Air Pressure
`a...
`Yutaka Hata; Yuya
`Kamoazak...
`
`» Smart wearables
`for remote health
`monitoring, fro...
`A. Lymberis
`
`» Wireless ECG
`monitoring system
`Dina Simunic;
`Slaven Toma...
`
`» A Wireless
`Medical Monitoring
`Over a
`Heterageneou...
`Mehmet R. Yuce;
`Peng Choo...
`
`» A MICS Band
`Wireless Bady
`Sensor Network
`MehmetR. Yuce;
`Steven W....
`
`http:/fieeexplore.ieee.org/document/42538047/
`
`0005
`
`23
`
`FITBIT, Ex. 1052
`
`FITBIT, Ex. 1052
`
`
`
`10/25/2016
`
`IEEE Xplore Document - Design of a Low-cost Physiological Parameter Measurement and Monitoring Device
`
`Personal Sign In| Create Account
`
`IEEE Account
`
`PurchaseDetails
`
`Profile Information
`
`Need Help?
`
`» Change Usemame/Password
`» Update Address
`
`» Payment Options
`» OrderHistory
`» View Purchased Documents
`
`» Communications Preferences
`» Profession and Education
`» TechnicalInterests
`
`»US & Canada: +1 800 678 4333
`» Worldwide: +1 732 981 0060
`» Contact & Support
`
`About IEEE Xpiore | Contact Us | Help| Terms of Usa | Nondiscrimination Policy | Sitemap | Privacy & Opting Out of Cookies
`
`A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technologyfor the benefit of humanity.
`© Copyright 2016 IEEE - All rights reserved, Use ofthis website signifies your agreementto the terms and conditions
`
`http:/iesexplore.ieee.org/docum ent/4258047/
`
`0006
`
`3/3
`
`FITBIT, Ex. 1052
`
`FITBIT, Ex. 1052
`
`
`
`IMTC 2007 — Instrumentation and Measurement
`Technology Conference
`Warsaw, Poland 1-3 May 200
`
`Design of a Low-cost Physiological Parameter Measurement and Monitoring Device
`
`G. Sen Gupta’, $.C. Mukhopadhyay’, B.S. Devlin? and S. Demidenko?”
`'Schoolof Electrical and Electronic Engineering, Singapore Polytechnic, 500 Dover Road, Singapore
`Institute of Information Sciences and Technology, Massey University, Palmerston North, New Zealand
`Email: s.cmukhopadhyay@massey.ac.nz, SenGupta@sp.edu.sg, b.s.devlin@massey.ac.nz,s.demidenko@massey.ac.nz
`
`Abstract — In this paper we present the design of a low-cost system
`that can be used to monitor physiological parameters, such as
`temperature and heart rate, of a human subject, The system consists
`of an electronic device which is worn on the wrist andfinger, by an
`elderly or at-risk person. Using several sensors to measure different
`vital signs, the person is wirelessly monitored within his own home,
`An impact sensor has been used to detectfalls. The device detects if
`a person is medically distressed and sends an alarm to a receiver
`unit that is connected to a computer. This sets offan alarm, allowing
`help to be provided to the patient. The device is battery poweredfor
`use indoors. The device can be easily adapted to monitor athletes
`and infants. The low cost ofthe device will help to lower the cost of
`home monitoring ofpatients recoveringjrom lilness. A prototype of
`the device has been fabricated and extensively tested with very good
`results.
`
`— physiological
`Keywords
`transmission, home monitoring
`
`parameters,
`
`SENSOKS,
`
`wireless
`
`I.
`
`INTRODUCTION
`
`Manyelderly people dread the idea of being forced to live
`with their adult children, or in a rest home or in other
`sheltered
`living
`arrangement.
`They want
`to
`live
`independently and keep control of the own lives. Yet at the
`same time they know there is a high risk of injury or even
`death because of a fall or stroke. With the population aging
`in most developing countries, there will be more and more
`elderly people living alone in future. Such people need to be
`monitored continuously and provided with immediate
`medical help and attention when required.
`The cost of hospitalization is ever increasing, so is the cost
`of rehabilitation after a major illness or surgery. Hospitals are
`looking at sending people back as soon as possible to recoup
`at home. During this recovery period several physiological
`parameters need to be
`continuously measured. Hence
`telemedicine and remote monitoring of patients at home are
`gaining added importance and urgency [1-3]. Today,
`the
`progress in science and technology offers miniaturization,
`speed, intelligence, sophistication and new materials at lower
`cost. In this new landscape, micro-technologies, mformation
`technologies and telecommunications are the key factors in
`inventing devices to assist mankind. Patients are being
`monitored using a network of wireless sensors [4]. A system
`to monitor the overall health of welfare facility residents, who
`need constant care, has been reported in [5]. This system [5]
`has been designed with wireless sensors, wireless repeaters
`and a host computer. The system consists of a piezoelectric
`
`sensor, a 2 axis accelerometer, a microcontroller and a low
`power
`transceiver.
`It
`records
`respiration activity and
`indicators of posture for 24 hours. These data are transmitted
`to the wireless repeater by the transceiver. The wireless
`repeaters, which are installed throughout the welfare facility,
`send data, including the repeater's ID, to the host computer.
`The ID is used to detect the resident's location in the welfare
`facility. The host com puter stores the data, which can be used
`to analyze the resident's overall health condition. When the
`resident is in an emergency situation, such as fallmg or in an
`inactive state for more that
`the allotted time,
`the host
`computer automatically alerts the situation to the care staff by
`an alarm sound and also by mobile phone. However, all
`reported systems arerelatively expensive.
`In the back drop of the importance of continuous
`monitoring of vital physiological parameters ofa patient, our
`research was undertaken to design a
`low-cost
`smart
`monitoring device. It aims to provide peace-of-mindto users
`who have medical problems, but are not placed in a hospital
`for monitoring. Caregivers, who look after patients with
`mental or physical disabilities, can use this device when they
`are not able to visually supervisethe patients.
`Currently there are monitoring products in the market that
`are aimed to provide emergency assistance to senior citizens,
`rehabilitation
`patients,
`and medically
`or
`physically
`challenged individuals, but these have limitations. St John’s
`and Medic Alert’s Lifelink™[6] allows the user to set off an
`alarm manually if they are under medical stress, which will
`then dial designated contact phone numbers. The fundamental
`problem with this system is that when medical emergencies
`happen to the user, they are often unconscious and unable to
`press an ‘emergencyalert button’. There is no product on the
`market which does not require manualactivation of the alarm
`and monitors a user’s vital signs smartly. This is the novel
`design goal of the work presented in this paper.
`The reported device consists of a wrist strap and a finger
`glove. This allows the sensors to be mounted aroundthe wrist
`and finger. A battery and a microcontroller, with built-in RF
`transceiver, are mounted within the wrist strap as well. In
`Section II we present the complete system overview. All the
`sensors are explained in Section III. The hardware details are
`in Section IV and the algorithms in Section V. The prototype
`and test results are discussed in Section VI. The paper ends
`with a discussion on future developments
`
`1-4244-0589-0/07/$20.00 ©2007 IEEE
`
`0007
`
`FITBIT, Ex. 1052
`
`FITBIT, Ex. 1052
`
`
`
`I. SYSTEM OVERVIEW
`
`B. Heart Rate Sensor
`
`The system has been designed to take several inputs from
`a human subject to measure physiological parameters such as
`temperature and heart rate. Figure 1 shows the functional
`block diggram of the system hardware. The inputs from the
`sensors are processed andthe results transmitted to a receiver
`unit, which is connected to a computer placed in the home,
`using Radio Frequency (RF) wireless
`technology. The
`receiver unit decodes and analyses the data. If it is inferred
`that the person is medically distressed, an alarm is generated.
`The design is modular which makesit rather easy and straight
`forward to add extra sensors for measuring and monitoring
`other parameters. The hardware blocks are explained in full
`details in a later section.
`
`
`
`{mpact Sensor
`(Accelerometer)
`__
`Cheulley
`
`2 4GHZ RF
`Ls
`
`
`
`
`AnalogSignals
`
`F
`
`Micro-contrcllar
`with
`Recelver
`
`R525
`
`PC
`
`A custom heart rate sensor was designed to read the
`patient’s beats per mimute (bpm). The designed sensor is very
`small and inexpensive. The technique used to measure the
`heart rate is based on near-infrared (NIR) spectroscopy. NIR
`spectroscopy involves using light in the wavelength of 700-
`900nm to measure blood volume. At these wavelengths most
`tissues do not absorb light — other than hemoglobin (whichis
`what we are interested in). This allowed for designing a non-
`invasive and low cost method of measuring the pulse. A
`silicon phototransistor and a GaAs infrared emitting diode
`were used in the sensor, moulded into a flat side-facing
`package. The amount of light
`that was detected by the
`phototransistor varied with the patients heart pulse, as the
`amount of absorbed IR light changed with the flow of blood,
`whichis directly linked to the heart rate. This signal was then
`amplified,
`filtered, and sent to the microcontroller to be
`analyzed. The heart rate sensor was mounted in the finger
`glove as this position proved to give the best response.
`
`C. Impact Sensor
`
`An ADXL311 accelerometer was used as an impact
`sensor. It provides a 2-axis response, measuring accelerations
`up to +/- 2p.
`It was fitted into the wrist strap. The
`accelerometer provides an analog voltage, the amplitude of
`whichis directly proportional to acceleration. This signal was
`scaled down to bring it within the acceptable input range of
`the micro-controller, and then analyzed. Software algorithms
`were used to detect sharp impacts, while allowing slower
`movements, such as walking, to be ignored. The purpose of
`this sensor was to detect sudden impacts that could indicate
`the patient had fallen over.
`
`IV. HARDWARE DESIGN
`
`The hardware wasbuilt in three separate blocks. A sensor
`card was designed to house
`the temperature
`sensor,
`accelerometer and the connections for the NIR emitter and
`detector. A separate analog card was designed for all the
`analog processing circuitry needed for the sensors, primarily
`for processing the heart rate signal. The temperature and
`acceleration output was fed directly to the micro-controller.
`The micro-controller was mounted on a separate card which
`also had the antenna connection. The cards were connected
`by ribbon cables within the wrist strap. Figure 2 shows the
`circuit schematics of the sensor units and Figure 3 shows the
`analog processing circuit for measuring heart beatrate
`
`A, Lock-In Amplification for heart rate measurement
`
`The micro-controller modulates the infra-red emitter
`signal at 1 KHz through a npn transistor (Figure 2). This is
`then mixed with the signal obtained from the IR sensors
`(back scattered light). This technique, known as Lock-In
`Amplification
`[9],
`involves phase
`sensitive
`detection.
`
`
`
`
`
`Miec-siqnal
`micm.corerolier
`with RF
`Transmitter
`
`‘ \
`
`>
`
`'
`
`Temperature
`Sensor
`ciculry
`
`Heart Rate
`Sensor
`Cireuilry
`
`Fig. 1. Functional block diagram of the system hardware
`
`III]. SENSORS AND INTERFACE
`
`The system consists of three sensors- a temperature sensor,
`heart rate sensor, and an impact sensor. All
`the sensor
`circuitries used in the design generate analog voltages which
`are fed to the ADC (Analog-to-Digital) inputs of the micro-
`controller. The ADC inputs are
`time-multiplexed and
`sampled at different rates. The description of individual
`sensors follows.
`
`A, Temperature Sensor
`
`The temperature measurement is done using a LM35 [7]
`precision integrated-circuit temperature sensor. It provides an
`accuracy of +/- 0.25°C within the desired temperature
`measurement range of 20-40°C. It has a very low current
`drain of 60 LA. This sensor is mounted within the wrist strap,
`positioned in such a way that it is in contact with the skin,
`allowing it to measure the external temperature of the skin.
`From the skin temperature, the body temperatureis estimated.
`Because an exact measurement of body temperature is not
`required, this method is suitable. Rather, relative changes are
`monitored within set thresholds, which set off the alarm. This
`allows the device to detect changes in body temperature that
`could indicate the patient is undergoing any of the following
`conditions:
`trauma,
`injury, heart
`attack,
`stroke, heat
`exhaustion, and burns [8]. The temperature sensor is sampled.
`once every 3 seconds.
`
`0008
`
`FITBIT, Ex. 1052
`
`FITBIT, Ex. 1052
`
`
`
`
`
`
`Lage_Hi
`[cad.
`Ie.
`«
`1,
`
`teal
`BDXLELL
`— mee
`
`aay SW_PB
`ae a
`1
`WinnSet
`-
`ae ae .
`Mae
`
`i
`
`Come
`fF alynal tremeniter
`and receyer
`
`1 KHz
`Square
`
`RP Wi
`its
`
`yaa
`
`Vas
`
`
`
`
`wy
`
`BS
`*33K
`
`F LD!
`sa
`
`BO
`Grit
`
`2
`Cc?
`| |rriestion Vo ctaloy processing
`Toe
`
`
`
`| F
`
`ig. 2. Sensor Units
`
`
` 27M
`
`Py lL Signal inverter(x1 Gary
`
`Analog srittoh (temadelating)
`TORrd
`
`
`
`
`
`AC couple and nenpAleation (413.5gain)
`
`e&
`
`
`|
`bo 7
`HOOK Je
`Bigns! Buffer
`
`a i
`
`wor
`
`4
`‘y
`iE
`
`
`
`
`
`Fig. 3. Signal conditioning for Heart Rate Monitoring
`
`The signal of interest (1-2 Hz) is moved into a much higher
`frequency band together with the noise that is picked up by
`the sensors. Demodulation is performed by an analog switch,
`which demodulates at the same frequency and in phase with
`the 1 KHz modulating signal. The resulting signal is then
`passed through a low-pass filter with a cut off frequency of
`6Hz. This allows the signal of interest to pass through, while
`filtering out all noise that originated from the sensor. This is
`illustrated in figure 4.
`
`B. Controller Card
`
`The controller used in the wrist strap unit (and also in the
`receiver unit) is a Nordic nREF24E1. This takes inputs from
`
`
`
`(Sere Spat
`(TKHe)
`
`Fig. 4. Lock-In Amplification for heart rate measurement
`
`the sensor circuits in the form of analog voltages. Each sensor
`has a dedicated ADC channel which is multiplexed by the
`microcontroller. Each sensor’s signal is sampled at a pre-
`defined rate,
`through interrupt-driven algorithms. This
`microcontroller was chosen because of its small footprint
`(6mm x 6mm),
`low power consumption,
`and built-in
`
`0009
`
`FITBIT, Ex. 1052
`
`FITBIT, Ex. 1052
`
`
`
`transceiver, The microcontroller is responsible for producing
`the carrier signal that modulates the IR emitting diode, which
`is used in demodulation too, It is powered by a 9V battery,
`which is regulated down to 5V. The controller card contains
`the microcontroller, crystal oscillator, RF antenna connection,
`and header pins which connect analog and digital ports to the
`other componentsof the unit
`
`C. Receiver Unit
`
`The hardware of the receiver unit is housed in a plastic
`box and consists of a nREF24E1 microcontroller, antenna, a
`5V AC adaptor and serial interface port. The receiving unit is
`connected, via a RS232 serial port, to a personal computer
`(@C) and is constantly receiving information about
`the
`patient’s medical status. A program, running on the PC,
`receives the packetized information from the serial port,
`decodes the packet and then displays this information on the
`PC monitor. The program offers several options to set
`thresholds of the allowable range of heart
`rate,
`skin
`temperature and impact sensor. When the readings from the
`patient move outside of the set range, an alarm is raised The
`software can depict the change in data over time in a
`graphical plot. One receiver unit can be interfaced with
`rnultiple wrist units. In the software, one can tab through the
`information received from each wrist unit.
`
`D. Communication
`
`Communication between the wrist units and the receiver
`unit is wireless, powered by the nREF24E1, and transmitted
`in the unlicensed 2.4GHz frequency band. Information is
`gathered every 3 seconds from the sensors and then encoded
`into a packet. Each packet is 6 bytes long, composed as
`shown in figure 5.
`
`6 Bytes Long
`
`Start of File
`
`Heart Rate
`
`Bi balanced (10101010)
`
`Skin Temperature
`
`impact Information
`
`sent by the nREF24E1 using a
`is
`The data packet
`technology termed ShockBurst™. This allows data to be
`clocked into a FIFO buffer at a low data rate, and then
`transmitted all at once ata very high rate. This lowers power
`consumption by minimizing the amount of receiving and
`transmitting time Data is transmitted by this method at
`IMbps. This also reduces the risk of a data collision with
`other wrist units, or devices operating in the same band.
`
`VY. SOFTWARE AND ALGORITHMS
`
`the
`on
`implemented
`algorithms were
`Several
`from the
`take inputs
`micrecontrolla. These algorithms
`sensors and process them into meaningfii] information.
`
`A, Heart Rate Algorithm
`
`Theheart rate signal is an oscillating signal of 1 to 2Hz. This
`is sampled by the microcontroller at SOHz, and then averaged
`over 5 samples, which gives the algorithm an effective data
`input rate of 10 samples per second. This is stored in a buffer
`which is 32 bytes long. Once this buffer is full, the algorithm
`scans though each value in the buffer to compute the period
`ofthe signal (see figure 6). Since the signal is not sinusoidal,
`rather has distinct peaks corresponding to the contractions in
`the heart, the period is measured by marking transitions over
`the 25% mark. This is the most reliable part of the received
`signal. Since the sample time is know (0.15), the number of
`samples between these ‘transition points’ is used to calculate
`the period and hence the frequency. The frequency is then
`multiplied by 60 to compute the heart rate Gn bpm, beats per
`minute) of the patient
`Is par divinvan
`
`Renn
`
`a
`
`vy
`
`1D samples her elistelon
`
`Fig. 6. H east rate measuremental gorithm
`
`Fig. 5. Data packet compoaition
`
`8. Impact Algorithm
`
`is in beats per
`The heart rate included in the packet
`minutes (bpm) which is calculated using the Heart Rate
`Algorithm explained in Section V. The temperature data is
`the result ofthe ADC conversion, done once every 3 seconds,
`and is decoded into degrees Celsius at the receiver unit, The
`impact information is the maximum output voltage of the
`accelerometer measuredin the past 3 seconds. This is also the
`digital value obtained from the ADC conversion.
`
`The signal received from the accelerometer is a DC
`voltage, the amplitude of which is directly related to the
`acceleration (62mV/g). This input is sarnpled at 10Hz, and
`stored in a buffer which is 10 bytes long. Every second,this
`buffer is scanned, and the maximum amplitude is recorded.
`At the receiver unit,
`this data is compared to recorded
`representative values for walking and jogging. This ensures
`that an alarm is set off only for very sharp, heavy impacts.
`
`0010
`
`FITBIT, Ex. 1052
`
`FITBIT, Ex. 1052
`
`
`
`Thereliability of impact detection was very good and the
`walking could easily be differentiated from a fall.
`
`with thumb on carotid artery). Figure 9 shows a segmentof a
`received heart rate signal.
`
`VI. PROTOTYPE AND EXPERIMENTAL RESULTS
`
`The Nordic micro-controller development board was used
`to build and test the prototype design. The analog processing
`circuitry and the sensors were assembled on PCBs which
`were placed within the wrist strap. Figure 7 shows the
`prototype hardware. The prototype was powered off a 9V
`battery. The RF transmission has been tested to operate
`successfully at 10 meters range through obstacles such as
`concrete walls, The receiver unit, without the casing, can be
`
`seen in figure 8.
`
`
`Fig. 8. Prototype receiver connected to a PC
`
`A. Heart Rate Sensor Test Results
`
`A new heart rate is calculated every 3.2 seconds, The
`outputof the sensor is a 200-400 mV p-psignal, riding a DC
`signal of 500m¥V, On human tests it is able to measure within
`+2 bpm of a rested patient (confirmed by measuring pulse
`
`Fig. 9. Segment ofa heart rate signal
`
`B. Impact Sensor Test results
`
`The output of the accelerometer was tested with walking
`and simulated falling. The results showed the difference was
`simple to detect and proved the accuracy of the algorithm.
`Figure 10 shows the impact sensor output.
`
`Fig. 10. Impact sensor output for walking and a fall
`
`VII.DISCUSSIONS AND FUTURE DEVELPOMENTS
`
`In this paper we have presented the research, of applied
`nature, done to monitor physiological parameters such as skin
`temperature, heart rate and body impact. A prototype was
`successfully developed and tested to establish the proof of
`concept. The algorithms were tested and found to be accurate
`and reliable. The novel aspect of the design is its low cost and
`detection of medical distress which does not necessitate
`pressing any panic button. This is an enormous improvement
`over existing commercial products.
`An important aspect of the design was miniaturization, so
`that the system was as non-intrusive as possible to the wearer.
`This was achieved by the use of surface-mounted devices on
`the PCBs designed. Low power operational amplifiers were
`used to minimize battery consumption. The price of the unit
`currently is $70. The major costs come from the use of
`precision components, accelerometer and temperature sensor.
`With some modification, the system can be madeavailable
`commercially. Future improvements will focus on the use of
`
`0011
`
`FITBIT, Ex. 1052
`
`FITBIT, Ex. 1052
`
`
`
`
`REFERENCES
`
`Ohta S, Nakamoto H, Shinagawa Y, Tanikawa T., “A health
`monitoring system for elderly people living alone”, Jounal of
`Telemedicine and Telecare, Vol 8, No. 3, June 2002,pp. 151-156
`C,
`Dittmar
`A,
`Axisa
`F,
`Delhomme
`G,
`Gehin
`“New concepts and technologies in home care and ambulatory
`monitoring”, Studies in health technology and informatics, 2004, pp 9-
`35.
`Fazlur Rahman, Arun Kumar, G Nagendra, and Gourab Sen Gupta.
`"Network Approach for Physiological Parameter Measurement”, IEEE
`Transactions on Instrumentation and Measurement, February 2005, Vol
`54, No.1, pp 337-346
`Jovanov E, Raskovic D,Price J, Chapman J, Moore A, Krishnamurthy
`A, “Patient Monitoring Using Personal Area Networks of Wireless
`Intelligent Sensors’, Biomedical Sciences Instrumentation, 2001, pp
`373-378
`Maki H, Yonezawa Y, Ogawa H, Sato H, Hahn AW, Caldwell WM.,
`“A welfare facility resident care support system”, Biomedical Sciences
`Instrumentation, 2004, pp 480-483.
`LifeLink
`Panic
`Button,
`http:/Avww.bgehome.conv/hs_protection.html#lifelink
`National Semiconductor, LM35 — Precision Centigrade Temperature
`Sensor, http://www national.com/pfLM/LM35 html
`Y.C.Sydney, A-Z Health Guide from WebMD: Medical tests, Body
`Temperature,
`.
`http:/Avww.webmd.com/hw/health_guide_atoz/hw198785.asp
`Eastern Michigan University, Lock-In Amplification
`http:/Avww.physics.emich.edu/molab/lock-in/index.htm!
`W.D Peterson, D.A.Skramsted., D.E.Glumac, Piezo Film Pulse
`Sensor,http:/Avww.phoenix.tc-ieee.org/004_PiezoFilmBlood_
`Flow_Sensor/Phoenix_PiezoPulse.htm
`
`overview,
`
`4] 3]
`
`1 2
`
`]
`
`BI]
`
`[6]
`
`[7]
`
`[8]
`
`[9]
`
`[10]
`
`flexible PCBs to replace the stiff cards, so that it could be
`moulded around the wrist unit, making it more comfortable
`for the wearer.
`The design of the IR sensors could be improved to
`decrease its susceptibility to noise, to a point where it could
`be moved onto the wrist unit. This would provide a much
`more comfortable and less intrusive unit, getting rid of the
`finger glove.
`The addition of a blood-oxygen sensor would allow the
`system to detect medical distress more accurately by
`measuring the amount of oxygen in the blood (HbO). This
`could be implemented by the addition of another emitter
`diode operating at a wavelength which is more readily
`absorbed by oxygen, and measuring the light using photo
`detector. B