`
`Advancing Technology
`for Humanity
`
`DECLARATION OF GERARD P. GRENIER
`
`1, Gerard P. Grenier, am over twenty-one (21) years of age. I have never been convicted
`of a felony, and I am fully competent to make this declaration. I declare the following to be true
`to the best of my knowledge, information and belief:
`
`1.
`
`I am Senior Director of Publishing Technologies of the Institute of Electrical and
`Electronics Engineers, Inc. (“IEEE”).
`
`U.S. Patent No. 8,886,269
`
`It is the regular practice of IEEE to publish articles and other writings including
`article abstracts and make them available to the public through IEEE Xplore. IEEE
`maintains copies of publications in the ordinary course of its regularly conducted
`activities.
`
`.
`
`IEEE is a neutral third party in this dispute.
`
`. Neither I nor IEEE itself is being compensated for this declaration.
`
`. Among my responsibilities as Senior Director of Publishing Technologies, I act as a
`custodian of certain records for IEEE.
`
`.
`
`I make this declaration based on my personal knowledge and information contained
`in the business records of IEEE.
`
`. As part of its ordinary course of business IEEE publishes and makes available
`technical articles and standards. These publications are made available for public
`download through the IEEE digital library, IEEE Xplore.
`
`.
`
`. The article below has been attached as Exhibits A to this declaration:
`
`H.H. Asada, et a1. “Mobile monitoring with wearable
`photoplethysmographic biosensors” IEEE Engineering in Medicine and
`Biolo Maazine, Vol. 22, Issue 3, Ma June 2003.
`
`.
`
`I obtained a copy of Exhibit A through IEEE Xplore, where it is maintained in the
`ordinary course of IEEE’s business. Exhibit A is a true and correct copy of the
`Exhibit as it existed on or about October 25, 2016.
`
`10. The article abstracts from IEEE Xplore shows the date of publication. IEEE Xplore
`populates this information using the metadata associated with the publication
`
`___/
`Apple Inc.
`APL1018
`
`445 Hoes Lane Piscataway, NJ 08854
`
`0001
`
`FITBIT, Ex. 1018
`
`
`
`12. I hereby declare that all statements made herein of my own knowledge are true and
`that all statements made on information and belief are believed to be true, and further
`that these statements were made with the knowledge that willful false statements and
`the like are punishable by fine or imprisonment, or both, under 18 U.S.C. § 1001.
`
`I declareunderpenalty ofpeljurythatthe foregoing statements correct.
`Executed on:
`CT
`
`l 1. H.H. Asada, et a1. “Mobile monitoring with wearable photoplethysmographic
`biosensors” was published in IEEE Engineering in Medicine and Biology Magazine,
`Vol. 22, Issue 3, IEEE Engineering in Medicine and Biology Magazine, Vol. 22,
`Issue 3 was published in May-June 2003. Copies of this publication were made
`available no later than the last day of July 2003. The article is currently available for
`public download from the IEEE digital library, IEEE Xplore.
`
`2;;J
`
`FITBIT, Ex. 1018
`
`
`
`EXHIBIT A
`
`FITBIT, Ex. 1018
`
`
`
`IEEE Xplore Document- Mobile monitoring with wearable photoplethysmographic biosensors
`10/25/2016
`lEEE.orgl IEEE Xplore Digital Library | lEEE-SA| IEEE Spectrumi More Sites
`Cart (0) | Create Accountl Personal Sign In
`
`Institutional Sign In
`
`BROWSE
`
`MY SE'I'I1NGS
`
`_
`
`GETHELP
`
`WHATCAN IACCESS?
`
`s
`
`SUBSCRIBE
`
`Browse Journals & Magazines > IEEE Engineering in Medicine > Volume: 22 issue: 3
`
`Mobile monitoring with wearable photoplethysmographic
`
`Purchase or Sig“ In
`‘
`:
`7,1,)
`m Vlewm” 0“
`
`172
`Paper
`Citations
`
`7
`Patent
`Cibtions
`
`3441
`Full
`TextViews
`
`Related Articles
`ASurvey on
`I AMON:a
`Wearable
`| wearable
`Sensor-Based
`. multiparameter
`Hea...
`monitorin...
`Systems for
`medical
`
`I Awearable
`health care
`system based
`on knitted in...
`
`5
`Author(s)
`
`H.H. Asada : P. Shaltis : A. Reisner: Sokwoo Rhee : R.C. Hutchinson
`
`View All Authors
`
`Abstract
`
`Authors
`
`Figures
`
`References
`
`Citations
`
`Keywords
`
`Metrics
`
`Published in: lEEE Engineering in Medicine and Biology Magazine (Volume: 22, Issue: 3, May-June 2003 )
`
`Page(s): 28 - 40
`
`Date of Publication: 22 July 2003
`
`Print ISSN: 0739-5175
`
`INSPEC Accession Number: 7680816
`
`DOI: 10.1109/MEMB.2003.1213624
`
`Publisher: IEEE
`
`Sponsored by: lEEE Engineering in Medicine and Biology Society
`
`SE Contents
`
`Abstract:
`We address both technical and clinical issues of wearable biosensors (WBS). First, design concepts of a WBS are presented, with emphasis on the
`ring sensor developed by the author's group at MIT. The ring sensor is an ambulatory, telemetric, continuous health-monitoring device. This WBS
`combines miniaturized data acquisition features with advanced photoplethysmographic (PPG) techniques to acquire data related to the patient‘s
`cardiovascular state using a method that is far superior to existing fingertip PPG sensors. In particular, the ring sensor is capable of reliably monitoring
`a patient‘s heart rate, oxygen saturation, and heart rate variability. Technical issues, including motion artifact, interference with blood circulation, and
`battery power issues, are addressed, and effective engineering solutions to alleviate these problems are presented. Second, based on the ring sensor
`technology the clinical potentials of WBS monitoring are addressed.
`
`0004
`
`Download PDF
`
`Download Citations
`
`Wew References
`
`Wbs System Paradigm
`For novel healthcare applications to employ WBS technology, several system criteria must be met.
`The WBS hardware solution must be adequate to make reliable physiologic measurements during
`activities of daily living or even more demanding circumstances such as fitness training or military
`battle. There must exist data processing and decision-making algorithms for the waveform data.
`These algorithms must prompt some action that improves health outcomes. Finally, the systems must
`be cost effective when compared with less expensive, lower technology alternatives.
`
`Read document
`
`Request Permissions
`
`Keywords
`
`IEEE Keywords
`Biomedical monitoring, Biosensors, Wearable sensors, Patient monitoring, Telemetry, Data
`acquisition, Cardiology, Sensor phenomena and characterization, Heart rate measurement, Heart rate
`Export
`http:/fieeexplore.ieee.org/documentl1213624/
`
`Full Text
`
`Absvact
`
`Authors
`
`Figures
`
`References
`
`I
`I
`C'tat'ons
`
`FITBIT, Ex. 1018
`
`
`
`10/25/2016
`
`IEEE Xplore Document - Mobile monitoring with wearable photoplethysmographic biosensors
`
`Keywords
`
`INSPEC: Controlled Indexing
`electromyography, patient monitoring, biomedical transducers, biomedical telemetry, cardiovascular
`system, blood pressure measurement, plethysmography, electroencephalography
`
`INSPEC: Non-Controlled Indexing
`battery power, mobile monitoring, wearable photoplethysmographic biosensors, cardiovascular
`monitoring, ring sensor, ambulatory telemetric continuous health-monitoring device, miniaturized data
`acquisition features, cardiovascular state, oxygen saturation, heart rate variability, technical issues,
`motion artifact, blood circulation
`
`H.H. Asada
`Dept. of Mech. Eng., MIT, Cambridge, MA, USA
`
`Phillip Shaltis received the BA degree in physics from Albion College, Albion, MI, in 1999 and the
`B.S. degree in mechanical engineering from the University of Michigan, Ann Arbor, MI in 2000. He will
`be finishing dual M.S. degrees in mechanical and electrical engineering at MIT in 2003 and plans to
`continue work towards the Ph.D. degree in mechanical engineering at MIT. His research interests
`include biomedical instrumentation, biomedical signal processing, analog circuit design, and system
`analysis and control.
`
`A. Reisner
`
`Related Articles
`
`»A Survey on
`Wearable Sensor-
`Based Systems
`for Hea...
`Alexandros
`Pantalopoulos;..
`
`>>AMON: a wearable
`multiparameter
`medical
`monitorin...
`U_ Anliker; J.A.
`Ward; P.
`.
`
`» A wearable health
`care system
`based on knitted
`in...
`R. Paradiso; G.
`Loriga; N...
`
`» A wireless PDA-
`based
`physiological
`monitoring sys...
`Yuan-Hsiang Lin; I-
`Chie...
`
`» Flexible
`technologies and
`smart clothing for
`citi...
`Fabrice Axisa; P.M.
`Schm...
`
`» Monitoring Motor
`Fluctuations In
`Patients Vimh
`Pa. ..
`Shyamal Patel;
`Konrad Lor...
`
`» Data secunty and
`privacy in wireless
`body area n...
`Ming Li; Wenjing
`Lou; Kui...
`
`» A patient-specific
`algorithm for the
`detection of...
`Hao Qu; J. Gotman
`
`» The Advanced
`Health and
`Disaster Aid
`Network: A L...
`Tia Gao; Tammara
`Massey;
`
`» Artifact-resistant
`power-efficient
`design offing...
`Sokwoo Rhee; Boo—
`Ho Yan...
`
`Haruhiko Harry Asada is a Ford professor of mechanical engineering and director of the Brit and Alex
`d'Arbeloff Laboratory for Information Systems and Technology in the Department of Mechanical
`Engineering at Massachusetts Institute of Technology (MIT). He specializes in robotics, biomedical
`engineering, and system dynamics and control. His current research areas include wearable health
`monitoring, robotic aids for bedridden patients, vast DOF actuator systems, and multiphysics
`simulation. He received the B.S., M.S., and PhD. degrees in precision engineering in 1973, 1975, and
`1979, respectively, all from Kyoto University, Japan. He was a visiting research scientist at the
`Robotics Institute of Carnegie-Mellon University from 1980 to 1981. He joined the Department of
`Mechanical Engineering at MIT as faculty in 1982 and became a full professor in 1989. He is a Fellow
`of ASME.
`
`Back to Top
`
`stiff
`Andrew Reis ner received the B.S. in mechanical engineering and biological sciences at Stanford
`I lniunreihl in 100’) the M n frnm Hanlnrd Madiral thnnl in 1007 and trainnd in nmnrnnnr-u mndir-inn
`http:/fieeexpl ore.ieee.org/docum ent/1213624/
`
`0005
`
`FITBIT, Ex. 1018
`
`
`
`10/25/2016
`
`Sokwoo Rhee
`
`Sokwoo Rhee received the 3.8. degree in mechanical engineering from Seoul National University,
`Seoul, South Korea, in 1995, and the MS. and Ph.D. degrees in mechanical engineering from MIT in
`1997 and 2000, respectively. He is currently the chief technology officer and vice president of
`technoloy at Millennial Net, Inc. in Cambridge, MA. He was also a postdoctoral research associate in
`the Department of Mechanical Engineering at MIT in 2000—2002. His research interests include
`biomedical instrumentation, ultra-low power wireless communication, system analysis, and control.
`
`R.C. Hutchinson
`
`Reginald C. Hutchinson received the 8.8. degree in mathematics from Morehouse College, Atlanta,
`GA; the 3.3. degree in mechanical engineering from the Georgia Institute of Technology, Atlanta,
`Georgia, in 1999; and dual M.S. degrees in mechanical engineering and electrical engineering from
`MIT, Cambridge, MA, in 2002. He is currently working as a consultant for Accenture in New York City.
`His research interests include design, control of electromechanical systems. controls and system
`dynamics, and analog and digital signal processing.
`
`IEEE Xplore Document - Mobile monitoring with wearable photoplethysmographic biosensors
`Ul IIVCI any Ill IUU‘I ll IV I‘ll-U.
`II UIII I Idl Val U IVIGUIUGI \JUI IVVI III
`IV?! I, GI I“ ll an ICU III GI I IGI 36! Ivy IIIGUIVII IV
`at the Harvard—affiliated emergency medicine residency program. He is presently an attending
`physician at the Massachusetts General Hospital in the Department of Emergency Medicine, an
`instructor at Harvard Medical School, and a visiting scientist at MIT. Dr. Reisner's research is oriented
`toward the intersection of diagnostic expert systems, medical sensortechnology, and the clinical
`problem of circulatory shock.
`
`http://ieeexplore.ieee.org/documentl1213624/
`
`Personal Sign In l Create Account
`
`IEEE Account
`
`Purchase Details
`
`Profile Information
`
`Need Help?
`
`» Change Usemame/Password
`» Update Address
`
`» Payment Options
`» Order History
`» View Purchased Documents
`
`» Communications Preferences
`» Profession and Education
`» Technical Interests
`
`» US & Canada: +1 500 678 4333
`» Worldwide: +1 732 981 0060
`» Contact & Support
`
`About IEEE Xplore I Contact Us I Help l Terms 01 Use | Nondiscrimination Policy l Sitemap | Privacy & Opting Out ofCookies
`
`A not-for-profit organization, IEEE is the world‘s largesttechnical professional organization dedicated to advancing technology forthe benefit othumanity
`© Copyright 2016 IEEE - All rights reserved Use of this web site signifies your agreement to the terms and conditions
`
`FITBIT, Ex. 1018
`
`
`
`
`
`WearableTechnology
`
`Mobile Monitoring
`with Wearable
`Photoplethysmographic
`Biosensors
`
`MAY/JUNE 2003
`
`earable biosensors (WBS) will permit contin-
`uous cardiovascular
`(CV) monitoring in a
`number of novel settings. Benefits may be real-
`ized in the diagnosis and treatment of a number
`of major diseases. WBS,
`in conjunction with appropriate
`alarm algorithms, can increase surveillance capabilities for
`CV catastrophe for high-risk subjects. WBS could also play a
`role in the treatment of chronic diseases, by providing infor-
`mation that enables precise titration of therapy or detecting
`lapses in patient compliance.
`WBS could play an important role in the wireless surveil-
`lance of people during hazardous operations
`(military,
`fire-fighting, etc), or such sensors could be dispensed during
`a mass civilian casualty occurrence. Given that CV physio-
`logic parameters make up the “vital signs” that are the most
`important information in emergency medical situations, WBS
`might enable a wireless monitoring system for large numbers
`of at-risk subjects. This same approach may also have utility
`in monitoring the waiting room of today’s overcrowded emer-
`gency departments. For hospital inpatients who require CV
`monitoring, current biosensor technology typically tethers pa-
`tients in a tangle of cables, whereas wearable CV sensors
`could increase inpatient comfort and may even reduce the risk
`of tripping and falling, a perennial problem for hospital
`patients who are ill, medicated, and in an unfamiliar setting.
`On a daily basis, wearable CV sensors could detect a
`missed dose of medication by sensing untreated elevated
`blood pressure and could trigger an automated reminder for
`the patient to take the medication. Moreover, it is important
`for doctors to titrate the treatment of high blood pressure,
`since both insufficient therapy as well as excessive therapy
`(leading to abnormally low blood pressures) increase mortal—
`ity. However, healthcare providers have only intermittent val—
`ues of blood pressure on which to base therapy decisions; it is
`possible that continuous blood pressure monitoring would
`permit enhanced titration of therapy and reductions in mortal-
`ity. Similarly, WBS would be able to log the physiologic sig-
`nature of a patient’s exercise efforts (manifested as changes in
`heart rate and blood pressure), permitting the patient and
`healthcare provider to assess compliance with a regimen
`proven to improve health outcomes. For patients with chronic
`cardiovascular disease, such as heart failure, home monitoring
`employing WBS may detect exacerbations in very early (and
`
`H. HARRY ASADA,
`PHILLIP SHALTIS.
`ANDREW REISNER,
`SOKWOO RHEE, AND
`REGINALD C. HUTCHINSON
`
`Technical and Clinical Aspects of a Ring Sensor for
`Ambulatory, Telemetric, Continuous Health Monitoring
`in the Field, in the Hospital, and in the Home
`
`often easily treated) stages, long before the patient progresses
`to more dangerous levels that necessitate an emergency room
`visit and costly hospital admission.
`In this article we will address both technical and clinical is-
`sues of WBS. First, design concepts of a WBS will be pre-
`sented, with emphasis on the ring sensor developed by the
`author’s group at MIT. The ring sensor is an ambulatory, tele-
`metric, continuous health-monitoring device. This WBS com-
`bines miniaturized data acquisition features with advanced
`photoplethysmographic (PPG) techniques to acquire data re-
`lated to the patient’s cardiovascular state using a method that is
`far superior to existing fingertip PPG sensors [1]. In particular,
`the ring sensor is capable of reliably monitoring a patient’s
`heart rate, oxygen saturation, and heart rate variability, Techni-
`cal issues, including motion artifact, interference with blood
`circulation, and battery power issues, will be addressed, and ef-
`fective engineering solutions to alleviate these problems will be
`presented. Second, based on the ring sensor technology the
`clinical potentials of WBS monitoring will be addressed.
`
`WBS System Paradigm
`For novel healthcare applications to employ WBS technology,
`several system criteria must be met. The WBS hardware solu-
`tion must be adequate to make reliable physiologic measure-
`ments during activities of daily living or even more
`demanding circumstances such as fitness training or military
`battle. There must exist data processing and decision-making
`algorithms for the waveform data. These algorithms must
`prompt some action that improves health outcomes. Finally,
`the systems must be cost effective when compared with less
`expensive, lower technology alternatives.
`
`WBS Design Paradigm
`The monitoring environments for out-of-hospital, wearable
`devices demand a new paradigm in noninvasive sensor design.
`There are several design requirements central to such devices.
`Compactness, stability of signal, motion and other distur-
`bance rejection, durability, data storage and transmission, and
`low power consumption comprise the major design consider-
`ations. Additionally, since WBS devices are to be worn with-
`out direct doctor supervision, it is imperative that they are
`simple to use and comfortable to wear for long periods of
`time. A challenge unique to wearable sensor design is the
`
`28
`
`IEEE ENGINEERING IN MEDlClNE AND BIOLOGY MAGAZINE
`
`0759-5175/03/31/.00©2003|Eht
`
`0007
`
`FITBIT, Ex. 1018
`
`
`
`WBS solutions, in various stages of
`
`technologic maturity, exist for measuring
`
`established cardiopulmonary “vital signs":
`
`heart rate, arterial blood pressure, arterial
`
`oxygen saturation, respiratory rate,
`
`temperature, and even cardiac output.
`
`MAY/JUNE 2003
`
`there are numerous WBS modalities that can offer physiologic
`measurements not conventional in contemporary medical mon—
`itoring applications, including acoustic sensors, electrochemi—
`cal
`sensors,
`optical
`sensors,
`eleetromyography
`and
`electroencephalography, and other bioanalytic sensors (to be
`sure, some of these sensors have well—established medical util—
`ity, but not for automated surveillance). These less established
`WBS modalities are outside the scope of this review.
`Wearable electrocardiogram systems represent the most
`mature WBS technology. Holter and related ambulatory
`electrophysiologic monitoring solutions have established util—
`ity in the diagnosis of cardiac arrhythmias. There has been
`substantial examination of this technology in the medical lit—
`erature, with excellent reviews available [10]. Temperature is
`technically trivial to measure using WBS, but the continuous
`monitoring of body temperature is only a soft surrogate for
`perfusion, and it lacks established utility outside of traditional
`Clinical settings [11], [12]. There is not a satisfactory ambula-
`tory solution for cardiac output measurement; it has been
`shown that cardiac output can be extracted from thoracic
`bioimpedance measurements, although speaking and irregu-
`lar breathing, as well as posture changes and ambulation, can
`corrupt this signal. In the future, bioimpedance is likely to
`prove a powerful WBS modality, since the signal carries in-
`formation about pulsatile blood volumes, respiratory vol-
`umes, intracellular and extracellular fluid balances, and has
`been shown to enable tomographic imaging. Respiration can
`be measured using bioimpedance, chest wall geometry, and
`acoustic means. While the basic sensor technology exists for
`monitoring respiratory rate, it requires the conversion of a
`continuous waveform into an integer (breaths per unit time),
`or the imprecise conversion of the measured parameter into an
`estimated volumetric rate (liters of gas per unit time).
`Ambulatory systems for arterial blood pressure measure-
`ment exist. The portapres, employing the volume clamp tech-
`nique for measuring ABP, offers a continuous waveform. The
`technology encumbers a finger and the wrist of the subject, is
`somewhat uncomfortable, and requires some expertise to set
`up for a subject (for instance, the finger cuff size must be care—
`fully matched to the finger). A more common WBS solution
`for 24-hour monitoring of ABP involves a portable version of
`the conunon oscillometric cuff that fits around the upper arm.
`This solution requires that the patient keep the monitored arm
`immobile while the cuff inflates for measurements. By report,
`this solution has been known to interfere with the sleep and
`other activities of monitored subjects (and has been reported
`to cause bruising of the arm at the cuff site) [13].
`
`trade-off between patient comfort, or long—term wearability,
`and reliable sensor attachment. While it is nearly needless to
`say that WBS technology must be safe, it should be noted that
`there have been tragic reports of serious injury resulting from
`early home monitoring technology [2]. Evolving regulatory
`guidelines for hospital and home monitoring technology can
`be found in the U.S. National Fire Protection Association
`Health Care Facilities Handbook.
`
`At the same time, the physiologic information generated
`by WBS technology must trigger some appropriate system ac-
`tion to improve health outcomes. Abnormal states must be ef-
`ficiently recognized while false alarms are minimized. This
`requires carefully designed WBS devices, as well as innova-
`tive postprocessing and intelligent data interpretation. Post-
`processing of sensor data can improve usability, as illustrated
`by recent improvements in pulse oximetry technology [3J-[5].
`Data interpretation can occur in real time (as is necessary for
`detecting cardiovascular-related catastrophes) or offline (as is
`the standard-of—care for arrhythmia surveillance using Holter
`and related monitoring). Real-time alarm “algorithms” using
`simple thresholds for measured parameters, like heart rate and
`oxygen saturation, have demonstrated high rates of false
`alarms [6],
`[7]. Algorithms for off-line, retrospective data
`analysis are also in a developmental stage. Studies of novel
`automated “triage” software used to interpret hours of contin—
`uous noninvasive ECG data of monitored outpatients suggest
`that the software’s diagnostic yield is not equal to a human’s
`when it comes to arrhythmia detection [8], [9]. It will presum-
`ably require further
`improvements
`in WBS hardware,
`middleware, and software in order to fully exploit the promise
`of wearable ambulatory monitoring systems.
`It is important to bear in mind the present limitations of the
`technology, such as reliability, system complexity, and cost,
`but there is a wide scope of exciting healthcare applications
`available for this technology, as will be discussed later in this
`article. WBS technology is a platform upon which a new para-
`digm of enhanced healthcare can be established. Considering
`that hardware solutions will
`inevitably become smaller,
`cheaper, and more reliable, and diagnostic software more so-
`phisticated and effective, it seems more a matter of when cost
`effectiveness will be achieved for WES solutions, not if.
`
`Available WBS Monitoring Modalities
`WBS solutions, in various stages of technologic maturity, exist
`for measuring established cardiopulmonary “vital signs”: heart
`rate, arterial blood pressure, arterial oxygen saturation, respira-
`tory rate, temperature, and even cardiac output. In addition,
`
`IEEE ENGINEERING IN MEDICINE AND BIOLOGY MAGAZINE
`
`FITBIT, Ex. 1018
`
`
`
`No fully satisfactory WBS solution exists for ABP monitor-
`ing. Because this physiologic parameter has been the comer-
`stone of many decades of clinical and physiology practice, it
`will be important to develop future WBS solutions for monitor-
`ing ABP. It is also worth investigating surrogate measures of
`ABP that prove easier to measure, such as pulse wave velocity
`(which correlates well with degree of hypertension [14], [15])
`and the second-derivative of the photoplethysmograph. This ar-
`ticle focuses on a wearable ring pulse-oximeter solution, which
`measures the PPG as well as the arterial oxygen saturation. The
`PPG contains information about the vascular pressure wave—
`forms and compliances. Efforts to extract unique circulatory in—
`formation, especially an ABP surrogate,
`from the PPG
`waveform are discussed later in this article. The PPG provides
`an effective heart rate (measuring heart beats that generate
`identifiable forward-flow), useful for circulatory consider-
`ations though less useful for strict electrophysiologic consider-
`ations. For instance,
`the PPG signal may reveal heart rate
`variability, provided ectopic heart beats, which corrupt the as-
`sociation with autonomic tone, can be excluded.
`
`Development of a Wearable Biosensor—
`The Ring Sensor
`Technical Issues of PPG Ring Sensors
`Central
`to the ring sensor design is the importance of
`long—term wearability and reliable sensor attachment. Since
`continuous monitoring requires a device that must be
`noninvasive and wont at all times. a ring configuration for the
`sensor unit is a natural choice. Because of the low weight and
`
`>O
`
`
`
`LightAbsorption O0
`
`Pulsatile Arterial Blood
`Nonpulsatile Arterial Blood
`Venous Blood
`
`Tissue, Bone, Etc...
`
`
`
`Fig. 1. Illustrative representation of the relative photon
`absorbance for various sections of the finger. The dc compo-
`nent is significantly larger than the ac component.
`
`Control Volume 2
`
`Digital Artery
`
`MAY/JU NE 2003
`
`small size, rings are generally worn without removal more of—
`ten than watches. Additionally, recent studies have indicated
`that the finger is one of the best places for WBS sensor attach-
`ment [16]. The primary vasculature of the finger is located
`near the surface and therefore makes it optimal for monitoring
`arterial blood flow using noninvasive optoelectronic sensors.
`Thus, a ring is ideal for long-term measurements. As will be
`illustrated in the following sections, the development of the
`ring sensor has stressed first an understanding of and then the
`subsequent elimination of front-end signal artifacts. By im-
`plementing a mechanical design that is sensitive to the true
`causes of signal corruption, significant improvements in over-
`all signal quality can be achieved and sensor effectiveness for
`various environments can be improved.
`Figure 1 shows the typical waveform of a photoplethys—
`mograph signal obtained from a human subject at rest. The
`signal comprises a large segment of dc signal and a small-am-
`plitude ac signal. The dc component of photon absorption re—
`sults from light passing through various nonpulsatile media,
`including tissue, bones, venous blood, and nonpulsatile arte-
`rial blood. Assuming that these are kept constant, a bandpass
`filter can eliminate the dc component. However, wearable
`PPG sensors do not meet this premise since, as the wearer
`moves, the amount of absorption attributed to the nonpulsatile
`components fluctuates. Power spectrum analysis reveals that
`this motion artifact often overlaps with the true pulse signal at
`a frequency of approximately 1 Hz. Therefore, a simple noise
`filter based on frequency separation does not work for PPG
`ring sensors to eliminate motion artifact.
`Furthermore, wearable PPG sensors are exposed to diverse
`ambient lighting conditions, ranging from direct sunlight to
`flickering room light. In addition, wearable PPG sensors must
`be designed for reduced power consumption. Carrying a large
`battery pack is not acceptable for long-term applications. The
`whole sensor system must run continually using a small bat-
`tery. Several ways to cope with these difficulties are:
`> secure the LEDs and the photodetector (PD for short) at a
`location along the finger skin such that the dc component
`may be influenced less by the finger motion
`modulate the LEDs to attenuate the influence of
`uncorrelated ambient light as well as to reduce power
`consumption
`increase the amplitude of the ac component so that the
`signal-to-noise ratio may increase
`measure the finger motion with another sensor or a sec-
`ond PD and use it as a noise reference for verifying the
`signal as well as for canceling the disturbance and noise.
`In the following sections these methods will briefly be dis-
`cussed, followed by specific sensor designs and performance
`tests. There are other techniques for reducing motion artifact
`for general-purpose PPG. These, however, are mostly signal
`processing techniques applicable to PPG intended for short-
`term use. The motion artifact problem we are facing in wear-
`able PPG design is different in nature; the source signal qual-
`ity must be improved before applying signal processing,
`Therefore, the focus must be placed on basic sensor design.
`
`Fig. 2. (a) For the reflective illumination method, movement of
`the photodiode relative to the LED (position 1 to position 2)
`leads to a photon path that no longer contains the digital ar-
`tery. (b) Forthe transmittal illumination method, movement of
`the photodetector relative to the LED still contains photon
`paths that pass through the digital artery.
`
`IEEE ENGINEERING IN MEDICINE AND BIOLOGY MAGAZINE
`
`Techniques for Reduced Motion Artifact
`Sensor Arrangement
`The location of the LEDs and a PD relative to the finger is an
`important design issue determining signal quality and robust-
`ness against motion artifact. Figure 2 shows a cross-sectional
`
`FITBIT, Ex. 1018
`
`
`
`view of the finger with the ring sensor. The LEDs and PD are
`placed on the flanks of the finger rather than the dorsal and
`palmar sides. These locations are desirable for two reasons:
`> both flanks of fingers have a thin epidermal tissue layer
`through which photons can reach the target blood vessels
`with less attenuation
`the digital arteries are located near the skin surface paral-
`lel to the length of the finger.
`It should be noted that an arterial pulsation is not only
`greater in magnitude than cutaneous pulsations but is also less
`susceptive to motion due to the naturally higher internal pres-
`sure. While the capillary collapses with a small external pres-
`sure on the order of lO~3O mmHg, the artery can sustain an
`external pressure up to 70—80 mmHg [17], [18]. Therefore,
`light static loads, such as contact with the environment, may
`not disturb the arterial pulsation.
`\
`Lighting Modulation
`For these reasons, at least one optical device, either the PD
`As is the case with most other WBS technologies, on—board
`or the LED, should be placed on one lateral face of the finger
`power is an extremely important design consideration and is of-
`near the digital artery. The question is where to place the other
`ten the limiting factor in design size, function, and flexibility.
`device. Figure 2 shows two distinct cases. One case places both
`
`the PD and the LED on the same side of the fin-
`ger—base, and the other places them on opposite
`sides of the finger. Placing both the PD and the
`LED on the same side creates a type of reflective
`PPG, while placing each of them on opposite
`sides makes a type of transmittal PPG, In the fig-
`ure the average pathway of photons is shown for
`the two sensor arrangements. Although the exact
`photon path is difficult to obtain, due to the heter-
`ogeneous nature of the finger tissue and blood, a
`banana-shaped are connecting the LED and PD,
`as shown in the figure, can approximate its aver-
`age path [19]. Although these two arrangements
`have no fundamental difference from the optics
`point of view, their practical properties and per-
`formance differ significantly with respect to mo-
`tion artifact, signal-to—noise ratio, and power
`requirements [201-[22].
`Reflective PPG needs more secure attach-
`ments of the LED and PD to the skin surface,
`when compared to transmittal PPG. Once an air
`gap is created between the skin surface and the
`optical components due to some disturbance, a
`direct optical path from the LED to the PD may
`be created. This direct path exposes the PD di-
`rectly to the light source and consequently
`leads to saturation. To avoid this short circuit,
`the LED light beam must be focused only in the
`normal direction, and the PD must also have a
`strong directional property (i.e., polarity), so
`that it is sensitive to only the incoming light
`normal to the device surface. Such strong di-
`rectional properties, however, work adversely
`when a disturbance pressure acts on the sensor
`bodies, since it deflects the direction of the
`LED and PD leading to fluctuations in the out-
`put signal. As a result, reflective PPG configu-
`rations are more susceptive to disturbances.
`in contrast, transmittal PPG configurations
`do not have the short circuit problems, since the
`LED and PD are placed on the opposite sides of
`the finger; no direct path through the air can be
`
`MAY/JUNE 2003
`
`Fig. 4. (a) The slow response time of the photodetector meant that the LED
`had to be modulated at lower frequencies for data sampli