(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2009/0287067 A1
`(43) Pub. Date: NOV. 19, 2009
`
`Dorogusker et a].
`
`US 20090287067A1
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`A613 5/00
`G09G 5/00
`0an 1 7/00
`
`(2006.01)
`(2006.01)
`(2006.01)
`
`(52) U.S. Cl.
`
`.......................... .. 600/300; 345/156; 700/94
`
`(57)
`
`ABSTRACT
`
`(54)
`
`INTEGRATED SENSORS FOR TRACKING
`PERFORMANCE METRle
`
`(75)
`
`lnverrtors:
`
`Jesse Lee Dorogusker, Los Altos,
`CA (US); Anthony Fadell, Portola
`Valley, CA (US); Donald J.
`Novotney, San Jose, CA (US);
`Nicholas R. Kalayjian. San Carlos,
`CA (US)
`
`Correspondence Address:
`KRAMER LEVIN NAFTALIS & FRANKEL LLP
`1177 Avenue of the Americas
`New York, NY 10036 (US)
`
`Assignee:
`
`Apple Inc., Cupertino, CA (US)
`
`Appl. No.:
`
`12/507,993
`
`Filed:
`
`Jul. 23, 2009
`
`Related U.S. Application Data
`
`Division of application No. 11/729075, filed on Mar.
`27, 2007, now abandoned.
`
`Electronic devices and accessories having integrated sensors
`for tracking a user’s performance metrics are provided. In one
`embodiment, the present invention can include a headset
`having integrated physiological sensors. The present inven-
`tion also can include a sling having onc or morc integrath
`physiological sensors. The sling can secure a portable elec—
`tronic device to a user’s body or clothing. The present inven-
`tion also can include a portable media device having one or
`more integrated physiological sensors. In one embodiment,
`an electronic device of the present invention can accept data
`from multiple sensors, including one or more sensors that
`track a user’s movements. The electronic device can be con-
`figured to condition data from physiological sensors using
`data indicative of the user’s movements.
`
`U.S. Patent No. 8,923,941
`
`O
`'0
`Q
`
`.‘I..A'.'.'...-
`
`..5..
`
`Apple Inc.
`APLl 028
`
`Apple Inc.
`APL1028
`U.S. Patent No. 8,923,941
`
`001
`
`FITBIT, Ex. 1028
`
`

`

`Nov. 19, 2009 Sheet 1 0f 10
`
`US 2009/0287067 A1
`
`Patent Application Publication
`
`PRIOR ART
`
`002
`
`FITBIT, Ex. 1028
`
`

`

`US 2009/0287067 A1
`
`A
`
`Patent Application Publication
`
`Nov. 19, 2009 Sheet 2 0f 10
`
`PRIOR ART
`
`FIG. 1B
`
`003
`
`FITBIT, Ex. 1028
`
`

`

`Patent Application Publication
`
`DETECTOR
`
`LIGHT
`SOURCE
`
`PHOTO-
`
`Nov. 19, 2009 Sheet 3 0f 10
`
`US 2009/0287067 A1
`
`SPEAKER
`
`.I
`0‘.
`-
`
`IIIIIIIIIII EI
`
`004
`
`FITBIT, Ex. 1028
`
`

`

`Patent Application Publication
`
`Nov. 19, 2009 Sheet 4 0f 10
`
`US 2009/0287067 A1
`
`404
`
`402V
`
`410
`
`ANTENNA(S)
`421
`
`406
`
`CONNECTOR
`
`DISPLAY
`
`ll
`
`USER
`INPUT
`
`STORAGE
`
`CONTROLLER
`422
`
`SENSOR(S)
`
`005
`
`FITBIT, Ex. 1028
`
`

`

`Nov. 19, 2009 Sheet 5 0f 10
`
`US 2009/0287067 A1
`
`Patent Application Publication
`
`: PROCESSING :
`
`, SIGNAL
`
`,
`
`006
`
`FITBIT, Ex. 1028
`
`

`

`Nov. 19, 2009 Sheet 6 0f 10
`
`Patent Application Publication
`
`US 2009/0287067 A1
`
`007
`
`FITBIT, Ex. 1028
`
`

`

`Nov. 19, 2009 Sheet 7 0f 10
`
`US 2009/0287067 A1
`
`702
`
`Patent Application Publication
`
`\
`
`008
`
`FITBIT, Ex. 1028
`
`

`

`Nov. 19, 2009 Sheet 8 0f 10
`
`Patent Application Publication
`
`US 2009/0287067 A1
`
`009
`
`FITBIT, Ex. 1028
`
`

`

`US 2009/0287067 A1
`
`Nov. 19, 2009 Sheet 9 0f 10
`
`n0.nac.hbuPn0.nac.hwAtnetaP
`
`010
`
`FITBIT, Ex. 1028
`
`

`

`US 2009/0287067 A1
`
`Nov. 19, 2009 Sheet 10 0f 10
`
`n0.nac.hbuPn0.nac.hwAtnetaP
`
`
`
`
`momem.92.:FEES:Em:memzmmdata.328
`
`011
`
`FITBIT, Ex. 1028
`
`

`

`O12
`
`invention can include systems and
`[0012] The present
`methods for integrating sensors for tracking a user‘s perfor-
`mance metrics into electronic devices and accessories there-
`for. In one embodiment of the present invention, the elec-
`tronic devices can include portable media devices similar to
`iPodsTM sold by Apple Inc. of Cupertino, Calif. or cellular
`telephones similar to iPhonesTM designed by Apple Inc.
`[0013]
`In one embodiment,
`the present
`invention can
`include headsets having one or more integrated physiological
`sensors. The headsets can be, for example, headphones for
`receiving audio signals from a media device or headsets for
`communication with cellular telephones. The sensor signals
`can be transmitted to a data repository through the same
`communication channel through which audio signals are
`transmitted to the headset (e.g., hard—wired or wireless).
`[0014]
`In one embodiment,
`the present
`invention can
`include a sling having one or more integrated physiological
`sensors. The sling can have an enclosure within which a
`portable electronic device can be disposed. The sling also can
`have a strap for securing the sling and the portable electronic
`device to the user’s body or clothing. In one embodiment of
`the present invention, the sling can have an integrated con-
`nector configured to be operatively coupled to a complemen-
`tary connector in the portable electronic device. The sensor
`signals can be transmitted from the sling to the portable
`electronic device via these connectors. Alternatively, the sen-
`sor signals can be transmitted via Wireless commtmication
`protocols.
`invention can
`the present
`[0015]
`In one embodiment,
`include a portable media device having one or more inte-
`grated physiological sensors. The physiological sensors can
`(1) be exposed through the housing of the portable media
`device, or (2) be hidden from View and undetectable by the
`user. A sling for securing such a portable electronic device to
`the user’s body also is provided by the present invention.
`[001 6]
`In one embodiment ofthe present invention, an elec—
`tronic device can accept data from one or more physiological
`sensors, along with data from one or more other sensors that
`track the user’s movements. The movement sensors can be
`disposed within the electronic device itself or attached to or
`incorporated within the user’s body or clothing (e.g., a move-
`ment sensor similar to the sensor from the Nike+iPod Sport
`Kit sold byApple Inc. and Nike Inc. of Beaverton, Oreg.) The
`electronic device can be configured to condition the data from
`the physiological sensors using the data from the movement
`sensors. For example, because the physiological sensor may
`contain anomalies due to the user’s movements, the electronic
`
`INTEGRATED SENSORS FOR TRACKING
`PERFORVIANCE .VIETRIC S
`
`
`CROSS-R A F A RENC 4 TO RELATED
`APPLICATION S
`
`
`
`
`
`US 2009/0287067 A1
`
`NOV. 19, 2009
`
`[0011] During the workout, the user may want to monitor
`his performance metrics, e.g., the distance the user has cov—
`ered during a jog and/or the user’s heart rate. Conventionally,
`this can require the user to attach additional electronic devices
`to his body or clothing. For example, to monitor the distance
`a user has jogged, the user may clip a pedometer to his
`clothing. To obtain information about the user’s heart rate, the
`user may strap a heart rate sensor to his chest and a receiver
`for receiving data from the heart rate sensor to his wrist.
`Disadvantageously, the user can become very uncomfortable
`during his fitness routine due to the number of devices the
`user has attached to his body and clothing.
`
`SUMMARY OF THE INVENTION
`
`[0001] This is related 0:
`[0002] U.S. Provisional Patent Applicationl\o. 60/846,414
`to Gilley et al., filed on Sep. 21, 2006 (referred to herein as
`“the incorporated provisional patent application”),
`the
`entirety of which is incorporated herein by reference;
`[0003] U.S. patent application Ser. No.
`to Gilley et
`
`al., filed on Mar. 27, 2007, entitled “LIFESTYLE COMPAN-
`ION SYSTEM,” Attomey Docket No. 104677-0019-101/
`P4725I SI
`(referred to herein as “the incorporated I,IE-
`
`ESTYLE COMPANION document”), the entirety ofwhich is
`incorporated herein by reference;
`to Gilley et
`[0004] U.S. patent application Ser. No.
`
`al., filed on Mar. 27, 2007, entitled “SYSTEMS AND METH-
`ODS FOR PROVIDING AUDIO AND VISUAL CUES VIA
`
`A PORTABLE ELECTRONIC DEVICE,” Attorney Docket
`No. 104677—0019—102/P4725US2 (referred to herein as “the
`incorporated AUDIO AND VISUAL CUES document”), the
`entirety of which is incorporated herein by reference;
`[0005] U.S. patent application Ser. No.
`to Gilley et
`al.,
`filed on Mar. 27, 2007, entitled “DYNAMICAIIY
`ADAPTIVE SCHEDULING SYSTEM,” Attorney Docket
`No. 104677-0019-103/P4725US3 (referred to herein as “the
`
`incorporated ADAPTIVE SCHEDULING SYSTEM docu-
`ment”), the entirety of which is incorpora ed herein by refer-
`cnce;
`to Gilley et
`[0006] U.S. patent application Ser. No.
`al., filed on Mar. 27, 2007, entitled “SYSTEMS AND METH—
`ODS FOR FACILITATING GROUP ACTIVITIES,” Attor-
`ney Docket No. 104677-001 9-104/P4725US4 (referred to
`herein as “the incorporated GROUP ACTIVITIES docu-
`ment”), the entirety of which is incorpora ed herein by refer—
`ence;
`to Gilley et
`[0007] U.S. patent application Ser. No.
`
`al., filed on Mar. 27, 2007, entitled “VARIABLE I/O INTER-
`
`FACE TOR PORTABLE MEDIA DEVICE,” Attorney
`Docket No. 104677—0025—101/P4732USI (referred to herein
`as “the incorporated VARIABLE I/O document”),
`the
`entirety of which is incorporated herein by reference; and
`[0008] U.S. patent application Ser. No.
`to Gilley et
`al., filed on Mar. 27, 2007, entitled “REWARDS SYSTEMS,”
`Attorney Docket No. 104677-0022-101/P4727USI (referred
`to herein as “the incorporated REWARDS SYSTEMS docu—
`ment”), the entirety of which is incorporated herein by refer-
`ence.
`
`
`
`EIEID OF THE INVENTION
`
`[0009] The present invention relates to electronic devices
`and accessories having integrated sensors for tracking a user’s
`performance metrics.
`
`BACKGROUND OF THE INVENTION
`
`[0010] An increasing number of people are exercising to
`the beat oftheir favorite songs. Often, the songs are stored on
`a portable media player strapped to a user’s arm so that the
`user would not need to carry the portable media player during
`the workout. Audio signals can be transmitted from the por-
`table media player to the user’s ear using a set ofheadphones.
`
`012
`
`FITBIT, Ex. 1028
`
`

`

`O13
`
`invention can include systems and
`[0032] The present
`methods for integrating sensors for tracking a users perfor-
`mance metrics into media devices and accessories therefor,
`thereby reducing or eliminating the need for additional inde-
`pendent monitoring devices. Advantageously, such integra-
`tion of sensors can be desirable because it requires no addi-
`tional effort by the user to use them. As used herein,
`performance metrics can include physiological metrics (e. g.,
`heart rate, EKG, blood oxygen content, temperature, heat
`flux, etc.) and non-physiological indications of performance
`(e.g., distance covered, pace, etc.).
`[0033]
`FIG. 2 illustrates an earbud of a headset having one
`or more integrated physiological sensors in accordance with
`one embodiment of the present invention. Earbud 202 can
`have housing 204 and internal cavity 206. Internal cavity 206
`can be bisected by internal wall 208 into separate acoustical
`chambers. Speaker 210 can be positioned within internal
`cavity 206 (e.g., mounted onto internal wall 208) so that
`sound waves emanating from the speaker are directed out of
`acoustical aperture 212. Speaker 210 can be coupled to wires
`214 that transmit audio signals from an electronic device (not
`shown). Outside earbud 202, wires 214 can be encased in a
`non—conductive material to form cable 21 6. One embodiment
`of the electronic device of the present invention is described
`in greater detail below with respect to FIG. 4.
`[0034]
`In one embodiment ofthe present invention, earbud
`202 also can be equipped with one or more physiological
`sensors 218. For example, sensors 218 can include one or
`more infrared photodetectors for tracking the user’s tempera-
`ture, heat flux, and heart rate. From infrared radiation in the
`user’s ear, sensors 218 can detect minute temperature varia-
`tions due to the user’s heart beats. Heart rate can be calculated
`based on the time between beats and the user’s temperature
`can be set as the “DC component” (or average or median
`value) of the detected temperature distribution. Other sensors
`also can be used for tracking the same physiological metrics
`or different physiological metrics. In one embodiment of the
`present
`invention, one sensor 218 can be centered with
`respect to acoustical aperture 212 to ensure that the sensor
`receives a sufficient infrared signal regardless ofhow the user
`positions earbud 202 in the user’s ear. Alternatively, speaker
`210 can be centered with respect to acoustical aperture 212
`and two or more of the same sensors 218 can be positioned
`around the periphery of speaker 210. This can increase the
`likelihood that at least one sensor 218 can obtain a sufficient
`infrared signal regardless of how the user positions earbud
`202 in the user’s ear.
`
`device can identify the anomalies based on data indicative of
`the user’s movements and thereafter remove or filter out their
`eITects.
`
`
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0017] The above and other advantages of the present
`invention will be apparent upon consideration of the follow-
`ing detailed description, taken in conj metion with accompa-
`nying drawings, in which like reference characters refer to
`like parts throughout, and in which:
`[0018]
`FIG. 1A illustrates a prior art portable media sys-
`tem;
`FIG. 1B illustrates a prior art physiological moni-
`[0019]
`toring system;
`[0020]
`FIG. 2 illustrates an earbud of a headset having one
`or more integrated physiological sensors in accordance with
`one embodiment of the present invention;
`[0021]
`FIGS. 3A-3B illustrate an alternative earbud of a
`headset having one or more integrated physiological sensors
`in accordance with one embodiment of the present invention;
`[0022]
`FIG. 4 shows a third illustrative headset having one
`or more integrated physiological sensors and an illustrative
`portable electronic device in accordance with one embodi-
`ment of the present invention;
`[0023]
`FIG. 5 illustrates an adapter for providing hard-
`wired communication between a headset and an electronic
`device in accordance with one embodiment of the present
`invention;
`[0024]
`FIGS. 6A-6B illustrate an armband having one or
`more integrated physiological sensors in accordance with one
`embodiment of the present invention;
`[0025]
`FIGS. 7A-7B illustrate a portable electronic device
`having one or more integrated physiological sensors in accor—
`dance with one embodiment of the present invention;
`[0026]
`FIG. 7C illustrates an armband for use with the
`portable electronic device of FIGS. 7A-7B in accordance
`with one embodiment of the present invention;
`[0027]
`FIG. 8 illustrates a portable electronic device that
`accepts data from multiple sensors in accordance with one
`embodiment of the present invention; and
`[0028]
`FIGS. 9A-9C illustrate signal conditioning of data
`from a physiological sensor using data indicative of a users
`movements in accordance with one embodiment of the
`present invention.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`FIG. 1A illustrates a prior art portable media system
`[0029]
`having portable media device 102, headset 104, and armband
`106. Portable media device 102 can provide audio signals to
`a user via headset 1 04. The audio signals canbe transmitted to
`headset 104 using wires 106. While the user is exercising or
`otherwise does not wish to carry portable media device 102 in
`his hands, the user can strap the portable media device to his
`arm using armband 108.
`[0030]
`FIG. 1E illustrates a prior art physiological moni-
`toring system. A user may use conventional heart rate moni—
`toring system 110 to monitor the user‘s heart rate, e.g.. while
`the user is performing an exercise routine. Conventional heart
`rate monitoring system 110 can be equipped with heart rate
`sensor 112, which the user can strap onto the user’s chest
`using chest band 114. Heart rate monitoring system 110 also
`can have receiver 116, which can accept wireless data signals
`transmitted from heart rate sensor 112 and display such infor-
`
`US 2009/0287067 A1
`
`Nov. 19, 2009
`
`mation for the user’s consideration. Typically, receiver 116 is
`configured to be strapped onto a user’s wrist in a manner
`similar to that of a watch.
`[0031]
`So. ifa user wants to listen to be entertained, e.g., by
`audio tracks stored on portable media device 102 and simul-
`taneously monitor his performance metrics during a workout,
`the user would need to strap his portable media player onto his
`arm, a heart rate sensor to his chest, and a receiver to his wrist.
`Unfortunately, due to the numerous electronic devices
`strapped to the user, the user may experience considerable
`discomfort.
`
`Sensors 218 can send data signals to a signal pro-
`[0035]
`cessor. The signal processor can be disposed in earbud 202, in
`an electronic device from which the earbud receives audio
`signals, and/or in an adapter configured for coupling to the
`electronic device. Illustrative embodiments of an electronic
`device and adapter are described in greater detail herein.
`
`013
`
`FITBIT, Ex. 1028
`
`

`

`US 2009/0287067 A1
`
`Nov. 19, 2009
`
`014
`
`In accordance with one aspect of the present inven-
`[0036]
`tion, earbud 202 can be incorporated into a wired or wireless
`headset
`that receives and/or transmits audio signals. For
`example, if the electronic device with which the headset
`communicates is a telephone,
`the headset also can be
`equipped with a microphone. The telephone can be based on
`any one ofthe following networks: public switched telephone
`network (PSTN), cellular, voice over
`internet protocol
`(VoIP), any other telephone network, or any combination
`thereof. Each carbud in the headset can have sensors 218 or
`only one of the earbuds can have sensors 218.
`[0037]
`FIGS. 3A—3B illustrate an alternative earbud of a
`headset having one or more integrated physiological sensors
`in accordance with one embodiment of the present invention.
`Earbud 302 can have housing 304 with main body portion 306
`and clip portions 308a and 30819. Main body portion 306 can
`be equipped with speaker 310 for delivering acoustic signals
`to the user and. in some embodiments, physiological sensors
`similar to sensors 218 ofFIG. 2. When main body portion 306
`is disposed in a user’s ear, clip portion 3080 can be configured
`to be disposed near or against the front lobe of the user’s
`earlobe, and clip portion 308b can be configured to be dis—
`posed near or against the back lobe of the user’s earlobe (or
`vice versa). In one embodiment of the present invention, a
`spring force can be provided to bias clip portions 308a and
`30817 against the user’s earlobe.
`[0038] Light source 312 can be disposed within clip portion
`30811 or 308b, and photodetector 314 can be disposed within
`the other clip portion. Clip portions 308a and 308b can have
`apertures through which light can be transmitted and received
`by light source 312 and photodetector 314, respectively.
`Altematively, clip portions 308a and 3081) can be made at
`least partially of a transmissive material through which the
`light can pass.
`[0039]
`In one embodiment of the present invention, light
`source 312 and photodetector 3 14 can be used to track a user’s
`blood oxygen content and heart-rate. For example,
`light
`source 312 can include two light emitting diodes that provide
`light at two different wavelengths. Photodetector 314 can
`detect the portion of such light that passes through the user’s
`earlobe, the remaining light having been absorbed by the
`blood within the user’s earlobe. From the relative absorption
`of these two wavelengths of light, the user’s blood oxygen
`content can be calculated. The user‘s heart beat also can be
`determined based on the photodetector signal since the signal
`may bounce in time with the user’s heart beat due to the
`expansion and contraction of arterial blood vessels. In an
`altemative embodiment, both light source 312 and photode—
`tector 314 can be disposed in either clip portion 3080 or 30817
`and operate as a reflectance pulse oximeter.
`[0040] Light source 312 can receive signals from and pho-
`todetector 314 can send data signals to a controller that con-
`trols the light source and photodetector and processes signals
`sent thereto or received therefrom. The controller can be
`disposed in earbud 302, in an electronic device from which
`the earbud receives audio signals, and/or in an adapter con-
`figured for coupling to the electronic device.
`[0041]
`In accordance with an alternative embodiment ofthe
`present invention, electrical contacts (not shown) also can be
`disposed within clip portion 3081; and/or 308b, in addition to
`or instead of light source 312 and photodetector 314. Electri-
`cal contacts can include contacts for detecting, e.g., tempera—
`ture, heat flux, EKG waveforms, heart rate, any other suitable
`physiological metric, or any combination thereof. For
`
`example, to detect EKG waveforms, each carbud of a headset
`can be equipped with electrical contacts. The placement of
`the electrical contacts in both the left and right hemispheres of
`the user body and the resulting distance between electrical
`contacts can permit the present invention to detect greater
`voltage differences, and thus more accurate EKG data. The
`user’s heart rate can be extracted from the EKG waveforms,
`although,
`in some embodiments of the present invention,
`heart rate can be determined without detecting EKG wave—
`forms.
`
`FIG. 4 shows a third illustrative headset having one
`[0042]
`or more integrated physiological sensors and an illustrative
`portable electronic device in accordance with one embodi-
`ment of the present invention. Headset 402 can incorporate
`earbud 404, cable 406, audio connector 408, and sensor 410.
`Earbud 404 can be equipped with a speaker and, in some
`embodiments, sensors similar to those described with respect
`to FIGS. 2 and 3A-3B. Cable 406 can electrically and
`mechanically couple earbud 404 and sensor 410 to audio
`connector 408. Sensor 410 can be any one of the sensors
`described herein for tracking a user’s physiological metrics.
`For example. sensor 410 can include electrical contacts for
`measuring heart rate or sensors for a reflectance pulse oxime-
`ter,
`
`To promote contact between sensor 410 and the
`[0043]
`user’s skin, the sensor can be partially or fully encased in a
`material that causes it to be removany attached to the user’s
`skin. For example, sensor 410 can be encased in a material
`that is attracted to the ionic charges on the user’s skin.
`[0044]
`Portable electronic device 412 can have housing 414
`within which is disposed display 416, user input component
`418, memory 420, antenna(s) 421, controller 422, sensors
`424, audio connector receptacle 426, and connector 428.
`[0045] User input component 418 can permit a user to
`interact with the electronic device. User input component 418
`can include a clickwheel similar to that incorporated in some
`models of iPodsTM. The clickwheel can include one or more
`buttons and a touchpad. The touchpad can pemiit a user to
`scroll by running the user’s finger around the track of the
`clickwheel. In alternative embodiments, user input compo—
`nent 418 can include. for example, one or more buttons. a
`touchpad, a touchscreen display, electronics for accepting
`voice conmiands, antennas for accepting signals from other
`electronic devices, infrared ports for accepting signals from
`other electronic devices, or any combination thereof. In one
`embodiment of the present invention, display 416 and user
`input 418 can be integrated into one component by using a
`touchscreen display.
`[0046] Memory 420 can store sensor data generated by
`sensor 410, sensor(s) 424, and/or any other sensor used for
`tracking a user’s performance metrics, Memory 420 can
`include read only memory, random access memory, solid-
`state memory, buffer memory, hard drive memory, any other
`memory known in the art or otherwise, or any combination
`thereof.
`
`invention,
`In one embodiment of the present
`[0047]
`memory 420 also can store media files for playback by elec-
`tronic device 412. Media files can include, for example, audio
`files for playback through speakers (e.g., headset 402) and/or
`graphic images for playback on a display (e.g., display 416).
`The media files can include media files that a user has selected
`to be played back during performance of an activity to enter-
`tain and motivate the user. Such media files can include, for
`
`014
`
`FITBIT, Ex. 1028
`
`

`

`US 2009/0287067 A1
`
`Nov. 19, 2009
`
`015
`
`[0050] Display 416 can provide graphics (e.g., text, still
`images, and/or videos) to the user. In one embodiment of the
`present invention, display 416 can provide the user with
`graphics about the user’s performance metrics. Display 416
`also can provide entertainment graphics from media files
`stored in memory 420 or downloaded from a data network via
`antenna(s) 421. In one embodiment of the present invention,
`controller 422 can instruct display 416 to display graphics
`about
`the user’s performance metrics and entertainment
`graphics simultaneously. Advantageously, this permits a user
`to monitor his performance metrics while simultaneously be
`entertained during his workout.
`[0051]
`Sensors 424 can incorporate sensors described in
`greater detail with respect to FIGS. 7A—7B and/or other sen—
`sors that can track the user’s performance metrics. In one
`embodiment of the present invention, sensor 424 can be a
`sensor for tracking a user’s movements. In one embodiment,
`movement sensors can include an accelerometer or GPS chip
`for detecting a user’s movements while walking or jogging.
`[0052] Data from sensors 424 and any other sensor for
`tracking performance metrics can be transmitted to signal
`processing module 430 ofcontroller 422 for signal process-
`ing. For example, signal processing module 430 can incorpo-
`rate digital circuitry, analog circuitry, and/or software for
`amplifying and filtering the sensor data.
`[0053] Audio connector receptacle 426 can be configured
`to accept audio connector 408 ofheadset 402. In one embodi-
`ment ofthe present invention, audio comlector 408 and recep-
`tacle 426 can transmit control signals to and accept data from
`sensors integrated with headset via a dedicated electrical lead
`in audio connector 408. Alternatively, the control signals and
`sensor data can be interleaved with other signals using, e.g., a
`serial interface protocol.
`[0054]
`In a further alternative embodiment, the control sig-
`nals and sensor data can be transmitted through connector
`428, as illustratively described in greater detail with respect to
`FIGS. 5 and 8. In one embodiment of the present invention,
`connector 428 can be a multiple pin connector similar to that
`described in US. Patent Application Publication No.
`
`example, songs, audio books, multimedia presentations, still
`images, text, podcasts, videos, etc.
`[0048] Electronic device 412 can have one or more anten—
`nas 421 for wirelessly communicating with a data network
`and/or with one or more accessories (e.g., any ofthe headsets
`described herein). For example, the electronic device can
`include one or more antennas for communication with Blue—
`tooth-enabled devices. WiFi network, cellular network, radio
`network, or any combination thereof. In one embodiment of
`the present invention, antenna(s) 421 can permit a user to
`stream or otherwise download audio and]or visual media to
`entertain and motivate the user during performance of an
`activity. For example, the user may choose to stream internet
`radio or a podcast through a WiFi network. If electronic
`device 412 is a cellular telephone, the user may choose to have
`a telephone conversation with another person by connecting
`to a cellular network.
`[0049] Controller 422 can, for example, control operation
`of electronic device 412, generate audio signals for transmis-
`sion to a headset, instruct audio signals to be transmitted to a
`headset, generate control signals for any of the sensors
`described herein, and/or accept data signals from any of the
`sensors described herein. Controller 422 can include one or
`more processors, ASICS, circuits, or any combination
`thereof.
`
`20050240705 to Novotney ct al., published on Oct. 27, 2005,
`the entirety of which is incorporated by reference herein.
`Electronic device 412 can use connector 428 for data com-
`munication with a local server, e.g., the user’s personal com-
`puter.
`In one embodiment of the present invention, con-
`[0055]
`troller 422 can generate audio signals related to the user’s
`performance metrics. These audio signals can be intermixed
`with audio signals from entertainment media files stored in
`memory 420 or audio signals downloaded by the user from
`data networks (e.g., the internet or radio broadcast).
`[0056]
`In one embodiment of the present invention, elec-
`tronic device 412 can be an il"odTM oran iPhoneTM. Electronic
`device 412 also can be any electronic device suitable for
`processing signals from sensors that track a user’s perfor-
`mance metrics during physical activity. For example, the
`electronic device can be any portable, mobile, hand-held, or
`miniature consumer electronic device. Illustrative electronic
`devices can include, but are not limited to, music players,
`video players, still image players, game players, other media
`players, music recorders, video recorders, cameras, other
`media recorders, radios, medical equipment, calculators, cel-
`lular phones, other wireless communication devices, personal
`digital assistants. programmable remote controls, pagers, lap-
`top computers, printers, or any combination thereof. Minia-
`ture electronic devices may have a form factor that is smaller
`than that of hand-held devices. Illustrative miniature elec-
`tronic devices can include, but are not limited to, watches,
`rings, necklaces, belts, accessories for belts, headsets, acces-
`sories for shoes, virtual reality devices, other wearable elec-
`tronics, accessories for sporting equipment, accessories for
`fitness equipment, key chains, or any combination thereof.
`[0057] While electronic device 412 is illustratively shown
`in operation with headset 402 in FIG. 4, electronic device 412
`can be used alone or in combination with any of the accesso-
`ries described herein.
`
`FIG. 5 illustrates an adapter for providing hard-
`[0058]
`wired commLmication between a headset and an electronic
`device in accordance with one embodiment of the present
`invention. Headset 502 can be similar to any of the headsets
`described herein, e.g., the headsets described with respect to
`FIGS. 2, 3A-3B, and 4. Headset 502 can be coupled to elec-
`tronic device 504 via adapter 506. Adapter 506 can have
`connector 510 configured for electrical and mechanical cou-
`pling to a complementary connector in electronic device 504
`(e.g., a comiector similar to connector 428 of FIG. 4).
`[0059]
`In one embodiment ofthe present invention, adapter
`506 can incorporate signal processing module 508 for pro-
`cessing signals from sensors integrated with headset 502, in
`contrast to the embodiment of FIG. 4 which illustratively can
`integrate a similar signal processing module within electronic
`device 412. During operation. a controller within electronic
`device 504 can transmit audio and control signals for headset
`502 via adapter 506. Sensor data also can be transmitted back
`to electronic device 504 via adapter 506, after having been
`conditioned by signal processing module 508 in adapter 506.
`In one embodiment of the present invention, comiector 510
`can transmit audio and control signals to and accept data from
`sensors integrated with headset via dedicated electrical lead
`(s) in the connector. Alternatively, the audio and control sig—
`nals and sensor data can be interleaved with other signals
`transmitted through comiector 510.
`[0060]
`FIGS. 6A-6B illustrate an armband having one or
`more integrated physiological sensors in accordance with one
`
`015
`
`FITBIT, Ex. 1028
`
`

`

`US 2009/0287067 A1
`
`Nov. 19, 2009
`
`O16
`
`embodiment of the present invention. Armband 602 can have
`enclosure 604 within which a portable electronic device simi—
`lar to, e.g., electronic device 412, can be disposed. To secure
`enclosure 604 (and thus any electronic device disposed
`therein) to a user’s arm, armband 602 can have strap 606, e.g.,
`an elastic strap with Velcro.
`[0061]
`In one embodiment of the present invention, arm-
`band 602 can be equipped with one or more integrated sensors
`608 for tracking the physiological metrics of the user. Sensors
`608 can be integrated into, e.g., a back wall of enclosure 604
`or within strap 606. When armband 602 is strapped onto a
`user’s arm, the sensors can be positioned in close proximity to
`or in contact with the user’s skin.
`[0062] One or more sensors 608 can be electrical contacts
`for tracking, e.g., a user’s EKG waveforms, heart rate. tem-
`perature, and/or heat flux. The electrical contacts can be
`exposed to the external environment or obtain physiological
`signals through material that is conducive to electrical and/or
`thermal conduction. For example. one or more sensors 608
`can include electrical contacts similar to those described
`above with respect to FIG. 4.
`[0063] One or more sensors 608 also can include an optical
`sensor system for tracking, e. g, the user’s oxygen content,
`heart rate, temperature, and/or heat flux. The optical s