ao United States
`a2) Patent Application Publication
`0) Pub. No.: US 2009/0287067 Al
`
`(43) Pub. Date: Nov. 19, 2009
`Doroguskeret al.
`
`US 20090287067A1
`
`(54)
`
`INTEGRATED SENSORS FOR TRACKING
`PERFORMANCE METRICS
`
`(75)
`
`Inventors:
`
`Jesse Lee Dorogusker, Los Altos,
`CA (US); Anthony Fadell, Portola
`Valley, CA (US); Donald J.
`Novotney, San Jose, CA (US);
`Nicholas R. Kalayjian, San Carlos,
`CA (US)
`
`Correspondence Address:
`KRAMER LEVIN NAFTALIS & FRANKEL LLP
`1177 Avenue of the Americas
`NewYork, NY 10036 (US)
`
`(73)
`
`Assignee:
`
`Apple Ine., Cupertino, CA (US)
`
`(21)
`
`Appl. No.:
`
`12/507,993
`
`(22)
`
`Filed:
`
`Jul. 23, 2009
`
`Related U.S. Application Data
`
`(62)
`
`Division of application No. 11/729,075, filed on Mar.
`27, 2007, now abandoned.
`
`Publication Classification
`
`(51)
`
`Int.CL
`AGIB 5/00
`G09G 5/00
`GOOF 17/00
`
`(2006.01)
`(2006.01)
`(2006.01)
`
`(52) US. Cd ceecceeccssssssssseiseniee 600/300; 345/156; 700/94
`
`(57)
`
`ABSTRACT
`
`Electronic devices and accessories having integrated sensors
`for tracking a user’s performance metrics are provided. In one
`embodiment, the present invention can include a headset
`having integrated physiological sensors. ‘The present inven-
`tion also can include a sling having one or more integrated
`physiological sensors. The sling can secure a portable elec-
`tronic device to a user’s body or clothing. The present inven-
`tion also can include a portable media device having one or
`more integrated physiological sensors. In one embodiment,
`an electronic device of the present invention can accept data
`from multiple sensors, including one or more sensors that
`track a user’s movements. The electronic device can be con-
`figured to condition data from physiological sensors using
`
`data indicative of the user’s movements.
`
`001
`
`U.S. Patent No.
`
`Apple Inc.
`APL1028
`8,923,941
`
`FITBIT,
`
`Ex. 1028
`
`Apple Inc.
`APL1028
`U.S. Patent No. 8,923,941
`
`001
`
`FITBIT, Ex. 1028
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 1 of 10
`
`US 2009/0287067 Al
`
`
`
`PRIOR ART
`
`002
`
`FITBIT, Ex. 1028
`
`002
`
`FITBIT, Ex. 1028
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 2 of 10
`
`US 2009/0287067 Al
`
`|
`
`FIG. 1B
`PRIOR ART
`
`003
`
`FITBIT, Ex. 1028
`
`003
`
`FITBIT, Ex. 1028
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 3 of 10
`
`US 2009/0287067 Al
`
`SPEAKER SOURCE
`
`DETECTOR
`
`308b
`
`FIG. 3B
`
`004
`
`FITBIT, Ex. 1028
`
`004
`
`FITBIT, Ex. 1028
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 4 of 10
`
`US 2009/0287067 Al
`
`404
`
`402~__
`
`410
`
`ANTENNA(S)
`421
`
`422
`
`PRO-
`
`°F
`
`CONTROLLER
`
`005
`
`FITBIT, Ex. 1028
`
`005
`
`FITBIT, Ex. 1028
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 5 of 10
`
`US 2009/0287067 Al
`
`' PROCESSING!
`22------ Ko
`
` 1 SIGNAL
`
`FIG. 5
`
`006
`
`FITBIT, Ex. 1028
`
`006
`
`FITBIT, Ex. 1028
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 6 of 10
`
`US 2009/0287067 Al
`
`
`
`FIG. 6B
`
`007
`
`FITBIT, Ex. 1028
`
`007
`
`FITBIT, Ex. 1028
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 7 of 10
`
`US 2009/0287067 Al
`
`702
`
`704
`
`108
`
`708
`
`FIG. 7A
`
`
`
`FIG. 7B
`
`008
`
`FITBIT, Ex. 1028
`
`008
`
`FITBIT, Ex. 1028
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 8 of 10
`
`US 2009/0287067 Al
`
`
`
`FIG. 7C
`
`009
`
`FITBIT, Ex. 1028
`
`009
`
`FITBIT, Ex. 1028
`
`

`

`Patent Application Publication
`
`Nov. 19, 2009 Sheet 9 of 10
`
`US 2009/0287067 Al
`
`8Old
`
`|!sou
`
`.11411
`
`TWNOIS
`
`eesewweewe
`
`010
`
`FITBIT, Ex. 1028
`
`010
`
`FITBIT, Ex. 1028
`
`
`
`
`

`

`Patent Application Publication
`
`Nov. 19, 2009 Sheet 10 of 10
`
`US 2009/0287067 Al
`
`YOSNAS
`
`‘OISAHd LNAWSAOWN
`
`83Sf1
`
`
`
`
`
`YOSNSS‘OISAHd‘ONOO
`
`FIG. 9B
`
`FIG. 9C
`
`011
`
`FITBIT, Ex. 1028
`
`011
`
`FITBIT, Ex. 1028
`
`
`

`

`US 2009/0287067 Al
`
`Nov. 19, 2009
`
`INTEGRATED SENSORS FOR TRACKING
`PERFORMANCE METRICS
`
`
` CROSS-REFERENCE TO RELATED
`
`APPLICATIONS
`
`
`
`
`
`[0001] This is related to:
`[0002] U.S. Provisional Patent Application No. 60/846,414
`to Gilley et al., filed on Sep. 21, 2006 (referred to herein as
`“the incorporated provisional patent application”),
`the
`entirety of which is incorporated herein by reference;
`[0003] U.S. patent application Ser. No.
`to Gilleyet
`
`al., filed on Mar. 27, 2007, entitled “LIFESTYLE COMPAN-
`ION SYSTEM,” Attorney Docket No. 104677-0019-101/
`P4725US1 (referred to herein as “the incorporated I.]F-
`
`ESTYLE COMPANIONdocument”), the entirety ofwhich is
`incorporated herein byreference;
`to Gilleyet
`[0004] U.S. patent application Ser. No.
`
`al., filed on Mar. 27, 2007, entitled “SYSTEMS AND METH-
`ODS FOR PROVIDING AUDIO ANDVISUAL CUES VIA
`
`A PORTABLE ELECTRONIC DEVICE,” Attorney Docket
`No. 104677-0019-102/P4725US2(referred to herein as “the
`incorporated AUDIO AND VISUAL CUESdocument”), the
`entirety of which is incorporated herein by reference;
`[0005] U.S. patent application Ser. No.
`to Gilleyet
`al.,
`filed on Mar. 27, 2007, entitled “DYNAMICALLY
`ADAPTIVE SCHEDULING SYSTEM,” Attorney Docket
`No. 104677-0019-103/P4725US3(referred to herein as“the
`
`incorporated ADAPTIVE SCHEDULING SYSTEM docu-
`ment’’), the entirety of which is incorporated herein by refer-
`cnee;
`to Gilleyet
`[0006] U.S. patent application Ser. No.
`al., filed on Mar. 27, 2007, entitled “SYSTEMS AND METH-
`ODS FOR FACILITATING GROUP ACTIVITIES,” Attor-
`ney Docket No. 104677-0019-104/P4725US4 (referred to
`herein as “the incorporated GROUP ACTIVITIES docu-
`ment’), the entirety of whichis incorporated herein by refer-
`ence;
`lo Gilleyet
`[0007] U.S. patent application Ser. No.
`
`al., filed on Mar. 27, 2007, entitled “VARIABLE I/O INTER-
`
`FACE FOR PORTABLE MEDIA DEVICE,’ Attorney
`Docket No. 104677-0025-101/P4732USI1 (referred to herein
`as “the incorporated VARIABLE I/O document”),
`the
`entirety of whichis incorporated herein by reference; and
`[0008] U.S. patent application Ser. No.
`to Gilleyet
`al., filed on Mar. 27, 2007, entitled “REWARDS SYSTEMS,”
`Attorney Docket No. 104677-0022-101/P4727US 1 (referred
`to herein as “the incorporated REWARDS SYSTEMSdocu-
`ment”), the entirety of whichis incorporated herein by refer-
`ence.
`
`
`
`FIFI_D OF THE INVENTION
`
`[0009] The present invention relates to electronic devices
`and accessories having integrated sensorsfor tracking a user’s
`performance metrics.
`
`BACKGROUND OFTHE INVENTION
`
`[0010] An increasing number of people are exercising to
`the beat oftheir favorite songs. Often, the songs are stored on
`a portable media player strapped to a user’s arm so that the
`user would not needto carrythe portable media player during
`the workout. Audio signals can be transmitted from the por-
`table media playerto the user’s ear using a set ofheadphones.
`
`[0011] During the workout, the uscr may want to monitor
`his performance metrics, e.g., the distance the user has cov-
`ered during a jog and/or the user’s heart rate. Conventionally,
`this can requirethe userto attach additional electronic devices
`to his body or clothing. For example, to monitorthe distance
`a user has jogged, the user may clip a pedometer to his
`clothing. To obtain information about the user’s heart rate, the
`user maystrap a heart rate sensor to his chest and a receiver
`for receiving data from the heart rate sensor to his wrist.
`Disadvantageously, the user can become very uncomfortable
`during his fitness routine due to the number of devices the
`user has attached to his bodyand clothing.
`
`SUMMARYOF THE INVENTION
`
`invention can include systems and
`[0012] The present
`methodsfor integrating sensors for tracking a user’s perfor-
`mance metrics into electronic devices and accessories there-
`for. In one embodiment of the present invention, the elec-
`tronic devices can include portable media devices similar to
`iPods™sold by Apple Inc. of Cupertino, Calif. or cellular
`telephones similar to iPhones™designed by AppleInc.
`[0013]
`In one embodiment,
`the present
`invention can
`include headsets having one or moreintegrated physiological
`sensors. The headsets can be, for example, headphones for
`receiving audio signals from a media device or headsets for
`communication with cellular telephones. The sensorsignals
`can be transmitted to a data repository through the same
`communication channel through which audio signals are
`transmitted to the headset (e.g., hard-wired or wireless).
`[0014]
`In one embodiment,
`the present
`invention can
`include a sling having one or more integrated physiological
`sensors. The sling can have an enclosure within which a
`portable clectronic device can be disposed. The sling also can
`have a strap for securing the sling and the portable electronic
`device to the user’s body or clothing. In one embodiment of
`the present invention, the sling can have an integrated con-
`nector configured to be operatively coupled to a complemen-
`tary connector in the portable electronic device. The sensor
`signals can be transmitted from the sling to the portable
`electronic device via these connectors. Alternatively, the sen-
`sor signals can be transmitted via wireless communication
`protocols.
`invention can
`the present
`[0015]
`In one embodiment,
`include a portable media device having one or more inte-
`grated physiological sensors. The physiological sensors can
`(1) be exposed through the housing of the portable media
`device, or (2) be hidden from view and undetectable by the
`user. A sling for securing such a portable electronic device to
`the user’s body also is provided bythe present invention.
`[0016]
`Inone embodimentofthe presentinvention,an elec-
`tronic device can accept data [rom one or more physiological
`sensors, along with data from one or more other sensors that
`track the user’s movements. The movement sensors can be
`disposed within the electronic device itself or attached to or
`incorporated within the user’s body or clothing (e.g., a move-
`ment sensor similar to the sensor from the Nike+iPod Sport
`Kit sold byApple Inc. and Nike Inc. of Beaverton, Oreg.). The
`electronic device can be configured to condition the data from
`the physiological sensors using the data from the movement
`sensors. For example, because the physiological sensor may
`contain anomalies dueto the user’s movements,the electronic
`
`012
`
`FITBIT, Ex. 1028
`
`012
`
`FITBIT, Ex. 1028
`
`

`

`US 2009/0287067 Al
`
`Nov. 19, 2009
`
`device can identify the anomalics based on data indicative of
`the user’s movements and thereafter removeorfilter out their
`effects.
`
`
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0017] The above and other advantages of the present
`invention will be apparent upon consideration of the follow-
`ing detailed description, taken in conjunction with accompa-
`nying drawings, in which like reference characters refer to
`like parts throughout, and in which:
`[0018]
`FIG. 1Aillustrates a prior art portable media sys-
`tem;
`[IG. 1B illustrates a prior art physiological moni-
`[0019]
`toring system:
`[0020]
`FIG.2 illustrates an earbud of a headset having one
`or more integrated physiological sensors in accordance with
`one embodiment ofthe present invention;
`[0021]
`FIGS. 3A-3B illustrate an alternative earbud of a
`headset having one or more integrated physiological sensors
`in accordance with one embodimentofthe present invention;
`[0022]
`FIG. 4 showsa third illustrative headset having one
`or more integrated physiological sensors and anillustrative
`portable electronic device in accordance with one embodi-
`mentof the present invention,
`[0023]
`FIG. 5 illustrates an adapter for providing hard-
`wired communication between a headset and an electronic
`device in accordance with one embodiment of the present
`invention;
`[0024]
`FIGS. 6A-6B illustrate an armband having one or
`more integrated physiological sensors in accordance with one
`embodimentofthe present invention;
`[0025]
`FIGS. 7A-7Billustrate a portable electronic device
`having one or moreintegrated physiological sensors in accor-
`dance with one embodimentofthe present invention;
`[0026]
`FIG. 7C illustrates an armband for use with the
`portable electronic device of FIGS. 7A-7B in accordance
`with one embodimentofthe present invention;
`[0027]
`FIG.8 illustrates a portable clectronic device that
`accepts data from multiple sensors in accordance with one
`embodimentof the present invention; and
`[0028]
`FIGS. 9A-9C illustrate signal conditioning of data
`from a physiological sensor using data indicative ofa users
`movements in accordance with one embodiment of the
`present invention.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`FIG. 1A illustrates a prior art portable media system
`[0029]
`having portable media device 102, headset 104, and armband
`106. Portable media device 102 can provide audio signals to
`auser via headset 104. The audio signals can be transmitted to
`headset 104 using wires 106. While the user is exercising or
`otherwise does not wish to carry portable media device 102 in
`his hands, the user can strap the portable media device to his
`arm using armband 108.
`[0030]
`FIG. 1B illustrates a prior art physiological moni-
`toring system. A user mayuse conventional heart rate moni-
`toring system 110 to monitor the user’s heart rate, e.g., while
`the user is performing anexercise routine. Conventional heart
`rate monitoring system 110 can be equipped with heart rate
`sensor 112, which the user can strap onto the user’s chest
`using chest band 114. Heart rate monitoring system 110 also
`can have receiver 116, which can accept wireless data signals
`transmitted fromheart rate sensor 112 and displaysuchinfor-
`
`mation for the user’s consideration. Typically, recciver 116 is
`configured to be strapped onto a user’s wrist in a manner
`similar to that of a watch.
`[0031]
`So, ifauser wantsto listen to be entertained, e.g., by
`audio tracks stored on portable media device 102 and simul-
`taneously monitorhis performance metrics during a workout,
`the user would need to strap his portable media playeronto his
`arm, a heart rate sensorto his chest, and a receiverto his wrist.
`Unfortunately, due to the numerous electronic devices
`strapped to the user, the user may experience considerable
`discomfort.
`
`invention can include systems and
`‘The present
`[0032]
`methods for integrating sensors for tracking a users perfor-
`mance metrics into media devices and accessories therefor,
`therebyreducing or eliminating the need for additional inde-
`pendent monitoring devices. Advantageously, such integra-
`tion of sensors can be desirable because it requires no addi-
`tional effort by the user to use them. As used herein,
`performance metrics can include physiological metrics(e.g.,
`heart rate, EKG, blood oxygen content, temperature, heat
`flux, etc.) and non-physiological indications of performance
`(e.g., distance covered, pace, etc.).
`[0033]
`FIG. 2 illustrates an earbud of a headset having one
`or more integrated physiological sensors in accordance with
`one embodiment of the present invention. Earbud 202 can
`have housing 204 and internal cavily 206. Internal cavity 206
`can be bisected by internal wall 208 into separate acoustical
`chambers. Speaker 210 can be positioned within internal
`cavity 206 (e.g., mounted onto internal wall 208) so that
`sound waves emanating from the speakerare directed out of
`acoustical aperture 212. Speaker 210 can be coupledto wires
`214that transmit audio signals from an electronic device (not
`shown). Outside carbud 202, wires 214 can be encased in a
`non-conductive material to form cable 216. One embodiment
`ofthe electronic device of the present invention is described
`in greater detail below with respect to FIG. 4.
`[0034]
`In one embodimentofthe present invention, earbud
`202 also can be equipped with one or more physiological
`sensors 218. For example, sensors 218 can include one or
`more infrared photodetectors for tracking the user’s tempera-
`ture, heat flux, and heart rate. From infrared radiation in the
`user’s ear, sensors 218 can detect minute temperature varia-
`tions dueto the user’s heart beats. Heart rate can be calculated
`based on the time between beats and the user’s temperature
`can be set as the “DC component” (or average or median
`value) of the detected temperature distribution. Other sensors
`also can be usedfor tracking the same physiological metrics
`or different physiological metrics. In one embodimentof the
`present
`invention, one sensor 218 can be centered with
`respect to acoustical aperture 212 to ensure that the sensor
`receives a sufficient infrared signal regardless ofhow the user
`positions earbud 202 inthe user’s ear. Alternatively, speaker
`210 can be centered with respect to acoustical aperture 212
`and two or more of the same sensors 218 can be positioned
`around the periphery of speaker 210. This can increase the
`likelihoodthatat least one sensor 218 can obtain a sufficient
`infrared signal regardless of how the user positions earbud
`202 in the user’s ear.
`
`Sensors 218 can send data signals to a signal pro-
`[0035]
`cessor. The signal processor can be disposed in earbud 202,in
`an clectronic device from which the carbud receives audio
`signals, and/or in an adapter configured for coupling to the
`electronic device. Illustrative embodiments of an electronic
`device and adapter are described ingreater detail herein.
`
`013
`
`FITBIT, Ex. 1028
`
`013
`
`FITBIT, Ex. 1028
`
`

`

`US 2009/0287067 Al
`
`Nov. 19, 2009
`
`In accordance with one aspect of the present inven-
`[0036]
`tion, earbud 202 can be incorporated into a wired or wireless
`headset
`that receives and/or transmits audio signals. For
`example, if the electronic device with which the headset
`communicates is a telephone,
`the headset also can be
`equipped with a microphone. Thetelephone can be based on
`any one ofthe following networks: public switched telephone
`network (PSTN), cellular, voice over
`internet protocol
`(VoIP), any other telephone network, or any combination
`thereof. Each carbud in the headset can have sensors 218 or
`only one of the earbuds can have sensors 218.
`[0037]
`FIGS. 3A-3Billustrate an alternative earbud of a
`headset having one or more integrated physiological sensors
`in accordance with one embodimentof the present invention.
`Earbud 302 can have housing 304 with main bodyportion 306
`and clip portions 308@ and 3085. Main bodyportion 306 can
`be equipped with speaker 310 for delivering acoustic signals
`to the user and, in some embodiments, physiological sensors
`similar to sensors 218 ofFIG. 2.When main bodyportion 306
`is disposed in a user’s ear, clip portion 3084 can be configured
`to be disposed near or against the front lobe of the user’s
`earlobe, and clip portion 3084 can be configured to be dis-
`posed near or against the back lobe of the user’s earlobe (or
`vice versa). In one embodimentof the present invention, a
`spring force can be provided to bias clip portions 308a and
`308d against the user’s earlobe.
`[0038] Light source 312 can be disposed within clip portion
`308a or 3086, and photodetector 314 can be disposed within
`the other clip portion. Clip portions 3082 and 308d can have
`apertures through whichlight can be transmitted and received
`by light source 312 and photodetector 314, respectively.
`Alternatively, clip portions 308@ and 3085 can be made at
`least partially of a transmissive material through which the
`light can pass.
`[0039]
`In one embodiment of the present invention, light
`source 312 and photodetector 314 can be usedto track a user’s
`blood oxygen content and. heart-rate. for example,
`light
`source 312 can include twolight emitting diodes that provide
`light at two different wavelengths. Photodetector 314 can
`detect the portionof suchlight that passes through the user’s
`earlobe, the remaining light having been absorbed by the
`blood within the user’s earlobe. From the relative absorption
`of these two wavelengths of light, the user’s blood oxygen
`content can be calculated. The user’s heart beat also can be
`determined based onthe photodetector signal since the signal
`may bounce in time with the user’s heart beat due to the
`expansion and contraction of artcrial blood vessels. In an
`alternative embodiment, both light source 312 and photode-
`tector 314 can be disposed in eitherclip portion 308a or 3085
`and operate as a reflectance pulse oximeter.
`[0040] Light source 312 can receive signals from and pho-
`todetector 314 can send data signals to a controller that con-
`trols the light source and photadetector and processes signals
`sent thereto or received therefrom. The controller can be
`disposed in earbud 302, in an electronic device from which
`the earbud receives audio signals, and/or in an adapter con-
`figured for coupling to the electronic device.
`[0041]
`Inaccordance with an alternative embodimentofthe
`present invention,electrical contacts (not shown) also can be
`disposed. within clip portion 308a and/or 3084,in addition to
`or instead of light source 312 and photodetector 314. Electri-
`cal contacts can include contacts for detecting, e.g., tempera-
`ture, heat flux, EKG waveforms, heart rate, any other suitable
`physiological metric, or any combination thereof. For
`
`example, to detect EKG waveforms, cach carbud of a headset
`can be equipped withelectrical contacts. The placement of
`the electrical contacts in both the left and right hemispheres of
`the user body andthe resulting distance between electrical
`contacts can permit the present invention to detect greater
`voltage differences, and thus more accurate EKG data. The
`user’s heart rate can be extracted from the EKG waveforms,
`although,
`in some embodiments of the present invention,
`heart rate can be determined without detecting EKG wave-
`forms.
`
`FIG. 4 showsa third illustrative hceadsct having one
`[0042]
`or more integrated physiological sensors and an illustrative
`portable electronic device in accordance with one embodi-
`ment ofthe present invention. Headset 402 can incorporate
`earbud 404, cable 406, audio connector 408, and sensor 410.
`Earbud 404 can be equipped with a speaker and, in some
`embodiments, sensors similar to those described with respect
`to FIGS. 2 and 3A-3B. Cable 406 can electrically and
`mechanically couple earbud 404 and sensor 410 to audio
`connector 408. Sensor 410 can be any one ofthe sensors
`described herein for tracking a user’s physiological metrics.
`For example, sensor 410 can include electrical contacts for
`measuring heart rate or sensors for a reflectance pulse oxime-
`ter.
`
`To promote contact between sensor 410 and the
`[0043]
`user’s skin, the sensor can be partially or fully encased in a
`material that causesit to be removablyattached to the user’s
`skin. For cxample, sensor 410 can be encased in a material
`that is attracted to the ionic charges on the user’s skin.
`[0044]
`Portable electronic device 412 can have housing 414
`within which is disposed display 416, user input component
`418, memory 420, antenna(s) 421, controller 422, sensors
`424, audio connector receptacle 426, and connector 428.
`[0045] User input component 418 can permit a user to
`interact with the electronic device. User input component 418
`caninclude a clickwheel similar to that incorporated in some
`models of iPods™. The clickwheel can include one or more
`buttons and a touchpad. The touchpad can permit a user to
`scroll by running the user’s finger around the track of the
`clickwheel. In alternative embodiments, user input compo-
`nent 418 can include, for example, one or more buttons, a
`touchpad, a touchscreen display, electronics for accepting,
`voice commands, antennas for accepting signals from other
`electronic devices, infrared ports for accepting signals from
`other electronic devices, or any combinationthereof. In one
`embodimentof the present invention, display 416 and user
`input 418 can be integrated into one component by using a
`touchscreen display.
`[0046] Memory 420 can store sensor data generated by
`sensor 410, sensor(s) 424, and/or any other sensor used for
`tracking a user’s performance metrics. Memory 420 can
`include read only memory, random access memory, solid-
`state memory, buffer memory, hard drive memory, any other
`memory knownin the art or otherwise, or any combination
`thereof.
`
`invention,
`In one embodiment of the present
`[0047]
`memory420 also can store mediafiles for playback byelec-
`tronic device 412. Media files can include, for example, audio
`files for playback through speakers (e.g., headset 402) and/or
`graphic imagesfor playback on a display (c.g., display 416).
`The media files can include mediafiles that a user has selected
`to be played back during performanceof an activily Lo enter-
`tain and motivate the user. Such media files can include, for
`
`014
`
`FITBIT, Ex. 1028
`
`014
`
`FITBIT, Ex. 1028
`
`

`

`US 2009/0287067 Al
`
`Nov. 19, 2009
`
`example, songs, audio books, multimedia presentations, still
`images, text, podcasts, videos, etc.
`[0048] Electronic device 412 can have one or more anten-
`nas 421 for wirelessly communicating with a data network
`and/or with one or more accessories(e.g., any ofthe headsets
`described herein). For example, the electronic device can
`include one or more antennas for communication with Blue-
`tooth-enabled devices. WiFi network, cellular network, radio
`network, or any combination thereof. In one embodimentof
`the present invention, antenna(s) 421 can permit a user to
`stream or otherwise download audio and/or visual media to
`entertain and motivate the user during performance of an
`aclivily. For example, the user may chouseto stream internet
`radio or a podcast through a Wili network. Hf electronic
`device 412 is acellular telephone, the user may choose to have
`a telephone conversation with another person by connecting
`to a cellular network.
`[0049] Controller 422 can, for example, control operation
`ofelectronic device 412, generate audio signals for transmis-
`sion to a headset, instruct audio signals to be transmitted to a
`headset, generate control signals for any of the sensors
`described herein, and/or accept data signals from any of the
`sensors described herein. Controller 422 can include one or
`more processors, ASICS, circuits, or any combination
`thereof.
`
`[0050] Display 416 can provide graphics (e.g., text, still
`images, and/or videos) to the user. In one embodimentof the
`present invention, display 416 can provide the user with
`graphics about the user’s performance metrics. Display 416
`also can provide entertainment graphics from media files
`stored in memory 420 or downloadedfrom a data network via
`antenna(s) 421. In one embodimentofthe present invention,
`controller 422 can instruct display 416 to display graphics
`about
`the user’s performance metrics and entertainment
`graphics simultaneously. Advantageously,this permits a user
`to monitor his performance metrics while simultancously be
`entertained during his workout.
`[0051]
`Sensors 424 can incorporate sensors described in
`greater detail with respect to FIGS. 7A-7B and/or other sen-
`sors that can track the user’s performance metrics. In one
`embodiment of the present invention, sensor 424 can be a
`sensorfor tracking a user’s movements. In one embodiment,
`movementsensors can include an accelerometer or GPS chip
`for detecting a user’s movements while walking or jogging.
`[0052] Data from sensors 424 and anyother sensor for
`tracking performance metrics can be transmitted to signal
`processing module 430 ofcontroller 422 for signal process-
`ing. For example, signal processing module 430 can incorpo-
`rate digital circuitry, analog circuitry, and/or software for
`amplifying andfiltering the sensor data.
`[0053] Audio connector receptacle 426 can be configured
`to accept audio connector 408 ofheadset 402. In one embodi-
`ment ofthe present invention, audio connector 408 and recep-
`tacle 426 can transmit control signals to and accept data from
`sensors integrated with headset via a dedicated electrical lead
`in audio connector 408. Alternatively, the control signals and
`sensor data can be interleaved with other signals using, e.g., 4
`serial interface protocol.
`[0054]
`Ina further alternative embodiment,the control sig-
`nals and sensor data can be transmitted through connector
`428, asillustratively describedin greaterdetail with respect to
`FIGS. 5 and 8. In one embodimentof the present invention,
`connector 428 can be a multiple pin connector similar to that
`described in U.S. Patent Application Publication No.
`
`20050240705 to Novotneyct al., published on Oct. 27, 2005,
`the entirety of which is incorporated by reference herein.
`Electronic device 412 can use connector 428 for data com-
`munication witha local server, e.g., the user’s personal com-
`puter.
`In one embodiment of the present invention, con-
`[0055]
`troller 422 can generate audio signals related to the user’s
`performance metrics. These audio signals can be intermixed
`with audio signals [rom entertainment media files stored in
`memory420 or audio signals downloaded bythe user from
`data networks(e.g., the internet or radio broadcast).
`[0056]
`In one embodimentof the present invention, elec-
`tronic device 412 can be an iPod™or an iPhone™. Flectronic
`device 412 also can be anyelectronic device suitable for
`processing signals from sensors that track a user’s perfor-
`mance metrics during physical activity. For example, the
`electronic device can be any portable, mobile, hand-held. or
`miniature consumer electronic device. Illustrative clectronic
`devices can include, but are not limited to, music players,
`video players, still image players, gameplayers, other media
`players, music recorders, video recorders, cameras, other
`media recorders, radios, medical equipment, calculators, cel-
`lular phones, other wireless communication devices, personal
`digital assistants, programmable remote controls, pagers, lap-
`top computers, printers, or any combination thereof. Minia-
`ture electronic devices may have a form factor that is smaller
`than that of hand-held devices. Illustrative miniature clec-
`tronic devices can include, but are not limited to, watches,
`rings, necklaces, bells, accessoriesfor belts, headsets, acces-
`sories for shoes, virtual reality devices, other wearable elec-
`tronics, accessories for sporting equipment, accessories for
`fitness equipment, key chains, or any combination thereof.
`[0057] While electronic device 412 is illustratively shown
`in operation with headset 402 in FIG.4, electronic device 412
`canbe used alone or in combination with any of the accesso-
`ries described herein.
`
`FIG. 5 illustrates an adapter for providing hard-
`[0058]
`wired communication between a headset and an electronic
`device in accordance with one embodiment of the present
`invention. Headset 502 can be similar to any of the headsets
`described herein, e.g., the headsets described with respect to
`FIGS. 2, 3A-3B, and 4. Headset 502 can be coupledto elec-
`tronic device 504 via adapter 506. Adapter 506 can have
`connector 510 configured for electrical and mechanical cou-
`pling to a complementary connectorin electronic device 504
`(e.g., a connector similar to connector 428 of FIG. 4).
`[0059]
`In one embodimentofthe present invention, adapter
`506 can incorporate signal processing, module 508 for pro-
`cessing signals trom sensors integrated with headset 502, in
`contrast to the embodiment of FIG. 4 whichillustratively can
`integrate a similar signal processing module within electronic
`device 412. During operation, a controller within electronic
`device 504 can transmit audio and control signals for headset
`502 via adapter 506. Sensor data also can be transmitted back
`to electronic device 504 via adapter 506, after having been
`conditioned bysignal processing module 508in adapter 506.
`In one embodimentofthe present invention, connector 510
`cantransmit audio and control signals to and accept data from
`sensors integrated with headset via dedicated electrical lead
`(s) in the connector. Alternatively, the audio and control sig-
`nals and sensor data can be interleaved with other signals
`transmitted through connector 510.
`[0060]
`FIGS. 6A-6B illustrate an armband having one or
`more integrated physiological sensors in accordance with one
`
`015
`
`FITBIT, Ex. 1028
`
`015
`
`FITBIT, Ex. 1028
`
`

`

`US 2009/0287067 Al
`
`Nov. 19, 2009
`
`[0067] Electronic device 702 also can have additional elec-
`tronic components similar to those described with respect to
`electronic device 412 of FIG. 4 (e.g., memory, a controller, a
`connector, antennas, and sensors).
`[0068]
`FIG. 7C illustrates an armband for use with the
`portable electronic device of FIGS. 7A-7B in accordance
`with one embodimentofthe present invention. Armband 712
`can have enclosure 714 and strap 716 for securing enclosure
`714 and any clectronic device disposed therein to the user’s
`body. Armband 712 also can have cutout 718 to permit sen-
`sors 710 of electronic device 702 to be disposed closer to or in
`contact with the user’s skin when the armbandis strapped to
`the user.
`
`embodimentof the present invention.Armband 602 can have
`surface of the electronic device, as indicated by the dashed
`
`enclosure 604 within whichaportable electronic device simi- lines. For example, if one or more sensors are IR sensors, the
`lar to, e.g., electronic device 412, can be disposed. To secure
`extemal surface separatingthe sensors from the external envi-
`enclosure 604 (and thus any electronic devi