as) United States
`a2) Patent Application Publication 10) Pub. No.: US 2009/0287067 Al
`
`(43) Pub. Date: Nov. 19, 2009
`Doroguskeretal.
`
`US 20090287067A1
`
`(54)
`
`INTEGRATED SENSORS FOR TRACKING
`PERFORMANCE METRICS
`
`(75)
`
`Inventors:
`
`Jesse Lee Dorogusker, Los Altos,
`CA (US); Anthony Fadell, Portola
`Valley, CA (US); Donald J.
`Novotney, San Jose, CA (US);
`Nicholas R. Kalayjian, San Carlos,
`CA (US)
`
`Correspondence Address:
`KRAMERLEVIN NAFTALIS & FRANKEL LLP
`1177 Avenueof the Americas
`
`New York, NY 10036 (US)
`
`(73) Assignee:
`
`Apple Inc., Cupertino, CA (US)
`
`(21) Appl. No.:
`
`12/507,993
`
`(22)
`
`Filed:
`
`Jul. 23, 2009
`
`Related U.S. Application Data
`
`(62) Division of application No. 11/729,075, filed on Mar.
`27, 2007, now abandoned.
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`AGIB 5/00
`G09G 5/00
`GO6F 17/00
`
`(2006.01)
`(2006.01)
`(2006.01)
`
`(52) US. CMe eccceeccssscssssssseeees 600/300; 345/156; 700/94
`
`(57)
`
`ABSTRACT
`
`Electronic devices and accessories having integrated sensors
`for tracking a user’s performance metrics are provided. In one
`embodiment, the present invention can include a headset
`having integrated physiological sensors. The present inven-
`tion also can include a sling having one or more integrated
`physiological sensors. The sling can secure a portable elec-
`tronic device to a user’s body or clothing. The present inven-
`tion also can include a portable media device having one or
`more integrated physiological sensors. In one embodiment,
`an electronic device of the present invention can accept data
`from multiple sensors, including one or more sensors that
`track a user’s movements. The electronic device can be con-
`
`figured to condition data from physiological sensors using
`data indicative of the user’s movements.
`
`
`
`oy
`
`Oieleaheraeneethanhoneda
`
`—Ck
`
`
`
`202
`
`204
`
`we
`
` >
`
`
`216
`
`001
`
`Apple Inc.
`APL1028
`U.S. Patent No. 8,923,941
`
`Apple Inc.
`APL1028
`U.S. Patent No. 8,923,941
`
`001
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 1 of 10
`
`US 2009/0287067 Al
`
`
`
`FIG. 1A
`PRIOR ART
`
`002
`
`002
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 2 of 10
`
`US 2009/0287067 Al
`
`|
`
`FIG. 1B
`PRIOR ART
`
`003
`
`003
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 3 of 10
`
`US 2009/0287067 Al
`
`SPEAKER
`
`308b FIG. 3B
`
`004
`
`004
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 4 of 10
`
`US 2009/0287067 Al
`
`404
`
`402~_
`
`410
`
`ANTENNA(S)
`421
`
`406
`
`|
`
`ed
`
`M18-NispLAaY.LHps==s==s
`SIGNAL|}4-430
`412
`PRO-
`-
`' CESSING |
`418 USER||‘7777777
`INPUT
`
`
`
`
`
`422
`
`STORAGE
`
`CONTROLLER
`
`SENSOR(S)
`
`
`
`CONNECTOR
`
`428
`
`FIG. 4
`
`005
`
`005
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 5 of 10
`
`US 2009/0287067 Al
`
`510
`
`908-°
`
`1 SIGNAL
`' PROCESSING |
`eer ee - eee
`
`
`
`FIG. 5
`
`006
`
`006
`
`

`

`Patent Application Publication
`
`Nov. 19, 2009 Sheet 6 of 10
`
`US 2009/0287067 Al
`
`
`
`FIG. 6B
`
`007
`
`007
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 7 of 10
`
`US 2009/0287067 Al
`
`702
`
`704
`
`106
`
`708
`
`
`
`008
`
`008
`
`

`

`Patent Application Publication
`
`Nov. 19,2009 Sheet 8 of 10
`
`US 2009/0287067 Al
`
`
`
`FIG. 7C
`
`009
`
`009
`
`

`

`Patent Application Publication
`
`Nov. 19, 2009 Sheet 9 of 10
`
`US 2009/0287067 A1
`
`8Old
`
`ePwenwrawnweme
`
`WHOS7
`
`ONISSIOONd+4-"918
`
`010
`
`010
`
`
`
`

`

`Patent Application Publication
`
`Nov. 19, 2009 Sheet 10 of 10
`
`US 2009/0287067 A1
`
`
`
`YOSNAS‘OISAHd
`
`
`
`LNAWSAOW4835/1
`
`
`
`
`
`YOSNISOISAHd‘CNOD
`
`FIG. 9A
`
`FIG. 9B
`
`FIG. 9C
`
`011
`
`011
`
`
`
`
`

`

`US 2009/0287067 Al
`
`Nov. 19, 2009
`
`INTEGRATED SENSORS FOR TRACKING
`PERFORMANCE METRICS
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] This is relatedto:
`[0002] U.S. Provisional Patent Application No. 60/846,414
`to Gilley et al., filed on Sep. 21, 2006 (referred to herein as
`“the incorporated provisional patent application”),
`the
`entirety of which is incorporated herein by reference;
`[0003] U.S. patent application Ser. No.
`to Gilley et
`al., filed on Mar. 27, 2007, entitled “LIFESTYLE COMPAN-
`ION SYSTEM,” Attorney Docket No. 104677-0019-101/
`P4725US1 (referred to herein as “the incorporated LIF-
`ESTYLE COMPANIONdocument’), the entirety ofwhich is
`incorporated herein by reference;
`to Gilley et
`[0004] U.S. patent application Ser. No.
`al., filed on Mar. 27, 2007, entitled “SYSTEMS AND METH-
`ODS FOR PROVIDING AUDIO AND VISUAL CUESVIA
`
`A PORTABLE ELECTRONIC DEVICE,” Attorney Docket
`No. 104677-0019-102/P4725US2 (referred to herein as “the
`incorporated AUDIO AND VISUAL CUES document’), the
`entirety of which is incorporated herein by reference;
`[0005] U.S. patent application Ser. No.
`to Gilley et
`al.,
`filed on Mar. 27, 2007, entitled “DYNAMICALLY
`ADAPTIVE SCHEDULING SYSTEM,” Attorney Docket
`No. 104677-0019-103/P4725US3(referred to herein as “the
`incorporated ADAPTIVE SCHEDULING SYSTEM docu-
`ment”), the entirety of which is incorporated herein by refer-
`ence;
`to Gilley et
`[0006] U.S. patent application Ser. No.
`al., filed on Mar. 27, 2007, entitled “SYSTEMS AND METH-
`ODS FOR FACILITATING GROUP ACTIVITIES,” Attor-
`ney Docket No. 104677-0019-104/P4725US4 (referred to
`herein as “the incorporated GROUP ACTIVITIES docu-
`ment”), the entirety of which is incorporated herein by refer-
`ence;
`to Gilley et
`[0007] U.S. patent application Ser. No.
`al., filed on Mar. 27, 2007, entitled “VARIABLE I/O INTER-
`FACE FOR PORTABLE MEDIA DEVICE,’ Attorney
`Docket No. 104677-0025-101/P4732US1 (referred to herein
`as “the incorporated VARIABLE I/O document’),
`the
`entirety of which is incorporated herein by reference; and
`[0008] U.S. patent application Ser. No.
`to Gilley et
`al., filed on Mar. 27, 2007, entitled “REWARDS SYSTEMS,”
`Attorney Docket No. 104677-0022-101/P4727US]1 (referred
`to herein as “the incorporated REWARDS SYSTEMSdocu-
`ment”), the entirety of which is incorporated herein by refer-
`ence.
`
`FIELD OF THE INVENTION
`
`[0009] The present invention relates to electronic devices
`and accessories having integrated sensors for tracking a user’s
`performance metrics.
`
`BACKGROUND OF THE INVENTION
`
`[0010] An increasing numberof people are exercising to
`the beat oftheir favorite songs. Often, the songs are stored on
`a portable media player strapped to a user’s arm so that the
`user would not needto carry the portable media player during
`the workout. Audio signals can be transmitted from the por-
`table media playerto the user’s ear using a set ofheadphones.
`
`[0011] During the workout, the user may want to monitor
`his performance metrics, e.g., the distance the user has cov-
`ered during a jog and/or the user’s heart rate. Conventionally,
`this can require the userto attach additionalelectronic devices
`to his body or clothing. For example, to monitor the distance
`a user has jogged, the user may clip a pedometer to his
`clothing. To obtain information aboutthe user’s heart rate, the
`user maystrap a heart rate sensor to his chest and a receiver
`for receiving data from the heart rate sensor to his wrist.
`Disadvantageously, the user can becomevery uncomfortable
`during his fitness routine due to the number of devices the
`user has attached to his body and clothing.
`
`SUMMARY OF THE INVENTION
`
`invention can include systems and
`[0012] The present
`methods for integrating sensors for tracking a user’s perfor-
`mance metricsinto electronic devices and accessories there-
`
`for. In one embodiment of the present invention, the elec-
`tronic devices can include portable media devices similar to
`iPods™sold by Apple Inc. of Cupertino, Calif. or cellular
`telephones similar to iPhones™ designed by Apple Inc.
`[0013]
`In one embodiment,
`the present
`invention can
`include headsets having one or moreintegrated physiological
`sensors. The headsets can be, for example, headphones for
`receiving audio signals from a media device or headsets for
`communication with cellular telephones. The sensor signals
`can be transmitted to a data repository through the same
`communication channel through which audio signals are
`transmitted to the headset (e.g., hard-wired or wireless).
`[0014]
`In one embodiment,
`the present
`invention can
`include a sling having one or more integrated physiological
`sensors. The sling can have an enclosure within which a
`portable electronic device can be disposed. The sling also can
`have a strap for securing the sling and the portable electronic
`device to the user’s body or clothing. In one embodimentof
`the present invention, the sling can have an integrated con-
`nector configured to be operatively coupled to a complemen-
`tary connector in the portable electronic device. The sensor
`signals can be transmitted from the sling to the portable
`electronic device via these connectors. Alternatively, the sen-
`sor signals can be transmitted via wireless communication
`protocols.
`invention can
`the present
`[0015]
`In one embodiment,
`include a portable media device having one or more inte-
`grated physiological sensors. The physiological sensors can
`(1) be exposed through the housing of the portable media
`device, or (2) be hidden from view and undetectable by the
`user. A sling for securing such a portable electronic device to
`the user’s body also is provided by the present invention.
`[0016]
`Inoneembodimentofthe present invention,an elec-
`tronic device can accept data from one or more physiological
`sensors, along with data from one or more othersensors that
`track the user’s movements. The movement sensors can be
`
`disposed within the electronic device itself or attached to or
`incorporated within the user’s body or clothing(e.g., a move-
`ment sensor similar to the sensor from the Nike+iPod Sport
`Kit sold by Apple Inc. and Nike Inc. of Beaverton, Oreg.). The
`electronic device can be configured to conditionthe data from
`the physiological sensors using the data from the movement
`sensors. For example, because the physiological sensor may
`contain anomalies due to the user’s movements, the electronic
`
`012
`
`012
`
`

`

`US 2009/0287067 Al
`
`Nov. 19, 2009
`
`device can identify the anomalies based on data indicative of
`the user’s movements and thereafter removeorfilter out their
`effects.
`
`mation forthe user’s consideration. Typically, receiver 116 is
`configured to be strapped onto a user’s wrist in a manner
`similar to that of a watch.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0017] The above and other advantages of the present
`invention will be apparent upon consideration of the follow-
`ing detailed description, taken in conjunction with accompa-
`nying drawings, in which like reference characters refer to
`like parts throughout, and in which:
`[0018]
`FIG. 1A illustrates a prior art portable media sys-
`tem;
`FIG. 1B illustrates a prior art physiological moni-
`[0019]
`toring system;
`[0020]
`FIG. 2 illustrates an earbud of a headset having one
`or more integrated physiological sensors in accordance with
`one embodimentofthe present invention;
`[0021]
`FIGS. 3A-3B illustrate an alternative earbud of a
`headset having one or more integrated physiological sensors
`in accordance with one embodimentofthe present invention;
`[0022]
`FIG. 4 showsa thirdillustrative headset having one
`or more integrated physiological sensors and an illustrative
`portable electronic device in accordance with one embodi-
`mentof the present invention;
`[0023]
`FIG. 5 illustrates an adapter for providing hard-
`wired communication between a headset and an electronic
`
`device in accordance with one embodiment of the present
`invention;
`[0024]
`FIGS. 6A-6B illustrate an armband having one or
`moreintegrated physiological sensors in accordance with one
`embodimentof the present invention;
`[0025]
`FIGS. 7A-7B illustrate a portable electronic device
`having one or more integrated physiological sensors in accor-
`dance with one embodimentofthe present invention;
`[0026]
`FIG. 7C illustrates an armband for use with the
`portable electronic device of FIGS. 7A-7B in accordance
`with one embodimentof the present invention;
`[0027]
`FIG. 8 illustrates a portable electronic device that
`accepts data from multiple sensors in accordance with one
`embodimentof the present invention; and
`[0028]
`FIGS. 9A-9C illustrate signal conditioning of data
`from a physiological sensor using data indicative of a users
`movements in accordance with one embodiment of the
`
`present invention.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`FIG.1Aillustrates a prior art portable media system
`[0029]
`having portable media device 102, headset 104, and armband
`106. Portable media device 102 can provide audio signals to
`auser via headset 104. The audio signals can be transmitted to
`headset 104 using wires 106. While the useris exercising or
`otherwise does not wish to carry portable media device 102 in
`his hands, the user can strap the portable media device to his
`arm using armband 108.
`[0030]
`FIG. 1B illustrates a prior art physiological moni-
`toring system. A user may use conventional heart rate moni-
`toring system 110 to monitorthe user’s heart rate, e.g., while
`the useris performing an exercise routine. Conventional heart
`rate monitoring system 110 can be equipped with heart rate
`sensor 112, which the user can strap onto the user’s chest
`using chest band 114. Heart rate monitoring system 110 also
`can have receiver 116, which can accept wireless data signals
`transmitted from heart rate sensor 112 and display such infor-
`
`So, ifauser wantsto listen to be entertained, e.g., by
`[0031]
`audio tracks stored on portable media device 102 and simul-
`taneously monitor his performance metrics during a workout,
`the user would needto strap his portable media player ontohis
`arm, a heart rate sensor to his chest, and a receiverto his wrist.
`Unfortunately, due to the numerous electronic devices
`strapped to the user, the user may experience considerable
`discomfort.
`
`invention can include systems and
`[0032] The present
`methods for integrating sensors for tracking a users perfor-
`mance metrics into media devices and accessories therefor,
`thereby reducing or eliminating the need for additional inde-
`pendent monitoring devices. Advantageously, such integra-
`tion of sensors can be desirable because it requires no addi-
`tional effort by the user to use them. As used herein,
`performance metrics can include physiological metrics (e.g.,
`heart rate, EKG, blood oxygen content, temperature, heat
`flux, etc.) and non-physiological indications of performance
`(e.g., distance covered, pace,etc.).
`[0033]
`FIG. 2 illustrates an earbud of a headset having one
`or more integrated physiological sensors in accordance with
`one embodiment of the present invention. Earbud 202 can
`have housing 204 andinternal cavity 206. Internal cavity 206
`can be bisected by internal wall 208 into separate acoustical
`chambers. Speaker 210 can be positioned within internal
`cavity 206 (e.g., mounted onto internal wall 208) so that
`sound waves emanating from the speakerare directed out of
`acoustical aperture 212. Speaker 210 can be coupled to wires
`214that transmit audio signals from an electronic device (not
`shown). Outside earbud 202, wires 214 can be encased in a
`non-conductive material to form cable 216. One embodiment
`
`of the electronic device of the present invention is described
`in greater detail below with respect to FIG.4.
`[0034]
`In one embodimentof the present invention, earbud
`202 also can be equipped with one or more physiological
`sensors 218. For example, sensors 218 can include one or
`moreinfrared photodetectors for tracking the user’s tempera-
`ture, heat flux, and heart rate. From infrared radiation in the
`user’s ear, sensors 218 can detect minute temperature varia-
`tions dueto the user’s heart beats. Heart rate can be calculated
`
`based on the time between beats and the user’s temperature
`can be set as the “DC component” (or average or median
`value) of the detected temperature distribution. Other sensors
`also can be usedfor tracking the same physiological metrics
`or different physiological metrics. In one embodimentof the
`present invention, one sensor 218 can be centered with
`respect to acoustical aperture 212 to ensure that the sensor
`receives a sufficient infrared signal regardless ofhow the user
`positions earbud 202 in the user’s ear. Alternatively, speaker
`210 can be centered with respect to acoustical aperture 212
`and two or more of the same sensors 218 can be positioned
`around the periphery of speaker 210. This can increase the
`likelihoodthat at least one sensor 218 can obtain a sufficient
`infrared signal regardless of how the user positions earbud
`202 in the user’s ear.
`
`Sensors 218 can send data signals to a signal pro-
`[0035]
`cessor. The signal processor can be disposed in earbud 202, in
`an electronic device from which the earbud receives audio
`
`signals, and/or in an adapter configured for coupling to the
`electronic device. Illustrative embodiments of an electronic
`
`device and adapter are described in greater detail herein.
`
`013
`
`013
`
`

`

`US 2009/0287067 Al
`
`Nov. 19, 2009
`
`In accordance with one aspect of the present inven-
`[0036]
`tion, earbud 202 can be incorporated into a wired or wireless
`headset that receives and/or transmits audio signals. For
`example, if the electronic device with which the headset
`communicates is a telephone,
`the headset also can be
`equipped with a microphone. The telephone can be based on
`any oneofthe following networks: public switched telephone
`network (PSTN), cellular, voice over
`internet protocol
`(VoIP), any other telephone network, or any combination
`thereof. Each earbud in the headset can have sensors 218 or
`only one of the earbuds can have sensors 218.
`[0037]
`FIGS. 3A-3B illustrate an alternative earbud of a
`headset having one or more integrated physiological sensors
`in accordance with one embodimentofthe present invention.
`Earbud 302 can have housing 304 with main bodyportion 306
`and clip portions 308a and 3085. Main body portion 306 can
`be equipped with speaker 310 for delivering acoustic signals
`to the user and, in some embodiments, physiological sensors
`similar to sensors 218 ofFIG. 2. When main bodyportion 306
`is disposedin a user’s ear, clip portion 308a can be configured
`to be disposed near or against the front lobe of the user’s
`earlobe, and clip portion 3084 can be configured to be dis-
`posed near or against the back lobe of the user’s earlobe (or
`vice versa). In one embodiment of the present invention, a
`spring force can be providedto bias clip portions 308a and
`308against the user’s earlobe.
`[0038] Light source 312 can be disposed within clip portion
`308a or 3086, and photodetector 314 can be disposed within
`the otherclip portion. Clip portions 308¢@ and 3085 can have
`apertures through whichlight can be transmitted and received
`by light source 312 and photodetector 314, respectively.
`Alternatively, clip portions 308a@ and 3085 can be made at
`least partially of a transmissive material through which the
`light can pass.
`[0039]
`In one embodimentof the present invention, light
`source 312 and photodetector 314 can be used to track a user’s
`blood oxygen content and heart-rate. For example,
`light
`source 312 can include twolight emitting diodes that provide
`light at two different wavelengths. Photodetector 314 can
`detect the portion of such light that passes through the user’s
`earlobe, the remaining light having been absorbed by the
`blood within the user’s earlobe. From the relative absorption
`of these two wavelengths of light, the user’s blood oxygen
`content can be calculated. The user’s heart beat also can be
`determined based on the photodetector signal sincethe signal
`may bouncein time with the user’s heart beat due to the
`expansion and contraction of arterial blood vessels. In an
`alternative embodiment, both light source 312 and photode-
`tector 314 can be disposedin eitherclip portion 308a or 3085
`and operate as a reflectance pulse oximeter.
`[0040] Light source 312 can receive signals from and pho-
`todetector 314 can send data signals to a controller that con-
`trols the light source and photodetector and processes signals
`sent thereto or received therefrom. The controller can be
`disposed in earbud 302, in an electronic device from which
`the earbud receives audio signals, and/or in an adapter con-
`figured for coupling to the electronic device.
`[0041]
`Inaccordance with an alternative embodimentofthe
`present invention, electrical contacts (not shown)also can be
`disposed within clip portion 308a and/or 308d,in addition to
`or instead of light source 312 and photodetector 314. Electri-
`cal contacts can include contacts for detecting, e.g., tempera-
`ture, heat flux, EKG waveforms, heart rate, any other suitable
`physiological metric, or any combination thereof. For
`
`example, to detect EKG waveforms, each earbud of a headset
`can be equipped with electrical contacts. The placement of
`the electrical contacts in both theleft and right hemispheres of
`the user body andthe resulting distance betweenelectrical
`contacts can permit the present invention to detect greater
`voltage differences, and thus more accurate EKG data. The
`user’s heart rate can be extracted from the EKG waveforms,
`although, in some embodiments of the present invention,
`heart rate can be determined without detecting EKG wave-
`forms.
`
`FIG. 4 showsa third illustrative headset having one
`[0042]
`or more integrated physiological sensors and an illustrative
`portable electronic device in accordance with one embodi-
`ment of the present invention. Headset 402 can incorporate
`earbud 404, cable 406, audio connector 408, and sensor 410.
`Earbud 404 can be equipped with a speaker and, in some
`embodiments, sensors similar to those described with respect
`to FIGS. 2 and 3A-3B. Cable 406 can electrically and
`mechanically couple earbud 404 and sensor 410 to audio
`connector 408. Sensor 410 can be any one of the sensors
`described herein for tracking a user’s physiological metrics.
`For example, sensor 410 can include electrical contacts for
`measuring heart rate or sensors for a reflectance pulse oxime-
`ter.
`
`To promote contact between sensor 410 and the
`[0043]
`user’s skin, the sensor can be partially or fully encased in a
`material that causes it to be removably attachedto the user’s
`skin. For example, sensor 410 can be encased in a material
`that is attracted to the ionic charges on the user’s skin.
`[0044]
`Portable electronic device 412 can have housing 414
`within which is disposed display 416, user input component
`418, memory 420, antenna(s) 421, controller 422, sensors
`424, audio connector receptacle 426, and connector 428.
`[0045] User input component 418 can permit a user to
`interact with the electronic device. User input component 418
`can include a clickwheel similar to that incorporated in some
`models of iPods™. The clickwheel can include one or more
`
`buttons and a touchpad. The touchpad can permit a user to
`scroll by running the user’s finger around the track of the
`clickwheel. In alternative embodiments, user input compo-
`nent 418 can include, for example, one or more buttons, a
`touchpad, a touchscreen display, electronics for accepting
`voice commands, antennas for accepting signals from other
`electronic devices, infrared ports for accepting signals from
`other electronic devices, or any combination thereof. In one
`embodimentof the present invention, display 416 and user
`input 418 can be integrated into one component by using a
`touchscreen display.
`[0046] Memory 420 can store sensor data generated by
`sensor 410, sensor(s) 424, and/or any other sensor used for
`tracking a user’s performance metrics. Memory 420 can
`include read only memory, random access memory, solid-
`state memory, buffer memory, hard drive memory, any other
`memory known in the art or otherwise, or any combination
`thereof.
`
`invention,
`In one embodiment of the present
`[0047]
`memory 420 also can store mediafiles for playback by elec-
`tronic device 412. Mediafiles can include, for example, audio
`files for playback through speakers(e.g., headset 402) and/or
`graphic imagesfor playback on a display (e.g., display 416).
`The mediafiles can include mediafiles that a user has selected
`to be played back during performanceofan activity to enter-
`tain and motivate the user. Such mediafiles can include, for
`
`014
`
`014
`
`

`

`US 2009/0287067 Al
`
`Nov. 19, 2009
`
`example, songs, audio books, multimedia presentations, still
`images, text, podcasts, videos, etc.
`[0048] Electronic device 412 can have one or more anten-
`nas 421 for wirelessly communicating with a data network
`and/or with one or more accessories (e.g., any of the headsets
`described herein). For example, the electronic device can
`include one or more antennas for communication with Blue-
`tooth-enabled devices, WiFi network, cellular network, radio
`network, or any combination thereof. In one embodiment of
`the present invention, antenna(s) 421 can permit a user to
`stream or otherwise download audio and/or visual media to
`
`entertain and motivate the user during performance of an
`activity. For example, the user may chooseto stream internet
`radio or a podcast through a WiFi network. If electronic
`device 412 is acellular telephone, the user may choose to have
`a telephone conversation with another person by connecting
`to a cellular network.
`
`[0049] Controller 422 can, for example, control operation
`of electronic device 412, generate audio signals for transmis-
`sion to a headset, instruct audio signals to be transmitted to a
`headset, generate control signals for any of the sensors
`described herein, and/or accept data signals from any of the
`sensors described herein. Controller 422 can include one or
`
`more processors, ASICS, circuits, or any combination
`thereof.
`
`[0050] Display 416 can provide graphics (e.g., text, still
`images, and/or videos) to the user. In one embodimentofthe
`present invention, display 416 can provide the user with
`graphics about the user’s performance metrics. Display 416
`also can provide entertainment graphics from media files
`stored in memory 420 or downloadedfrom a data network via
`antenna(s) 421. In one embodimentofthe present invention,
`controller 422 can instruct display 416 to display graphics
`about
`the user’s performance metrics and entertainment
`graphics simultaneously. Advantageously, this permits a user
`to monitor his performance metrics while simultaneously be
`entertained during his workout.
`[0051]
`Sensors 424 can incorporate sensors described in
`greater detail with respect to FIGS. 7A-7B and/or other sen-
`sors that can track the user’s performance metrics. In one
`embodimentof the present invention, sensor 424 can be a
`sensor for tracking a user’s movements. In one embodiment,
`movement sensors can include an accelerometer or GPS chip
`for detecting a user’s movements while walking or jogging.
`[0052] Data from sensors 424 and any other sensor for
`tracking performance metrics can be transmitted to signal
`processing module 430 of controller 422 for signal process-
`ing. For example, signal processing module 430 can incorpo-
`rate digital circuitry, analog circuitry, and/or software for
`amplifying andfiltering the sensordata.
`[0053] Audio connector receptacle 426 can be configured
`to accept audio connector 408 ofheadset 402. In one embodi-
`mentofthe present invention, audio connector 408 and recep-
`tacle 426 can transmit control signals to and accept data from
`sensors integrated with headset via a dedicated electrical lead
`in audio connector 408. Alternatively, the control signals and
`sensor data can be interleaved with othersignals using,e.g., a
`serial interface protocol.
`[0054]
`Ina further alternative embodiment, the controlsig-
`nals and sensor data can be transmitted through connector
`428,as illustratively described in greaterdetail with respect to
`FIGS. 5 and 8. In one embodimentof the present invention,
`connector 428 can be a multiple pin connector similar to that
`described in U.S. Patent Application Publication No.
`
`20050240705 to Novotneyet al., published on Oct. 27, 2005,
`the entirety of which is incorporated by reference herein.
`Electronic device 412 can use connector 428 for data com-
`munication with a local server, e.g., the user’s personal com-
`puter.
`In one embodimentof the present invention, con-
`[0055]
`troller 422 can generate audio signals related to the user’s
`performance metrics. These audio signals can be intermixed
`with audio signals from entertainment media files stored in
`memory 420 or audio signals downloaded by the user from
`data networks(e.g., the internet or radio broadcast).
`[0056]
`In one embodimentof the present invention, elec-
`tronic device 412 can be an iPod™ or aniPhone™. Electronic
`device 412 also can be any electronic device suitable for
`processing signals from sensors that track a user’s perfor-
`mance metrics during physical activity. For example, the
`electronic device can be any portable, mobile, hand-held, or
`miniature consumerelectronic device. Illustrative electronic
`devices can include, but are not limited to, music players,
`videoplayers, still image players, game players, other media
`players, music recorders, video recorders, cameras, other
`media recorders, radios, medical equipment, calculators, cel-
`lular phones, other wireless communication devices, personal
`digital assistants, programmable remote controls, pagers, lap-
`top computers, printers, or any combination thereof. Minia-
`ture electronic devices may have a form factor that is smaller
`than that of hand-held devices. Illustrative miniature elec-
`tronic devices can include, but are not limited to, watches,
`rings, necklaces, belts, accessories for belts, headsets, acces-
`sories for shoes, virtual reality devices, other wearable elec-
`tronics, accessories for sporting equipment, accessories for
`fitness equipment, key chains, or any combination thereof.
`[0057] While electronic device 412 is illustratively shown
`in operation with headset 402 in FIG.4, electronic device 412
`can be used alone or in combination with any of the accesso-
`ries described herein.
`
`FIG. 5 illustrates an adapter for providing hard-
`[0058]
`wired communication between a headset and an electronic
`
`device in accordance with one embodiment of the present
`invention. Headset 502 can be similar to any of the headsets
`described herein, e.g., the headsets described with respect to
`FIGS. 2, 3A-3B, and 4. Headset 502 can be coupled to elec-
`tronic device 504 via adapter 506. Adapter 506 can have
`connector 510 configured for electrical and mechanical cou-
`pling to a complementary connectorin electronic device 504
`(e.g., a connector similar to connector 428 of FIG.4).
`[0059]
`Inone embodimentofthe present invention, adapter
`506 can incorporate signal processing module 508 for pro-
`cessing signals from sensors integrated with headset 502, in
`contrast to the embodimentof FIG. 4 which illustratively can
`integrate a similar signal processing module within electronic
`device 412. During operation, a controller within electronic
`device 504 can transmit audio and control signals for headset
`502 via adapter 506. Sensor data also can be transmitted back
`to electronic device 504 via adapter 506, after having been
`conditioned by signal processing module 508 in adapter 506.
`In one embodimentof the present invention, connector 510
`can transmit audio and control signals to and accept data from
`sensors integrated with headset via dedicated electrical lead
`(s) in the connector. Alternatively, the audio and control sig-
`nals and sensor data can be interleaved with other signals
`transmitted through connector 510.
`[0060]
`FIGS. 6A-6B illustrate an armband having one or
`more integrated physiological sensors in accordance with one
`
`015
`
`015
`
`

`

`US 2009/0287067 Al
`
`Nov. 19, 2009
`
`embodimentofthe present invention. Armband 602 can have
`enclosure 604 within which a portable electronic device simi-
`lar to, e.g., electronic device 412, can be disposed. To secure
`enclosure 604 (and thus any electronic device disposed
`therein) to a user’s arm, armband 602 can havestrap 606, e.g.,
`an elastic strap with Velcro.
`[0061]
`In one embodimentof the present invention, arm-
`band 602 can be equipped with one or more integrated sensors
`608 for tracking the physiological metrics ofthe user. Sensors
`608 can be integrated into, e.g., a back wall of enclosure 604
`or within strap 606. When armband 602 is strapped onto a
`user’s arm, the sensors can be positioned in close proximity to
`or in contact with the user’s skin.
`
`[0062] One or more sensors 608 can beelectrical contacts
`for tracking, e.g., a user’s EXG waveforms, heart rate, tem-
`perature, and/or heat flux. The electrical contacts can be
`exposed to the external environmentor obtain physiological
`signals through material that is conduciveto electrical and/or
`thermal conduction. For example, one or more sensors 608
`can include electrical contacts similar to those described
`above with respect to FIG.4.
`[0063] One or more sensors 608 also can includean optical
`sensor system for tracking, e.g., the user’s oxygen content,
`heart rate, temperature, and/or heat flux. The optical sensor
`system can transmit and/or receive light through an aperture
`in a wall of the armband or through a light-transmissive
`materi