UYOAAAT AAAAAA
`
`US 20080076972A1
`
`as) United States
`a2) Patent Application Publication 10) Pub. No.: US 2008/0076972 Al
`Doroguskeret al.
`(43) Pub. Date:
`Mar. 27, 2008
`
`(54)
`
`(75)
`
`INTEGRATED SENSORS FOR TRACKING
`PERFORMANCE METRICS
`
`Inventors:
`
`Jesse Lee Dorogusker, Los Altos,
`CA (US); Anthony Fadell, Portola
`Valley, CA (US); Donald J.
`Novotney, San Jose. CA (US);
`Nicholas R. Kalayjian, San
`Carlos, CA (US)
`.
`.
`.
`Cc
`“orrespondence Address:
`ROPES & GRAY LLP
`PATENT DOCKETING39/361
`1211 AVENUE OF THE AMERICAS
`NEW YORK, NY 10036-8704
`
`(73) Assignee:
`
`Apple Inc., Cupertino, CA (US)
`
`(21) Appl. No.:
`
`11/729,075
`
`(22)
`
`Filed:
`
`Mar. 27, 2007
`
`Related U.S. Application Data
`
`(60) Provisional application No. 60/846,414, filed on Sep.
`21, 2006.
`
`Publication Classification
`
`(51)
`
`r
`Int. Cl.
`AGILE 100
`
`006.08)
`
`sue
`/
`(52) U.S. CL oe ne eee eee eee ee eee eee eee eee eeeeee eee eee eeee 600/300
`
`ABSTRACT
`(57)
`Electronic devices and accessories having integrated sensors
`for tracking a user’s performance metrics are provided. In
`one embodiment,the present invention can include a headset
`having integrated physiological sensors. The present inven-
`tion also can include a sling having one or more integrated
`physiological sensors. The sling can secure a portable elec-
`tronic device to a user’s body or clothing. The present
`invention also can include a portable media device having
`one or more integrated physiological
`sensors.
`In one
`embodiment, an electronic device of the present invention
`can accept data from multiple sensors, including one or more
`sensors that track a user’s movements. The electronic device
`can be configured to condition data from physiological
`sensors using data indicative of the user’s movements.
`
`
` Antenna)
`
`
`Ab
`
`42|
`
`423
`
`0001
`
`Apple Inc.
`APL1050
`U.S. Patent No. 8,652,040
`
`Apple Inc.
`APL1050
`U.S. Patent No. 8,652,040
`
`0001
`
`

`

`Patent Application Publication Mar. 27,2008 Sheet 1 of 10
`
`US 2008/0076972 Al
`
` AG.
`
`IA
`(PRioR ART)
`
`\ol
`
`0002
`
`0002
`
`

`

`Patent Application Publication Mar. 27,2008 Sheet 2 of 10
`
`US 2008/0076972 Al
`
`
`
`IR
`AG.
`(PRIOR ARTY
`
`0003
`
`0003
`
`

`

`Patent Application Publication Mar. 27,2008 Sheet 3 of 10
`
`US 2008/0076972 Al
`
`
`AG. 3%
`
`306)
`
`306
`
`304
`
`2080
`
`0004
`
`0004
`
`

`

`Patent Application Publication Mar. 27,2008 Sheet 4 of 10
`
`US 2008/0076972 Al
`
`404
`
`AG. 4
`
`422
`
`424
`
`
`
` 423
`
`0005
`
`0005
`
`

`

`Patent Application Publication Mar. 27,2008 Sheet 5 of 10
`
`US 2008/0076972 Al
`
`510
`
`0006
`
`0006
`
`

`

`Patent Application Publication Mar. 27,2008 Sheet 6 of 10
`
`US 2008/0076972 Al
`
`
`
`0007
`
`0007
`
`

`

`Patent Application Publication Mar. 27,2008 Sheet 7 of 10
`
`US 2008/0076972 Al
`
`AG.72
`
`S>
`
`"0b
`
`104
`
`VoL
`
`—_—
`
`FIG.7A
`
`08
`
`0008
`
`0008
`
`

`

`Patent Application Publication Mar. 27,2008 Sheet 8 of 10
`
`US 2008/0076972 Al
`
`qh
`
`/ =
`
`“lb
`
`ab
`ee
`
`\
`
`118
`
`Fig.
`
`IC
`
`0009
`
`0009
`
`

`

`Patent Application Publication Mar. 27,2008 Sheet 9 of 10
`
`US 2008/0076972 Al
`
`FIG.@
`
`Bol
`
` Wireless
`
` Biz
`
`0010
`
`0010
`
`

`

`Patent Application Publication Mar. 27,2008 Sheet 10 of 10
`
`US 2008/0076972 Al
`
`USer-
`movement
`
`physio.
`Sensor
`
` Cond
`
`0011
`
`0011
`
`

`

`US 2008/0076972 Al
`
`Mar.27, 2008
`
`INTEGRATED SENSORS FOR TRACKING
`PERFORMANCE METRICS
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] This is related to:
`[0002] U.S. Provisional Patent Application No. 60/846,
`414 to Gilleyetal., filed on Sep. 21, 2006 (referred to herein
`as “the incorporated provisional patent application”), the
`entirety of which is incorporated herein by reference:
`[0003] U.S. patent application Ser. No.
`to Gilley et
`al.. filed on Mar. 27, 2007, entitled “LIFESTYLE COM-
`PANION SYSTEM,” Attorney Docket No, 104677-0019-
`101/P4725US1 (referred to herein as “the incorporated
`LIFESTYLE COMPANION document”),
`the entirety of
`which is incorporated herein by reference;
`to Gilley et
`[0004] U.S. patent application Ser. No.
`al.,
`filed on Mar. 27, 2007, entitled “SYSTEMS AND
`METHODS FOR PROVIDING AUDIO AND VISUAL
`CUES VIA A PORTABLE ELECTRONIC DEVICE,”
`Attorney Docket No. 104677-0019-102/P4725US2(referred
`to herein as “the incorporatedAUDIO AND VISUAL CUES
`document”), the entirety of which is incorporated herein by
`reference;
`to Gilley et
`[0005] U.S. patent application Ser. No.
`al..
`filed on Mar. 27, 2007, entitled “DYNAMICALLY
`ADAPTIVE SCHEDULING SYSTEM.” Attorney Docket
`No. 104677-0019-103/P4725US3 (referred to herein as “the
`incorporated ADAPTIVE SCHEDULING SYSTEM docu-
`ment’),
`the entirety of which is incorporated herein by
`reference:
`
`to Gilley et
`[0006] U.S. patent application Ser. No.
`al.
`filed on Mar. 27, 2007, entitled “SYSTEMS AND
`METHODS FOR FACILITATING GROUP ACTIVITIES,”
`Attorney Docket No. 104677-0019-104/P4725US4(referred
`to herein as “the incorporated GROUP ACTIVITIES docu-
`ment”),
`the entirety of which is incorporated herein by
`reference;
`
`to Gilley et
`[0007] U.S. patent application Ser. No.
`al.,
`filed on Mar. 27, 2007, entitled “VARIABLE I/O
`INTERFACE FOR PORTABLE MEDIA DEVICE,” Attor-
`ney Docket No. 104677-0025-101/P4732US1 (referred to
`herein as “the incorporated VARIABLE I/O document”), the
`entirety of which is incorporated herein by reference; and
`
`[0008]
`UL.S. patent application Ser. No.
`to Gilley et
`al..
`filed on Mar. 27, 2007, entitled “REWARDS SYS-
`TEMS,” Attorney Docket No. 104677-0022-101/P4727US1
`(referred to herein as “the incorporated REWARDS SYS-
`TEMS document”),
`the entirety of which is incorporated
`herein by reference.
`
`FIELD OF THE INVENTION
`
`[0009] The present invention relates to electronic devices
`and accessories having integrated sensors for tracking a
`user's performance metrics.
`
`BACKGROUND OF THE INVENTION
`
`[0010] An increasing numberof people are exercising to
`the beat of their favorite songs. Often, the songs are stored
`on a portable media player strapped to a user’s arm sothat
`the user would not need to carry the portable media player
`
`during the workout. Audio signals can be transmitted from
`the portable media player to the user’s ear using a set of
`headphones.
`[0011] During the workout, the user may want to monitor
`his performance metrics, e.g.,
`the distance the user has
`covered during a jog and/or the user's heart rate. Conven-
`tionally, this can require the user to attach additional elec-
`tronic devices to his body or clothing. For example, to
`monitor the distance a user has jogged, the user may clip a
`pedometer to his clothing. To obtain information about the
`user’s heart rate, the user may strap a heart rate sensor tohis
`chest and a receiver for receiving data from the heart rate
`sensorto his wrist. Disadvantageously, the user can become
`very uncomfortable during his fitness routine due to the
`number of devices the user has attached to his body and
`clothing.
`
`SUMMARY OF THE INVENTION
`
`invention can include systems and
`[0012] The present
`methods for integrating sensors for tracking a user's perfor-
`mance metrics into electronic devices and accessories there-
`for, In one embodiment of the present invention, the elec-
`tronic devices can include portable media devices similar to
`iPods™ sold by Apple Inc. of Cupertino, Calif. or cellular
`telephones similar to iPhones™ designed by Apple Inc.
`[0013]
`In one embodiment,
`the present
`invention can
`include headsets having one or more integrated physiologi-
`cal sensors. The headsets can be, for example, headphones
`for receiving audio signals from a media device or headsets
`for communication with cellular telephones. The sensor
`signals can be transmitted to a data repository through the
`same communication channel through which audio signals
`are transmitted to the headset (e.g., hard-wired or wireless).
`[0014]
`In one embodiment,
`the present
`invention can
`include a sling having one or more integrated physiological
`sensors. The sling can have an enclosure within which a
`portable electronic device can be disposed. The sling also
`can have a strap-for securing the sling and the portable
`electronic device to the user’s body or clothing. In one
`embodimentofthe present invention, the sling can have an
`integrated connector configured to be operatively coupled to
`a complementary connector
`in the portable electronic
`device. The sensor signals can be transmitted from the sling
`to the portable electronic device via these connectors. Alter-
`natively, the sensor signals can be transmitted via wireless
`communication protocols.
`invention can
`the present
`[0015]
`In one embodiment,
`include a portable media device having one or more inte-
`grated physiological sensors. The physiological sensors can
`(1) be exposed through the housing ofthe portable media
`device, or (2) be hidden from view and undetectable by the
`user. A sling for securing such a portable electronic device
`to the user’s body also is provided by the present invention.
`[0016]
`In one embodiment ofthe present
`invention, an
`electronic device can accept data from one or more physi-
`ological sensors, along with data from one or more other
`sensors that track the user’s movements. The movement
`sensors can be disposed withinthe electronic device itselfor
`attached to or incorporated within the user’s body or cloth-
`ing (¢.g., a movement sensor similar to the sensor from the
`Nike+ipod Sport Kit sold by Apple Inc. and Nike Inc. of
`Beaverton, Oreg.). The electronic device can be configured
`to condition the data from the physiological sensors using
`the data from the movement sensors. For example, because
`
`0012
`
`0012
`
`

`

`US 2008/0076972 Al
`
`Mar. 27, 2008
`
`the physiological sensor may contain anomalies due to the
`user’s movements, the electronic device can identify the
`anomalies based on data indicative ofthe user’s movements
`and thereafier removeorfilter out their effects.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0017] The above and other advantages of the present
`invention will be apparent upon consideration ofthe fol-
`lowing detailed description,
`taken in conjunction with
`accompanying drawings, in which like reference characters
`refer to like parts throughout, and in which:
`[0018]
`FIG. 1A illustrates a prior art portable media sys-
`tem;
`
`FIG. 1B illustrates a prior art physiological moni-
`[0019]
`toring system;
`[0020]
`FIG. 2 illustrates an earbud ofa headset having one
`or more integrated physiological sensors in accordance with
`one embodiment ofthe present invention;
`[0021]
`FIGS. 3A-3B illustrate an alternative earbud ofa
`headset having one or more integrated physiological sensors
`in accordance with one embodiment ofthe present inven-
`tion:
`FIG. 4 shows a third illustrative headset having one
`[0022]
`or more integrated physiological sensors and an illustrative
`portable electronic device in accordance with one embodi-
`ment ofthe present invention;
`[0023]
`FIG. 5 illustrates an adapter for providing hard-
`wired communication between a headset and an electronic
`
`device in accordance with one embodiment ofthe present
`invention;
`[0024]
`FIGS. 6A-6Billustrate an armband having one or
`more integrated physiological sensors in accordance with
`one embodiment of the present invention;
`[0025]
`FIGS. 7A-7B illustrate a portable electronic device
`having one or more integrated physiological sensors in
`accordance with one embodiment ofthe present invention:
`[0026]
`FIG. 7C illustrates an armband for use with the
`portable electronic device of FIGS. 7A-7B in accordance
`with one embodiment ofthe present invention:
`[0027]
`FIG. 8 illustrates a portable electronic device that
`accepts data from multiple sensors in accordance with one
`embodiment of the present invention; and
`[0028]
`FIGS. 9A-9Cillustrate signal conditioning of data
`from a physiological sensor using data indicative of a user’s
`movements in accordance with one embodiment of the
`present invention.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`FIG. LA illustrates a prior art portable media sys-
`[0029]
`tem having portable media device 102, headset 104, and
`armband 106. Portable media device 102 can provide audio
`signals to a user via headset 104. The audio signals can be
`transmitted to headset 104 using wires 106. While the user
`is exercising or otherwise does not wish to carry portable
`media device 102 in his hands, the user can strap the portable
`media device to his arm using armband 108.
`[0030]
`FIG. 1B illustrates a prior art physiological moni-
`toring system. A user may use conventional heart rate
`monitoring system 110 to monitor the user’s heartrate, e.g..
`while the user is performing an exercise routine. Conven-
`tional heart rate monitoring system 110 can be equipped
`with heart rate sensor 112, whichthe user can strap onto the
`
`user’s chest using chest band 114. Heart rate monitoring
`system 110 also can have receiver 116, which can accept
`wireless data signals transmitted from heart rate sensor 112
`and display such information for the user’s consideration.
`Typically, receiver 116 is configured to be strapped onto a
`user’s wrist in a manner similar to that of a watch.
`
`So, if a user wants to listen to be entertained, e.g.,
`[0031]
`by audio tracks stored on portable media device 102 and
`simultaneously monitor his performance metrics during a
`workout, the user would need to strap his portable media
`player onto his arm, a heart rate sensor to his chest, and a
`receiver to his wrist. Unfortunately, due to the numerous
`electronic devices strapped to the user, the user may expe-
`rience considerable discomfort.
`
`invention can include systems and
`[0032] The present
`methods for integrating sensors for tracking a user’s perfor-
`mance metrics into media devices and accessories therefor,
`thereby reducing or eliminating the need for additional
`independent monitoring devices. Advantageously, suchinte-
`gration of sensors can be desirable because it requires no
`additional effort by the user to use them. As used herein,
`performance metrics can include physiological metrics(e.g.,
`heart rate, EKG, blood oxygen content, temperature, heat
`flux, etc.) and non-physiological indications of performance
`(e.g., distance covered, pace, etc.).
`[0033]
`FIG.2 illustrates an earbud ofa headset having one
`or more integrated physiological sensors in accordance with
`one embodiment of the present invention. Earbud 202 can
`have housing 204 and internal cavity 206. Internal cavity
`206 can be bisected by internal wall 208 into separate
`acoustical chambers, Speaker 210 can be positioned within
`internal cavity 206 (e.g.. mounted onto internal wall 208) so
`that sound waves emanating fromthe speaker are directed
`out of acoustical aperture 212. Speaker 210 can be coupled
`to wires 214 that transmit audio signals from an electronic
`device (not shown). Outside earbud 202, wires 214 can be
`encased in a non-conductive material to form cable 216. One
`embodimentof the electronic device ofthe present invention
`is described in greater detail below with respect to FIG. 4.
`[0034]
`In one embodiment ofthe present invention, ear-
`bud 202 also can be equipped with one or more physiologi-
`cal sensors 218. For example, sensors 218 can include one
`or more infrared photodetectors for tracking the user's
`temperature, heat flux, and heart rate. From infrared radia-
`tion in the user’s ear, sensors 218 can detect minute tem-
`perature variations due to the user's heart beats. Heart rate
`can be calculated based on the time between beats and the
`user’s temperature can be set as the “DC component” (or
`average or median value) of the detected temperature dis-
`tribution. Other sensors also can be used for tracking the
`same physiological metrics or different physiological met-
`rics. In one embodimentofthe presentinvention, one sensor
`218 can be centered with respect to acoustical aperture 212
`to ensure that the sensor receives a suflicient infrared signal
`regardless of how the user positions earbud 202 in the user’s
`ear. Alternatively, speaker 210 can be centered with respect
`to acoustical aperture 212 and two or more of the same
`sensors 218 can be positioned around the periphery of
`speaker 210. This canincreasethelikelihoodthat at least one
`sensor 218 can obtain a sufficient infrared signal regardless
`of how the user positions earbud 202 in the user’s ear.
`[0035]
`Sensors 218 can send data signals to a signal
`processor. The signal processor can be disposed in earbud
`202. in an electronic device from which the earbud receives
`
`0013
`
`0013
`
`

`

`US 2008/0076972 Al
`
`Mar. 27, 2008
`
`audio signals, and/or in an adapter configured for coupling
`to the electronic device. Illustrative embodiments of an
`
`electronic device and adapter are described in greater detail
`herein.
`
`In accordance with one aspect ofthe present inven-
`[0036]
`tion, earbud 202 can be incorporated into a wired or wireless
`headset
`that receives and/or transmits audio signals. For
`example, if the electronic device with which the headset
`communicates is a telephone,
`the headset also can be
`equipped with a microphone. The telephone canbe based on
`any one of the following networks: public switched tele-
`phone network (PSTN), cellular, voice over internet proto-
`col (VoIP), any other telephone network, or any combination
`thereof. Each earbud in the headset can have sensors 218 or
`
`only one of the earbuds can have sensors 218.
`[0037]
`FIGS, 3A-3B illustrate an alternative earbud ofa
`headset having one or more integrated physiological sensors
`in accordance with one embodiment of the present inven-
`tion. Earbud 302 can have housing 304 with main body
`portion 306 and clip portions 308a@ and 3085. Main body
`portion 306 can be equipped with speaker 310 for delivering
`acoustic signals to the user and,
`in some embodiments,
`physiological sensors similar to sensors 218 of FIG. 2. When
`main body portion 306 is disposed in a user’s ear, clip
`portion 308a can be configured to be disposed near or
`against the front lobe of the user’s earlobe, and clip portion
`3086 can be configured to be disposed near or against the
`back lobe of the user’s earlobe (or vice versa).
`In one
`embodiment of the present invention, a spring force can be
`provided to bias clip portions 308a@ and 3084 against the
`user’s earlobe.
`
`[0038] Light source 312 can be disposed within clip
`portion 308¢ or 3084, and photodetector 314 can be dis-
`posed within the other clip portion. Clip portions 308@ and
`3086 can have apertures through which light can be trans-
`mitted and received by light source 312 and photodetector
`314, respectively. Alternatively, clip portions 308¢ and 3085
`can be made at least partially of a transmissive material
`through whichthe light can pass.
`[0039]
`In one embodiment ofthe present invention, light
`source 312 and photodetector 314 can be used to track a
`user’s blood oxygen content and heart-rate. For example,
`light source 312 can include twolight emitting diodes that
`provide light at
`two different wavelengths. Photodetector
`314 can detect the portion of such light that passes through
`the user’s earlobe, the remaining light having been absorbed
`by the blood within the user’s earlobe. From the relative
`absorption of these two wavelengths oflight, the user's
`blood oxygen content can be calculated. The user’s heart
`beat also can be determined based on the photodetector
`signal since the signal may bounce in time with the user’s
`heart beat due to the expansion and contraction ofarterial
`blood vessels.
`In an alternative embodiment, both light
`source 312 and photodetector 314 can be disposed in either
`clip portion 308a or 3084 and operateas a reflectance pulse
`oximeter.
`
`[0040] Light source 312 can receive signals from and
`photodetector 314 can send data signals to a controller that
`controls the light source and photodetector and processes
`signals sent thereto or received therefrom, The controller can
`be disposed in earbud 302,
`in an electronic device from
`which the earbud receives audio signals, and/or in an adapter
`configured for coupling to the electronic device.
`
`In accordance with an alternative embodiment of
`[0041]
`the present invention, electrical contacts (not shown) also
`can be disposed within clip portion 308@ and/or 3084,
`in
`addition to or instead of light source 312 and photodetector
`314. Electrical contacts can include contacts for detecting,
`€.g.,
`temperature, heat flux, EKG waveformis, heart rate, any
`other suitable physiological metric, or any combination
`thereof. For example,
`to detect EKG waveforms, each
`earbud of a headset can be equipped withelectrical contacts.
`The placement ofthe electrical contacts in both the left and
`right hemispheres ofthe user body and the resulting distance
`between electrical contacts can permit the present invention
`to detect greater voltage differences, and thus more accurate
`EKG data. The user’s heart rate can be extracted from the
`
`in some embodiments of the
`EKG waveforms, although,
`present
`invention, heart rate can be determined without
`detecting EXG waveforms.
`[0042]
`FIG. 4 showsa third illustrative headset having one
`or more integrated physiological sensors and an illustrative
`portable electronic device in accordance with one embodi-
`ment of the present invention. Headset 402 can incorporate
`earbud 404, cable 406, audio connector 408, and sensor 410,
`Earbud 404 can be equipped with a speaker and,
`in some
`embodiments,
`sensors similar
`to those described with
`respect to FIGS. 2 and 3A-3B. Cable 406 can electrically
`and mechanically couple earbud 404 and sensor 410 to audio
`connector 408. Sensor 410 can be any one of the sensors
`described herein for tracking a user’s physiological metrics.
`For example, sensor 410 can include electrical contacts for
`measuring heart rate or sensors for a reflectance pulse
`oximeter.
`
`[0043] To promote contact between sensor 410 and the
`user’s skin, the sensor can be partially or fully encased in a
`material that causes it to be removably attachedto the user’s
`skin. For example, sensor 410 can be encased in a material
`that is attracted to the tonic charges on the user’s skin.
`[0044]
`Portable electronic device 412 can have housing
`414 within which is disposed display 416, user input com-
`ponent 418, memory 420, antenna(s) 421, controller 422,
`sensors 424, audio connector receptacle 426, and connector
`428.
`
`[0045] User input component 418 can permit a user to
`interact with the electronic device. User input component
`418 can include a clickwheel similar to that incorporated in
`some models of iPods™. The clickwheel can include one or
`
`more buttons and a touchpad. The touchpad can permit a
`user to scroll by running the user’s finger around the track
`of the clickwheel. In alternative embodiments, user input
`component 418 can include,
`for example, one or more
`buttons, a touchpad, a touchscreen display, electronics for
`accepting voice commands, antennas for accepting signals
`from other electronic devices, infrared ports for accepting
`signals from other electronic devices, or any combination
`thereof. In one embodimentof the present invention, display
`416 and user input 418 canbeintegrated into one component
`by using a touchscreendisplay.
`[0046] Memory 420 can store sensor data generated by
`sensor 410, sensor(s) 424, and/or any other sensor used for
`tracking a user’s performance metrics. Memory 420 can
`include read only memory, random access memory, solid-
`state memory, buffer memory, hard drive memory, any other
`memory knownin the art or otherwise, or any combination
`thereof.
`
`0014
`
`0014
`
`

`

`US 2008/0076972 Al
`
`Mar. 27, 2008
`
`invention,
`In one embodiment of the present
`[0047]
`memory 420 also can store media files for playback by
`electronic device 412. Media files can include, for example,
`audiofiles for playback through speakers (e.g., headset 402)
`and/or graphic images for playback on a display (e.g..
`display 416). The mediafiles can include mediafiles that a
`user has selected to be played back during performance of an
`activity to entertain and motivate the user. Such media files
`can include, for example, songs, audio books, multimedia
`presentations, still images, text, podcasts, videos, etc.
`[0048] Electronic device 412 can have one or more anten-
`nas 421 for wirelessly communicating with a data network
`and/or with one or more accessories (e.g., any of the
`headsets described herein). For example.
`the electronic
`device caninclude one or more antennas for communication
`with Bluetooth-enabled devices, WiFi network,cellular net-
`work, radio network, or any combination thereof. In one
`embodiment of the present invention, antenna(s) 421 can
`permit a user to stream or otherwise download audio and/or
`visual media to entertain and motivate the user during
`performance of an activity. For example,
`the user may
`choose to stream internet radio or a podcast through a WiFi
`network. If electronic device 412 is a cellular telephone, the
`user may choose to have a telephone conversation with
`another person by connecting to a cellular network.
`[0049] Controller 422 can, for example, control operation
`of electronic device 412, generate audio signals for trans-
`missionto a headset, instruct audio signals to be transmitted
`to a headset, generate control signals for any of the sensors
`described herein, and/or accept data signals from any ofthe
`sensors described herein. Controller 422 can include one or
`
`more processors, ASICs, circuits, or any combination
`thereof.
`
`[0050] Display 416 can provide graphics (e.g., text, still
`images, and/or videos) to the user. In one embodimentofthe
`present
`invention, display 416 can provide the user with
`graphics about the user’s performance metrics. Display 416
`also can provide entertainment graphics from media files
`stored in memory 420 or downloaded from a data network
`via antenna(s) 421.
`In one embodiment of the present
`invention, controller 422 can instruct display 416 to display
`graphics about the user’s performance metrics and enter-
`tainment graphics simultaneously. Advantageously, this per-
`mits a user to monitor his performance metrics while simul-
`taneously be entertained during his workout.
`[0051]
`Sensors 424 can incorporate sensors described in
`greater detail with respect to FIGS. 7A-7B and/or other
`sensors that can track the user’s performance metrics. In one
`embodiment ofthe present invention, sensor 424 can be a
`sensor for tracking a user’s movements. In one embodiment,
`movement sensors can include an accelerometer or GPS
`chip for detecting a user’s movements while walking or
`jogging.
`[0052] Data from sensors 424 and any other sensor for
`tracking performance metrics can be transmitted to signal
`processing module 430 of controller 422 for signal process-
`ing. For example, signal processing module 430 can incor-
`porate digital circuitry, analog circuitry, and/or software for
`amplifying and filtering the sensor data.
`[0053] Audio connector receptacle 426 can be configured
`to accept audio connector 408 of headset 402.
`In one
`embodiment of the present invention, audio connector 408
`and receptacle 426 can transmit control signals to and accept
`data from sensors integrated with headset via a dedicated
`
`lead in audio connector 408. Alternatively, the
`electrical
`control signals and sensor data can be interleaved with other
`signals using, e.g.. a serial interface protocol.
`[0054]
`In a further alternative embodiment, the control
`signals and sensor data can be transmitted through connector
`428, as illustratively described in greater detail with respect
`to FIGS. 5 and 8.
`In one embodiment of the present
`invention, connector 428 can be a multiple pin connector
`similar to that described in U.S. Patent Application Publi-
`cation No. 20050240705 to Novotney et al., published on
`Oct. 27, 2005,
`the entirety of which is incorporated by
`reference herein. Electronic device 412 can use connector
`428 for data communication with a local server, e.g., the
`user’s personal computer.
`[0055]
`In one embodiment ofthe present invention, con-
`troller 422 can generate audio signals related to the user’s
`performance metrics. These audio signals can be intermixed
`with audio signals from entertainment media files stored in
`memory 420 or audio signals downloaded by the user from
`data networks (e.g., the internet or radio broadcast).
`[0056]
`In one embodimentof the present invention, elec-
`tronic device 412 can be an iPod™ or an iPhone™., Elec-
`tronic device 412 also can be any electronic device suitable
`for processing signals from sensors that
`track a user’s
`performance metrics during physical activity. For example,
`the electronic device can be any portable, mobile, hand-held,
`or miniature consumer electronic device. Illustrative elec-
`tronic devices can include, but are not limited to, music
`players, video players, still
`image players, game players,
`other media players, music recorders, video recorders, cam-
`eras, other media recorders,
`radios, medical equipment,
`calculators, cellular phones, other wireless communication
`devices, personal digital assistants, programmable remote
`controls, pagers. laptop computers, printers, or any combi-
`nation thereof. Miniature electronic devices may have a
`form factor that is smaller than that of hand-held devices.
`Illustrative miniature electronic devices can include, but are
`not limited to, watches, rings, necklaces, belts, accessories
`for belts, headsets, accessories for shoes, virtual
`reality
`devices, other wearable electronics, accessories for sporting
`equipment, accessories forfitness equipment, key chains, or
`any combination thereof.
`[0057] While electronic device 412 is illustratively shown
`in operation with headset 402 in FIG. 4, electronic device
`412 can be used alone or in combination with any of the
`accessories described herein.
`
`FIG. 5 illustrates-an adapter for providing hard-
`[0058]
`wired communication between a headset and an electronic
`device in accordance with one embodiment of the present
`invention. Headset 502 can be similar to any ofthe headsets
`described herein, e.g., the headsets described with respect to
`FIGS. 2, 3A-3B, and 4. Headset 502 can be coupled to
`electronic device 504 via adapter 506. Adapter 506 can have
`connector 510 configured for electrical and mechanical
`coupling to a complementary connector in electronic device
`504 (e.g., a connector similar to connector 428 of FIG. 4).
`[0059]
`In one embodiment of the present
`invention,
`adapter 506 can incorporate signal processing module 508
`for processing signals from sensors integrated with headset
`502, in contrast to the embodiment of FIG. 4 which illus-
`tratively can integrate a similar signal processing module
`within electronic device 412. During operation, a controller
`within electronic device 504 can transmit audio and control
`
`signals for headset 502 via adapter 506. Sensor data also can
`
`0015
`
`0015
`
`

`

`US 2008/0076972 Al
`
`Mar. 27, 2008
`
`be transmitted back to electronic device 504 via adapter 506,
`after having been conditioned by signal processing module
`508 in adapter 506.
`In one embodiment of the present
`invention, connector 510 can transmit audio and control
`signals to and accept data from sensors integrated with
`headset via dedicated electrical
`lead(s) in the connector.
`Alternatively, the audio and control signals and sensor data
`can be interleaved with other signals transmitted through
`connector 510.
`
`FIGS, 6A-6B illustrate an armband having one or
`[0060]
`more integrated physiological sensors in accordance with
`one embodimentof the present invention.Armband 602 can
`have enclosure 604 within which a portable electronic
`device similar to, e.g., electronic device 412, can be dis-
`posed. To secure enclosure 604 (and thus any electronic
`device disposed therein) to a user’s arm, armband 602 can
`have strap 606, e.g., an elastic strap with Velcro.
`[0061]
`In one embodiment ofthe present invention, arm-
`band 602 can be equipped with one or more integrated
`sensors 608 for tracking the physiological metrics of the
`user. Sensors 608 can be integrated into, e.g., a back wall of
`enclosure 604 or within strap 606. When armband 602 is
`strapped onto a user’s arm, the sensors can be positioned in
`close proximity to or in contact with the user’s skin.
`[0062] One or more sensors 608 can be electrical contacts
`for tracking, e.g., a user’s EKG waveforms, heart
`rate,
`temperature, and/or heat flux. The electrical contacts can be
`exposed to the external environment or obtain physiological
`signals through material
`that
`is conducive to electrical
`and/or thermal conduction, For example, one or more sen-
`sors 608 can include electrical contacts similar to those
`
`described above with respect to FIG. 4.
`[0063] One or more sensors 608 also can include an
`optical sensor system for tracking, e.g., the user’s oxygen
`content, heart rate, temperature, and/or heat flux. The optical
`sensor system can transmit and/or receive light through an
`aperture in a wall of the armband or
`through a light-
`transmissive material. For example, one or more sensors 608
`can include a light source and photodetector similar to those
`described above with respect to FIGS. 3.A-3B, or an infrared
`photodetector similar to that described above with respect to
`FIG, 2.
`
`To transmit sensor data to