I 1111111111111111 11111 1111111111 11111 1111111111 11111 111111111111111 IIII IIII
`US007873849B2
`
`02) United States Patent
`Mucignat et al.
`
`(IO) Patent No.:
`(45) Date of Patent:
`
`US 7,873,849 B2
`Jan. 18, 2011
`
`(54) MOTION SENSOR DATA PROCESSING
`USING VARIOUS POWER MANAGEMENT
`MODES
`
`(75)
`
`Inventors: Andrea Mucignat, Burlingame, CA
`(US); Saurabh Gupta, Sunnyvale, CA
`(US)
`
`(73) Assignee: Apple Inc., Cupertino, CA (US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by O days.
`
`(21) Appl. No.: 12/552,385
`
`(22) Filed:
`
`Sep.2,2009
`
`(65)
`
`Prior Publication Data
`
`US 2010/0235667 Al
`
`Sep. 16, 2010
`
`Int.CJ.
`G06F 1126
`(2006.01)
`G06F 1132
`(2006.01)
`G01P 15/00
`(2006.01)
`U.S. CJ .
`....................... 713/323; 713/300; 713/320;
`713/324; 702/1 41
`Field of Classification Search .......... ....... 713/300,
`713/ 320, 323, 324; 702/1 41
`See application file for complete search history.
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`(52)
`
`(58)
`
`(56)
`
`5;)53,677 A
`6,665,802 Bl *
`7,145,454 82
`7,382,353 8 2 *
`7,408,506 82
`
`9/ 1999 Sato
`12/2003 Ober .......................... 7 13/320
`12/2006 Linjama et al.
`6/2008 Grady et al
`8/2008 Miller
`
`. 345/156
`
`2004/0181703 Al
`9/2004 Lilja et al.
`7/2005 Linjama et al. . .... , ...... 455/41.2
`2005/0164633 Al *
`2006/0161377 Al*
`7/2006 Rak.kola et al. ............. 702/141
`10/2006 Lee ............................ 713/300
`2006/0242434 Al *
`20071007 5965 Al
`4/2007 Huppi et al.
`2008/0008313 Al *
`1/2008 Fyke ..................... 379/433.01
`l 0/2008 Leooe et al. . ............... 340/669
`2008/0266128 Al *
`2009/0096586 Al *
`4/2009 Tubb ....................... 340/1 0.33
`12/2009 Ka.bn et al .
`2009/0319221 Al*
`................. 702/141
`2010/0013778 Al*
`1/2010 Liu et al. .................... 345/1 73
`FOREJGN PATENT DOCUMENTS
`
`EP
`1736850 Al
`EP
`1785808 Al
`WO
`2006070272 A2
`* cited by examiner
`
`12/2006
`5/2007
`7/2006
`
`Primary Examiner- Vincent T Tran
`(74) Attorney, Agent, or Firm- Kramer Levin Naftalis &
`Frankel LLP
`
`(57)
`
`ABSTRACT
`
`Systems and methods for processing motion sensor data
`using various power management modes of an electronic
`device are provided. Power may be provided to a motion
`sensor during a first power mode of the device. In response to
`the motion sensor detecting a motion event with a magnitude
`exceeding a threshold, the sensor may transmit a wake up
`signal to a power management unit of the device. In response
`to receiving the wake up signal, the power management unit
`may switch the device to a second power mode. Tue device
`may provide power to a processor and load the processor with
`a motion sensing application when switching to the second
`power mode. During the second power mode, motion sensor
`data may be processed to determine that the motion event is
`not associated with an intentional user input and the device
`may return to the first power mode.
`
`26 Claims, 7 Drawing Sheets
`
`BATTERY
`
`120
`
`108
`
`119
`
`118
`117
`~--+----1 POWER MANAGEMENT UNIT 1 - - -~~
`
`133
`
`143
`
`141
`
`135
`
`145
`
`131
`
`102
`
`- - --1PROCESSOR
`
`151
`
`100
`
`137
`
`111
`
`155
`
`Petitioner Samsung Ex-1019, 0001
`
`

`

`U.S. Patent
`
`Jan. 18, 2011
`
`Sheet 1 of 7
`
`US 7,873,849 B2
`
`103
`
`ELECTRONIC DEVICE
`,--,-102
`
`PROCESSOR
`
`101
`
`104
`
`106
`
`108
`
`110
`
`112
`
`MEMORY
`
`COMMUNICATIONS
`CIRCUITRY
`
`POWER
`SUPPLY
`
`INPUT/OUTPUT
`CIRCUITRY
`
`MOTION SENSOR
`
`100
`FIG. 1
`
`Petitioner Samsung Ex-1019, 0002
`
`

`

`U.S. Patent
`
`Jan.18,2011
`
`Sheet 2 of 7
`
`US 7,873,849 B2
`
`BATTERY
`
`120
`
`108
`
`119
`
`118
`117
`- - - - - - -1 - - - - - - - - -1 POWER MANA GEM ENT UN IT i - - - -+ - -~
`
`133
`
`143
`
`MEMORY
`
`104
`
`131
`
`102
`
`141
`
`135
`
`153
`
`137
`
`147
`
`145
`
`110
`
`MOTION
`SENSOR
`
`112 113
`
`- - - - - - -1 p R OC ES SOR t------'-----t IN PUT /0 UTP UT
`CIRCUITRY
`109
`
`151
`
`100
`
`FIG. 2
`
`111
`
`155
`
`Petitioner Samsung Ex-1019, 0003
`
`

`

`U.S. Patent
`
`Jan. 18, 2011
`
`Sheet 3 of 7
`
`US 7,873,849 B2
`
`OPERATE IN A
`FIRST POWER MODE
`(E.G., A HIGH ACTIVE POWER MODE)
`
`302
`
`SENSOR D
`DISPLAY CO
`ITHINTHE P
`OFTIME'X'
`
`SWITCH FROM THE FIRST POWER MODE
`TO A SECOND POWER MODE
`(E.G., A LOW ACTIVE POWER MODE)
`
`308
`
`300
`
`FIG. 3A
`
`310
`
`SWITCH FROM THE
`FIRST POWER MODE
`TO A THIRD POWER MODE
`(E.G., A SLEEP POWER MODE)
`
`Petitioner Samsung Ex-1019, 0004
`
`

`

`U.S. Patent
`
`Jan. 18, 2011
`
`Sheet 4 of 7
`
`US 7,873,849 B2
`
`OPERATE IN A
`SECOND POWER MODE
`(E.G., A LOW ACTIVE POWER MODE)
`
`312
`
`YES 322
`
`ANALYZE THE NEW
`MOTION SENSOR DATA
`
`NO
`
`316
`
`YES
`
`300
`
`FIG. 3B
`
`SWITCH FROM THE
`SECOND POWER MODE
`TO A THIRD POWER MODE
`(E.G., A SLEEP POWER MODE)
`
`SWITCH FROM THE
`SECOND POWER MODE
`TO A FIRST POWER MODE
`(E.G., A HIGH ACTIVE POWER MODE)
`
`320
`
`Petitioner Samsung Ex-1019, 0005
`
`

`

`U.S. Patent
`
`Jan. 18, 2011
`
`Sheet S of 7
`
`US 7,873,849 B2
`
`OPERATE INA
`THIRD POWER MODE
`(E.G .. A SLEEP POWER MODE)
`
`326
`
`SWITCH FROM THE THIRD POWER MODE
`TO A SECOND POWER MODE
`(E.G., A LOW ACTIVE POWER MODE)
`
`SWITCH FROM THE THIRD POWER MODE
`TO A FOURTH POWER MODE
`(E.G., A HIBERNATE POWER MODE)
`
`FIG. 3C
`
`Petitioner Samsung Ex-1019, 0006
`
`

`

`U.S. Patent
`
`Jan. 18, 2011
`
`Sheet 6 of 7
`
`US 7,873,849 B2
`
`336
`
`OPERATE INA
`FOURTH POWER MODE
`(E.G., A HIBERNATE POWER MODE)
`
`HASA
`MOTION EVENT EXCEEDING A
`MAGNITUDE THRESHOLD "M" BEEN
`DETECTED BY THE MOTION
`SENSOR?
`YES
`
`340
`
`NO
`
`SWITCH FROM THE FOURTH POWER MODE
`TOA SECOND POWER MODE
`(E.G., A LOW ACTIVE POWER MODE)
`
`300
`
`FIG. 3D
`
`Petitioner Samsung Ex-1019, 0007
`
`

`

`U.S. Patent
`
`Jan. 18, 2011
`
`Sheet 7 of 7
`
`US 7,873,849 B2
`
`OPERATE IN A
`FIRST POWER MODE
`(E.G., AN ACTIVE POWER MODE)
`
`402
`
`SWITCH FROM THE SECOND POWER MODE
`TOAFIRST POWER MODE
`(E.G., AN ACTIVE POWER MODE)
`
`410
`
`412
`
`OPERATE IN A FIRST
`POWER MODE
`(E.G., AN ACTIVE POWER MODE)
`FOR A DURATION OF TIME "N"
`
`SWITCH FROM THE FIRST
`POWER MODE TO A SECOND
`POWER MODE
`(E.G., AN INACTIVE POWER MODE)
`408
`
`OPERATE IN A SECOND
`POWER MODE
`(E.G., AN INACTIVE POWER MODE)
`FOR A DURATION OF TIME "F'
`
`RESPOND TO EACH OF TI-IE MOTION
`EVENTS DETECTED DURING TIME "N'
`AND RESPOND TO EACH OF THE MOTION
`EVENTS ASSUMED TO HAVE OCCURRED
`DURING TIME 'P
`
`100
`FIG. 4
`
`Petitioner Samsung Ex-1019, 0008
`
`

`

`US 7,873,849 B2
`
`1
`MOTION SENSOR DATA PROCESSING
`USING VARIOUS POWER MANAGEMENT
`MODES
`
`FIELD OF THE INVENTION
`
`This can relate to systems and methods for processing
`motion sensor data and, more particularly, to systems and
`methods for processing motion sensor data using various
`power management modes of an electronic device.
`
`BACKGROUND OF THE DISCLOSURE
`
`5
`
`2
`data identifies a first motion event occurring a first number of
`times during the first duration of time at a first rate. Then, the
`method may include returning from the first inactive power
`mode to the first active power mode after a second duration of
`time. Next, the method may include processing second
`motion sensor data for a third duration of time and determin(cid:173)
`ing that the second processed motion sensor data identifies
`the first motion event occurring a second number of times
`during the third duration of time at the first rate. Finally, the
`10 method may include responding to a third number of the first
`motion event. The third number may equal the second number
`plus the product of the second duration of time and the rate.
`For example, the second duration of time may be longer
`than the third duration of time. In some embodiments, the first
`15 motion event may be a user stepping event and the method
`may include storing the third number in a counter indicative
`of the amount of steps taken by a user of the device. In some
`embodiments, the switching from the first active power mode
`to the first inactive power mode may include unloading a
`20 motion sensing application from a processor of the device and
`deactivating at least a portion of the processor.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`Electronic devices, and in particular portable electronic
`devices ( e.g., portable media players and cellular telephones),
`often include one or more sensors for detecting characteris(cid:173)
`tics of the device and its surroundings. For example, an elec(cid:173)
`tronic device may include one or more motion sensors, such
`as an accelerometer or gyroscope, for detecting the orienta(cid:173)
`tion and/or movement of the device. The electronic device
`may process the data generated by the motion sensors and
`may be operative to perform particular operations based on
`the processed motion sensor data. For example, an electronic
`device may process motion sensor data to determine the num-
`ber of steps taken by a user carrying the device, thereby 25
`providing a pedometer application. This type of pedometer
`application may be utilized by the device over a long period of
`time in order to detect every step taken by a user, even when
`the user may not be actively interacting with the device.
`However, keeping certain device components active during 30
`utilization of such a pedometer application may consume a
`significant amount of the power available to the device.
`
`The above and other aspects of the invention, its nature, and
`various features will become more apparent upon consider(cid:173)
`ation of the following detailed description, taken in conjunc(cid:173)
`tion with the accompanying drawings, in which like reference
`characters refer to like parts throughout, and in which:
`FIGS. 1 and 2 are schematic views of an illustrative elec(cid:173)
`tronic device in accordance with some embodiments of the
`invention;
`FIGS. 3A-3D are a flowchart of an illustrative process for
`processing motion sensor data using various power manage-
`35 ment modes in accordance with some embodiments of the
`invention; and
`FIG. 4 is a flowchart of an other illustrative process for
`processing motion sensor data using various power manage(cid:173)
`ment modes in accordance with some embodiments of the
`40 invention.
`
`SUMMARY OF THE DISCLOSURE
`
`Systems, methods, and computer-readable media for pro(cid:173)
`cessing motion sensor data using various power management
`modes of an electronic device are provided.
`For example, in some embodiments, there is provided a
`method for controlling power consumption of an electronic
`device. The method may include providing power to a motion
`sensor of the device during a first inactive power mode of the
`device. Next, the method may include switching from the first
`inactive power mode to a first active power mode of the device
`in response to detecting a magnitude of a motion event that 45
`exceeds a threshold using the motion sensor.After the switch(cid:173)
`ing, the method may include returning from the first active
`power mode to the first inactive power mode in response to
`determining that the motion event is not associated with an
`intentional user input.
`For example, the switching may include activating at least
`a portion of a processor of the device and loading the proces-
`sor with a motion sensing application. The switching may
`also include instructing the processor to bypass a device
`component activation step of the application, such as a device 55
`component activation step that instructs the processor to at
`least partially activate a display output component of the
`device. The returning may include unloading the motion
`sensing application from the processor and deactivating at
`least a portion of the processor.
`In other embodiments, there is provided a method for con(cid:173)
`trolling power consumption of an electronic device. The
`method may include processing first motion sensor data for a
`first duration of time during a first active power mode of the
`device. Next, the method may include switching from the first 65
`active power mode to a first inactive power mode of the device
`in response to detecting that the first processed motion sensor
`
`DETAILED DESCRIPTION OF THE
`DISCLOSURE
`
`Systems, methods, and computer-readable media for pro(cid:173)
`cessing motion sensor data using various power management
`modes of an electronic device are provided and described
`with reference to FIGS. 1-4.
`An electronic device may be operative to receive motion
`50 sensor data generated by a motion sensor and the motion
`sensor data may be used to control a function of the electronic
`device. For example, a user of the device may perform a
`certain motion event ( e.g., a walking event or a shaking event)
`that may cause the motion sensor to detect a particular move(cid:173)
`ment and thereby generate particular motion sensor data. A
`motion sensing application may be utilized by the device to
`process the generated motion sensor data. For example, a
`processor running a motion sensing application may analyze
`the motion sensor data to distinguish the specific type of
`60 motion event that caused the motion sensor to generate the
`motion sensor data. Then the application may determine if
`that specific type of motion event is associated with an
`instruction to control a function of the device and, if so, the
`application may carry out that instruction.
`The electronic device may be able to operate in various
`power management modes in order to conserve power during
`certain situations. For example, an electronic device may be
`
`Petitioner Samsung Ex-1019, 0009
`
`

`

`US 7,873,849 B2
`
`3
`configured to switch from an active power mode to a sleep
`power mode when certain device components have not been
`used and/or certain instructions have not been received within
`a certain period of time. Various components may be at least
`partially deactivated by the device when switching to the
`sleep mode. However, in some embodiments, a motion sensor
`may remain at least partially activated when the device is
`operating in a lower power mode, such as a sleep mode, so
`that certain user motion events may still be detected and
`appropriately utilized by the device. For example, a motion
`sensor may be utilized as a pedometer for continuously
`detecting user step motion events despite the device switch(cid:173)
`ing between various power management modes for conserv(cid:173)
`ing power.
`FIG. 1 is a schematic view of an illustrative electronic
`device 100 for detecting a user's steps using one or more
`motion sensors in accordance with some embodiments of the
`invention. Electronic device 100 may perform a single func(cid:173)
`tion (e.g., a device dedicated to detecting a user's steps) and,
`in other embodiments, electronic device 100 may perform
`multiple functions (e.g., a device that detects a user's steps,
`plays music, and receives and transmits telephone calls).
`Moreover, in some embodiments, electronic device 100 may
`be any portable, mobile, or hand-held electronic device con(cid:173)
`figured to detect a user's motions (e.g., steps) wherever the
`user travels. Electronic device 100 may include any suitable
`type of electronic device having one or more motion sensors
`operative to detect a user's motions. For example, electronic
`device 100 may include a media player ( e.g., an iPod™ avail(cid:173)
`able by Apple Inc. of Cupertino, Calif.), a cellular telephone
`( e.g., an iPhone™ available by Apple Inc.), a personal e-mail
`or messaging device (e.g., a Blackberry™ available by
`Research In Motion Limited of Waterloo, Ontario), any other
`wireless communication device, a pocket-sized personal
`computer, a personal digital assistant ("PDA"), a laptop com(cid:173)
`puter, a music recorder, a still camera, a movie or video
`camera or recorder, a radio, medical equipment, any other
`suitable type of electronic device, and any combinations
`thereof.
`Electronic device 100 may include a processor or control
`circuitry 102, memory 104, communications circuitry 106,
`power supply 108, input/output ("I/O") circuitry 110, and one
`or more motion sensors 112. Electronic device 100 may also
`include a bus 103 that may provide a data transfer path for
`transferring data, to, from, or between various other compo(cid:173)
`nents of device 100. In some embodiments, one or more
`components of electronic device 100 may be combined or
`omitted. Moreover, electronic device 100 may include other
`components not combined or included in FIG. 1. For
`example, electronic device 100 may also include various
`other types of components, including, but not limited to, light
`sensing circuitry, camera lens components, or global posi(cid:173)
`tioning circuitry, as well as several instances of one or more of
`the components shown in FIG. 1. For the sake of simplicity,
`only one of each of the components is shown in FIG. 1.
`Electronic device 100 may also be provided with a housing
`101 that may at least partially enclose one or more of the
`components of device 100 for protecting them from debris
`and other degrading forces external to device 100. In some
`embodiments, all of the components of electronic device 100
`may be provided within the same housing 101. In other
`embodiments, one or more of the components may be pro(cid:173)
`vided within its own housing ( e.g., a motion sensor 112 may
`be provided within its own housing and may communicate
`wirelessly or through a wire with a processor 102, which may
`be provided within its own housing).
`
`15
`
`4
`Memory 104 may include one or more storage mediums,
`including, for example, a hard-drive, solid-state drive, flash
`memory, permanent memory such as read-only memory
`("ROM"), semi-permanent memory such as random access
`5 memory ("RAM"), any other suitable type of storage com(cid:173)
`ponent, or any combination thereof. Memory 104 may
`include cache memory, which may be one or more different
`types of memory used for temporarily storing data for elec(cid:173)
`tronic device applications. Memory 104 may store media data
`10 (e.g., music, image, and video files), software (e.g., for imple(cid:173)
`menting functions on device 100), firmware, preference
`information ( e.g., media playback preferences), lifestyle
`information (e.g., food preferences), exercise information
`(e.g., information obtained by exercise monitoring equip(cid:173)
`ment), transaction information (e.g., information such as
`credit card information), wireless connection information
`( e.g., information that may enable device 100 to establish a
`wireless connection), subscription information ( e.g., infor(cid:173)
`mation that keeps track of podcasts or television shows or
`20 other media a user subscribes to), contact information (e.g.,
`telephone numbers and e-mail addresses), calendar informa(cid:173)
`tion, any other suitable data, or any combination thereof.
`Communications circuitry 106 may be provided to allow
`device 100 to communicate with one or more other electronic
`25 devices or servers (not shown) using any suitable communi(cid:173)
`cations protocol. For example, communications circuitry 106
`may support Wi-Fi ( e.g., an 802.11 protocol), Ethernet, Blue(cid:173)
`tooth™, high frequency systems (e.g., 900 MHz, 2.4 GHz,
`and 5.6 GHz communication systems), cellular networks
`30 (e.g., GSM,AMPS, GPRS, CDMA, EV-DO, EDGE, 3GSM,
`DECT, IS-136/TDMA, iDen, LTE, or any other suitable cel(cid:173)
`lular network or protocol), infrared, transmission control pro(cid:173)
`tocol/internet protocol ("TCP/IP") ( e.g., any of the protocols
`used in each of the TCP/IP layers), hypertext transfer protocol
`35 ("HTTP"), BitTorrent™, file transfer protocol ("FTP"), real(cid:173)
`time transport protocol ("RTP"), real-time streaming proto(cid:173)
`col ("RTSP"), secure shell protocol ("SSH"), voice over
`internet protocol (''VOIP"), any other communications pro(cid:173)
`tocol, or any combination thereof. Communications circuitry
`40 106 may also include circuitry that can enable device 100 to
`be electrically coupled to another device ( e.g., a computer or
`an accessory device) and communicate with that other device,
`either wirelessly or via a wired connection.
`Power supply 108 can include any suitable circuitry for
`45 receiving and/or generating power, and for providing such
`power to one or more components of electronic device 100. In
`some embodiments, power supply 108 can be coupled to a
`power grid (e.g., when device 100 is not acting as a portable
`device or when a battery of the device is being charged at an
`50 electrical outlet with power generated by an electrical power
`plant). As another example, power supply 108 can be config(cid:173)
`ured to generate power from a natural source ( e.g., solar
`power using solar cells). In some embodiments, power supply
`108 can include one or more batteries for providing power
`55 (e.g., when device 100 is acting as a portable device). For
`example, power supply 108 can include one or more of a
`battery ( e.g., a gel, nickel metal hydride, nickel cadmium,
`nickel hydrogen, lead acid, or lithium-ion battery), an unin(cid:173)
`terruptible or continuous power supply ("UPS" or "CPS"),
`60 and circuitry for processing power received from a power
`generation source ( e.g., power generated by an electrical
`power plant and delivered to the user via an electrical socket
`or otherwise).
`The power can be provided by power supply 108 as alter-
`65 nating current or direct current, and may be processed to
`transform power or limit received power to particular char(cid:173)
`acteristics. For example, the power can be transformed to or
`
`Petitioner Samsung Ex-1019, 0010
`
`

`

`US 7,873,849 B2
`
`5
`
`10
`
`5
`from direct current, and constrained to one or more values of
`average power, effective power, peak power, energy per pulse,
`voltage, current (e.g., measured in amperes), or any other
`characteristic of received power. Power supply 108 can be
`operative to request or provide particular amounts of power at
`different times, for example, based on the needs or require(cid:173)
`ments of electronic device 100 or periphery devices that may
`be coupled to electronic device 100 ( e.g., to request more
`power when charging a battery than when the battery is
`already charged).
`Input/ output circuitry 110 may be operative to convert, and
`encode/decode, if necessary, analog signals and other signals
`into digital data. In some embodiments, I/O circuitry 110 may
`convert digital data into any other type of signal, and vice(cid:173)
`versa. For example, I/O circuitry 110 may receive and convert
`physical contact inputs (e.g., using a multi-touch screen),
`physical movements (e.g., using a mouse or sensor), analog
`audio signals ( e.g., using a microphone), or any other input.
`The digital data can be provided to and received from proces(cid:173)
`sor 102, memory 104, or any other component of electronic
`device 100. Although I/O circuitry 110 is illustrated in FIG. 1
`as a single component of electronic device 100, several
`instances ofl/O circuitry can be included in electronic device
`100.
`Input/output circuitry 110 may include any suitable
`mechanism or component for allowing a user to provide
`inputs for interacting or interfacing with electronic device
`100. For example, an input component of I/O circuitry 110
`may include any suitable user input component or mechanism
`and can take a variety of forms, including, but not limited to,
`an electronic device pad, dial, click wheel, scroll wheel, touch
`screen, one or more buttons (e.g., a keyboard), mouse, joy
`stick, track ball, and combinations thereof. In some embodi(cid:173)
`ments, I/O circuitry 110 may include a multi-touch screen.
`Each input component ofl/O circuitry 110 can be configured
`to provide one or more dedicated control functions for mak(cid:173)
`ing selections or issuing commands associated with operating
`electronic device 100.
`Input/output circuitry 110 may also include any suitable
`output mechanism or component for presenting information
`(e.g., textual, graphical, audible, and/or tactile information)
`to a user of electronic device 100. For example, I/O circuitry
`110 may include any suitable output component or mecha(cid:173)
`nism and can take a variety of forms, including, but not
`limited to, audio speakers, headphones, audio line-outs,
`visual displays, antennas, infrared ports, rumblers, vibrators,
`or combinations thereof.
`In some embodiments, I/O circuitry 110 may include
`image display circuitry ( e.g., a screen or projection system) as
`an output component for providing a display visible to the
`user. For example, the display circuitry may include a screen
`( e.g., a liquid crystal display ("LCD"), a light emitting diode
`("LED") display, an organic light-emitting diode ("OLED")
`display, a surface-conduction electron-emitter display
`("SED"), a carbon nanotube display, a nanocrystal display,
`any other suitable type of display, or combination thereof)
`that is incorporated in electronic device 100. As another
`example, the display circuitry may include a movable display
`or a projecting system for providing a display of content on a
`surface remote from electronic device 100 ( e.g., a video pro- 60
`jector, a head-up display, or a three-dimensional (e.g., holo(cid:173)
`graphic) display).
`In some embodiments, display circuitry of I/O circuitry
`110 can include a coder/ decoder ("COD EC") to convert digi(cid:173)
`tal media data into analog signals. For example, the display
`circuitry, or other appropriate circuitry within electronic
`device 100, may include video CODECS, audio CODECS, or
`
`6
`any other suitable type of CODEC. Display circuitry also can
`include display driver circuitry, circuitry for driving display
`drivers, or both. The display circuitry may be operative to
`display content (e.g., media playback information, applica-
`tion screens for applications implemented on the electronic
`device, information regarding ongoing communications
`operations, information regarding incoming communications
`requests, or device operation screens) under the direction of
`processor 102.
`It should be noted that one or more input components and
`one or more output components of I/O circuitry 110 may
`sometimes be referred to collectively herein as an I/O inter(cid:173)
`face 110. It should also be noted that an input component and
`an output component ofl/O circuitry 110 may sometimes be
`15 a single I/O component, such as a touch screen that may
`receive input information through a user's touch of a display
`screen and that may also provide visual information to a user
`via that same display screen.
`Motion sensor 112 may include any suitable motion sensor
`20 operative to detect movements of electronic device 100. For
`example, motion sensor 112 may be operative to detect a
`motion event of a user carrying device 100. In some embodi(cid:173)
`ments, motion sensor 112 may include one or more three-axis
`acceleration motion sensors (e.g., an accelerometer) opera-
`25 tive to detect linear acceleration in three directions (i.e., the x
`or left/right direction, they or up/down direction, and the z or
`forward/backward direction). As another example, motion
`sensor 112 may include one or more single-axis or two-axis
`acceleration motion sensors which may be operative to detect
`30 linear acceleration only along each of the x or left/right direc(cid:173)
`tion and they or up/down direction, or along any other pair of
`directions. In some embodiments, motion sensor 112 may
`include an electrostatic capacitance ( e.g., capacitance-cou(cid:173)
`pling) accelerometer that is based on silicon micro-machined
`35 micro electro-mechanical systems ("MEMS") technology,
`including a heat-based MEMS type accelerometer, a piezo(cid:173)
`electric type accelerometer, a piezoresistance type acceler(cid:173)
`ometer, or any other suitable accelerometer.
`In some embodiments, motion sensor 112 may be opera-
`40 tive to directly detect rotation, rotational movement, angular
`displacement, tilt, position, orientation, motion along a non(cid:173)
`linear (e.g., arcuate) path, or any other non-linear motions.
`For example, if motion sensor 112 is a linear motion sensor,
`additional processing may be used to indirectly detect some
`45 or all of the non-linear motions. For example, by comparing
`the linear output of motion sensor 112 with a gravity vector
`(i.e., a static acceleration), motion sensor 112 may be opera(cid:173)
`tive to calculate the tilt of electronic device 100 with respect
`to the y-axis. In some embodiments, motion sensor 112 may
`50 alternatively or additionally include one or more gyro-motion
`sensors or gyroscopes for detecting rotational movement. For
`example, motion sensor 112 may include a rotating or vibrat(cid:173)
`ing element. Although the following discussion generally
`describes sensing motion in the context of a three-axis accel-
`55 erometer, it will be understood that the discussion may be
`applied to any suitable sensing mechanism or combination of
`sensing mechanisms provided by motion sensor 112 of elec(cid:173)
`tronic device 100 for generating motion sensor data in
`response to detecting movement.
`Processor 102 may include any processing circuitry opera-
`tive to control the operations and performance of electronic
`device 100. For example, processor 102 may be used to run
`operating system applications, firmware applications, media
`playback applications, media editing applications, or any
`65 other application. In some embodiments, processor 102 may
`receive input signals from an input component ofl/O circuitry
`110 and/or drive output signals through an output component
`
`Petitioner Samsung Ex-1019, 0011
`
`

`

`US 7,873,849 B2
`
`7
`(e.g., a display) ofl/0 circuitry 110. Processor 102 may load
`a user interface program ( e.g., a program stored in memory
`104 or another device or server) to determine how instructions
`or data received via an input component ofl/0 circuitry 110
`or one or more motion sensors 112 may manipulate the way in
`which information is provided to the user via an output com(cid:173)
`ponent of I/0 circuitry 110. Processor 102 may associate
`different metadata with any of the motion data captured by
`motion sensor 112, including, for example, global position(cid:173)
`ing information, a time code, or any other suitable metadata
`(e.g., the current mode of device 100 or the types of applica(cid:173)
`tions being run by device 100 when the motion data was
`captured).
`To enhance a user's experience interacting with electronic
`device 100, the electronic device may provide the user with an
`ability to generate useful device information by moving the
`electronic device (i.e., a motion sensor of the electronic
`device) in one of various ways. For example, motion sensor
`112 may detect movement caused by a particular type of user
`motion event ( e.g., a user shaking sensor 112 or a user walk(cid:173)
`ing with sensor 112), and sensor 112 may then generate a
`particular motion sensor data signal based on the detected
`movement. In some embodiments, motion sensor 112 may be
`a three-axis accelerometer, and the detected movement may
`include, for example, movement along one or more particular
`axes of the accelerometer caused by a particular user motion
`event (e.g., a tilting motion detected in a z-y plane, or a
`shaking motion detected along any of the accelerometer
`axes). Sensor 112 may then generate motion sensor data in
`response to the detected movement. Next, device 100 may
`analyze this generated motion sensor data for distinguishing
`a particular type of user motion event associated with the
`sensor data and for determining whether or not to perform a
`specific device operation based on the distinguished type of
`user motion event ( e.g., using rules or settings provided by an
`application run by processor 102).
`There may be various types of user motion events that can
`be detected by motion sensor 112 for generating motion sen(cid:173)
`sor data to be analyzed by device 100. For example, user
`"input" motion events may be any suitable type of user
`motion event associated with a user attempting to actively
`interact with device 100, such as a user shaking or tilting
`sensor 112 to navigate a menu hierarchy of an application or
`to control the play of a video game being provided by device
`100. Alternatively, user "step" motion events may be any
`suitable type of user motion event associated with a user
`attempting to have device 100 track his or her exercise efforts,
`such as a user walking or running with sensor 112 so that the
`amount of steps taken may be counted by device 100. Of
`course, other types of user motion events detectable by
`motion sensor 112 may not be intended by the user (e.g.,
`when a user unintentionally bumps the device) or may not be
`caused by the user at all ( e.g., when an earthquake moves the
`device).
`Electronic device 100 may use any suitable appr