USOO943 0098B2
`
`(12) United States Patent
`LaZarescu et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 9.430,098 B2
`Aug. 30, 2016
`
`(54) FREQUENCY SENSING AND
`MAGNIFICATION OF PORTABLE DEVICE
`OUTPUT
`
`(71) Applicant: Apple Inc., Cupertino, CA (US)
`
`(72) Inventors: Paul Orri Lazarescu, Irvine, CA (US);
`Daniel Goodman, Greenbrae, CA (US);
`Adithya Raghavan, Los Altos, CA
`(US)
`(73) Assignee: APPLE INC., Cupertino, CA (US)
`
`(*) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 279 days.
`(21) Appl. No.: 13/717,693
`
`(22) Filed:
`
`Dec. 17, 2012
`
`(65)
`
`Prior Publication Data
`US 2014/O16817O A1
`Jun. 19, 2014
`
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`
`(51) Int. Cl.
`G06F 3/043
`GOIH I3/00
`GOIN 29/12
`GOIH IMO
`(52) U.S. Cl.
`CPC ................ G06F 3/043 (2013.01); G0IH I/00
`(2013.01); G0IH 13/00 (2013.01); G0IN
`29/12 (2013.01); G0IN 2291/028 (2013.01);
`G0IN 2291/02854 (2013.01)
`(58) Field of Classification Search
`CPC ....................................................... GO6F 3/043
`USPC ......................................... 345/169, 173, 179
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`7,345,677 B2 * 3/2008 Ing et al. ...................... 345,173
`8,477.463 B2 * 7/2013 Ms .................................. 361.20
`2004/0239651 A1* 12/2004 Sakurai ..........
`... 345,179
`2009/0243997 A1* 10/2009 Tierling et al.
`... 345,156
`2009,0273583 A1* 11/2009 Norhammar .......
`345,177
`2010/0164869 A1* 7/2010 Huang et al. ..
`... 345,168
`2011 0191680 A1* 8, 2011 Chae et al. ....
`715,716
`2012/0035934 A1* 2/2012 Cunningham ...
`... 704,260
`2012/O1200 14 A1* 5, 2012 Nikolovski et al. .......... 345,173
`2012/0274609 A1* 11/2012 Sheng et al. .......
`345,177
`2012/0302293 A1* 11/2012 Johnson et al. .............. 455,567
`* cited by examiner
`Primary Examiner — Kumar Patel
`Assistant Examiner — Afroza Chowdhury
`(74) Attorney, Agent, or Firm — Brownstein Hyatt Farber
`Schreck, LLP
`
`ABSTRACT
`(57)
`Devices, using emitted acoustic signals and received vibra
`tions, determine resonant frequencies of a surface or other
`object, and determine useful information about that Surface,
`including size, thickness, and material. Received vibrations
`include impulse vibrations from Striking that Surface with a
`finger or stylus, or from a frequency or from a swept
`sinusoid emitted by the device. The device can adjust its
`frequency output to use the Surface as an amplifier for alarms
`or speakers, or a center frequency for Sonic output. Using an
`accelerometer, devices sense impulse vibrations, translating
`those impulses into information, Such as keystrokes, game
`controls, mice, or musical instrument controls. Devices can
`emulate keyboards and input devices using tabletops.
`Devices can coordinate signals through multiple media,
`including air, Surface, or EMF channels.
`29 Claims, 6 Drawing Sheets
`
`
`
`IPR2022-00059
`TACTION EX2021 PAGE001
`
`

`

`U.S. Patent
`
`Aug. 30, 2016
`
`Sheet 1 of 6
`
`US 9.430,098 B2
`
`
`
`FIG.1
`
`IPR2022-00059
`TACTION EX2021 PAGE002
`
`

`

`U.S. Patent
`
`Aug. 30, 2016
`
`Sheet 2 of 6
`
`US 9.430,098 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`200A
`
`202
`
`
`
`
`
`DECIDE:
`RESONANT
`FREQUENCY OR
`ACOUSTIC
`SIGNATURE
`
`METHOD
`200
`
`?
`
`RESONANT
`FREQUENCY)
`EMS
`RESONANT
`FREQUENCY)
`
`EMIT
`ACOUSTIC
`SIGNAL
`
`
`
`SURFACE
`RECEIVES
`ACOUSTICSIGNAL
`
`DEVICE RECEIVES
`ACOUSTICSIGNAL
`
`DETERMINE
`CHARACTERISTICS
`OF SURFACE
`
`ADJUST
`OPERATION OF
`DEVICE
`
`ACOUSTIC
`IGNATURE)
`|READY TOUSE
`ACOUSTICSIGNAL)
`
`ATTEMPT TOUSE
`RESONANT
`FREQUENCY
`
`
`
`FIG.2
`
`IPR2022-00059
`TACTION EX2021 PAGE003
`
`

`

`U.S. Patent
`
`Aug. 30, 2016
`
`Sheet 3 of 6
`
`US 9.430,098 B2
`
`300A
`
`METHOD
`300
`
`ATTEMPT TO
`RECEIVEACOUSTIC
`SIGNAL
`
`SURFACE RECEIVES
`ACOUSTICSIGNAL
`
`SURFACE
`TRANSFORMS
`ACOUSTICSIGNAL
`
`DEVICE RECEIVES
`ACOUSTICSIGNAL
`
`
`
`DEVICE
`ANALYZES
`ACOUSTICSIGNAL
`
`
`
`
`
`
`
`DEVICE
`DETERMINES
`USEFUL
`INFORMATION
`
`302
`
`304
`
`306
`
`308
`
`310
`
`312
`
`FIG.3
`
`IPR2022-00059
`TACTION EX2021 PAGE004
`
`

`

`U.S. Patent
`
`Aug. 30, 2016
`
`Sheet 4 of 6
`
`US 9.430,098 B2
`
`
`
`IPR2022-00059
`TACTION EX2021 PAGE005
`
`

`

`U.S. Patent
`
`Aug. 30, 2016
`
`Sheet S of 6
`
`US 9.430,098 B2
`
`METHOD
`500
`
`502
`
`504
`
`506
`
`508
`
`510
`
`
`
`DETERMINE
`ACOUSTIC
`SIGNALTO
`SEND
`
`SEND INFO
`REGARDING
`ACOUSTIC
`SIGNAL
`
`EMT
`ACOUSTIC
`SIGNAL
`
`COMPARESENT
`WS. RECEIVED
`SIGNALS
`
`COLLECTIVELY
`DETERMINE
`IMPULSE
`RESPONSE
`
`(ED) 500B
`
`FIG.5
`
`IPR2022-00059
`TACTION EX2021 PAGE006
`
`

`

`U.S. Patent
`
`Aug. 30, 2016
`
`Sheet 6 of 6
`
`US 9.430,098 B2
`
`FREQUENCY
`100 DEVE
`
`
`
`PROGRAM
`DATA MEMORY
`
`PROCESSOR
`
`INPUT
`
`112
`
`VIBRATION
`SENSOR
`
`SONIC
`SENSOR
`
`SPEAKER
`
`102
`
`104
`
`106
`
`FIG.6
`
`IPR2022-00059
`TACTION EX2021 PAGE007
`
`

`

`1.
`FREQUENCY SENSING AND
`MAGNIFICATION OF PORTABLE DEVICE
`OUTPUT
`
`TECHNICAL FIELD
`
`This application relates to an iPhone frequency sensor/
`magnifier application, and other matters.
`
`BACKGROUND
`
`Many physical objects, particularly those having defined
`surfaces that are relatively wider than they are thick, are
`characterized by a resonant frequency, that is, a frequency at
`which those physical objects exhibit a maximum (or at least
`a local maximum) energy response to vibrations. For
`example, a wooden tabletop might, depending on its size,
`thickness, and the Substance from which it is made, have a
`particular frequency at which it might vibrate, and at which
`it might amplify vibrations if those vibrations are applied to
`that tabletop at that frequency.
`This can have the effect that a speaker, or a speaker in
`combination with an amplifier, can deliberately cause the
`tabletop to vibrate at a relative maximum, by emitting
`vibrations (such as sound) that match the resonant frequency
`of that tabletop.
`This can also have the effect that a sensor, or a sensor in
`combination with an amplifier, can detect or otherwise
`determine the resonant frequency of a tabletop on which it
`sits, in response to vibrations of the tabletop and in response
`to whether that sensor detects relative amplification or
`relative damping of those vibrations.
`
`BRIEF DESCRIPTION OF THE DISCLOSURE
`
`This application provides techniques, including devices
`and methods, which can determine a resonant frequency and
`possibly other characteristics of the object. For example,
`devices and methods as described herein can determine a
`resonant frequency of a surface upon which a frequency
`device (as described herein) is placed, and can in response
`thereto, determine useful information about that surface,
`Such as its size, thickness, and construction materials
`included in that surface.
`In one embodiment, one or more devices as described
`herein can emit one or more selected frequencies, and can
`detect a response of an object to which the devices are
`coupled. Such as when the devices are placed upon a Surface
`of the object. In response to this information, the devices can
`determine useful information about the object. The device
`can adjust its operation in response to information about the
`object, which can have the effect of improving performance
`of the device in one or more characteristics. For example, a
`speaker can emit vibrations at one or more known frequen
`cies and can, in response to whether the tabletop amplifies
`or dampens vibrations at those frequencies, determine
`whether those frequencies include one or more resonant
`frequencies of the tabletop. In response to the resonant
`frequencies of the tabletop, the speaker can use the tabletop
`as an alarm or speaker, or as a center frequency for Sonic
`output (Such as a center frequency for playing music).
`This application provides techniques, including devices
`and methods, which can sense acoustic vibrations from an
`object, such as received from a finger or stylus applied to the
`object, from a frequency emitted by a device applied to the
`object, or from a swept-sinusoid signal emitted by a device
`applied to the object. For example, devices and methods as
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 9,430,098 B2
`
`2
`described herein can sense impulse vibrations from an object
`coupled to a device having an inertial response sensor, and
`can in response thereto, determine useful information about
`those vibrations, such as their duration, location, Volume,
`and materials used to induce those vibrations.
`In one embodiment, one or more devices as described
`herein can receive one or more impulse vibrations from an
`object, such as using an accelerometer or another inertial
`response sensor (Such as a gyroscope or otherwise), and can
`translate those impulse vibrations into information, Such as
`a direction or location from which the vibrations originate,
`or a number of those vibrations that are received. The device
`can adjust its operation in response to the vibrations. Such as
`constructing input data for the device. For example, devices
`can receive impulse vibrations or other vibrations from one
`or more locations on a tabletop, and can, in response to a
`measure of how much the tabletop amplifies or dampens
`vibrations from those locations, emulate a keyboard, key
`pad, mouse or trackpad, game controller, musical instrument
`control, or other input for a computing device.
`This application provides techniques, including methods
`and systems, which can coordinate devices, such as having
`at least one emitter and at least one sensor, and coupled
`using one or more radio frequency (RF) or other electro
`magnetic frequency (EMF) channels. For example, methods
`and systems as described herein can emit vibrations from a
`first device and receive vibrations at a second device, the
`first device sending those vibrations to the second device
`both using (a) EMF techniques, such as using BluetoothTM
`or radiotelephone techniques, near field communication, or
`otherwise; as well as (b) sonic techniques deliberately
`mediated by the resonant frequency of one or more objects
`to which the first and second device are coupled.
`In one embodiment, the first and second device can each
`include a cellular telephone, such as an iPhoneTM or other
`device, wherein the first and second device can be disposed
`to communicate using EMF techniques, such as a cellular
`telephone circuit or a packet Switched network. In alterna
`tive embodiments, the first and second device can each
`include other devices disposed to communicate using EMF
`techniques, such as other cellular telephones, an iPadTM or
`other computing tablet, a netbook, a laptop computer or
`other portable personal computer, or otherwise. The first and
`second device can each be disposed on a tabletop. Such as a
`wooden tabletop disposed to support both the first and
`second device, and disposed to transmit an acoustic signal
`from the first to the second device. The first device can be
`disposed to emit one or more Such acoustic signals. Such as
`a known frequency for which a frequency response from the
`tabletop is known to at least either the first or second device,
`and the second device can be disposed to receive those
`acoustic signals, such as mediated by that frequency
`response from the tabletop. The first and second device can
`be disposed to compare the emitted acoustic signal with the
`received acoustic signal, in response to which one or both of
`them can determine an impulse response or a resonant
`frequency of the tabletop.
`While multiple embodiments are disclosed, including
`variations thereof, still other embodiments of the present
`disclosure will become apparent to those skilled in the art
`from the following detailed description, which shows and
`describes illustrative embodiments of the disclosure. As will
`be realized, the disclosure is capable of modifications in
`various obvious aspects, all without departing from the spirit
`and scope of the present disclosure. Accordingly, the draw
`ings and detailed description are to be regarded as illustra
`tive in nature and not restrictive.
`
`IPR2022-00059
`TACTION EX2021 PAGE008
`
`

`

`3
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 shows a conceptual drawing of a frequency device
`on a surface.
`FIG. 2 shows a conceptual drawing of a first example
`method of operation.
`FIG. 3 shows a conceptual drawing of a second example
`method of operation.
`FIG. 4 shows a conceptual drawing of a two frequency
`devices cooperating on a Surface.
`FIG. 5 shows a conceptual drawing of a third example
`method of operation.
`FIG. 6 shows a conceptual drawing of a frequency device.
`
`DETAILED DESCRIPTION
`
`Terminology
`The following terminology is exemplary, and not intended
`to be limiting in any way.
`The text “frequency device', and variants thereof, gener
`ally refers to any device capable of generating a sound or
`other vibration, Such as a mobile sound player, mobile
`telephone, iPhoneTM, or otherwise. For example, a frequency
`device can include another type of cellular telephone, an
`iPodTM or other mobile media player, such as an MP3 player
`or other music player, an iPadTM or other computing tablet,
`a netbook, a laptop computer or other portable personal
`computer, or otherwise. The amount of sound or vibration
`need not be concentrated in any particular frequency band,
`and need not be confined to any particular frequency band,
`Such as a human audible frequency band. For some
`examples, the frequency band can be a human audible
`frequency band, or another frequency band Such as an
`infrasonic or ultrasonic frequency band. Moreover, the
`amount of Sound or vibration need not be constant, or
`periodic, or follow any particular pattern.
`The text “resonant surface', 'surface', and variants
`thereof, generally refers to any Surface, or any other portion
`of an object, whether solid or otherwise, having at least one
`definable frequency at which that resonant Surface has (at
`least a local) maximum in its response to a frequency applied
`to that resonant Surface. For some examples, a resonant
`Surface can include a relatively flat surface including metal,
`plastic, wood, or combinations or composites thereof. Such
`as having the effect that a particular frequency is received by
`the resonant Surface and amplified relative to other frequen
`cies. In one such case, a tabletop can have the property that
`it might reverberate more loudly at 1 KHZ than at other
`frequencies, in which case the 1 KHZ frequency would be
`said to be a resonant frequency of that resonant Surface.
`After reading this application, those skilled in the art
`would recognize that these statements of terminology would
`be applicable to techniques, methods, physical elements, and
`systems (whether currently known or otherwise), including
`extensions thereof inferred or inferable by those skilled in
`the art after reading this application.
`Frequency Device on a Surface
`FIG. 1 shows a conceptual drawing of a frequency device
`on a surface.
`A frequency device 100 can be disposed on a resonant
`surface 120, or can be coupled to one or more objects
`collectively having at least one such surface 120.
`In one embodiment, the frequency device 100 can include
`a speaker 102, disposed to emit one or more acoustic signals.
`For a first example, the one or more acoustic signals can
`include an acoustic impulse, such as a click or a pulse, or
`otherwise disposed to elicit a Sonic impulse response from a
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 9,430,098 B2
`
`4
`Sonic medium. For a second example, the acoustic signals
`can include one or more selected frequencies, or combina
`tions or conjunctions thereof. Such as one or more pure
`frequencies, or one or more dual-tone multi-frequency
`(DTMF) sounds. For a third example, the acoustic signals
`can include one or more swept-sinusoid signals, or combi
`nations or conjunctions thereof, or other known time-vary
`ing signals, such as ramped triangular waves, square waves,
`or otherwise.
`In one embodiment, the frequency device 100 can include
`a vibration sensor 104 (shown in FIG. 6), disposed to receive
`one or more acoustic signals, such as signals mediated by the
`surface 120. For example, the vibration sensor 104 can
`include an accelerometer, an inertial response sensor, or
`other device disposed to receive vibrations from the surface
`120.
`In one embodiment, the frequency device 100 can include
`a sonic sensor 106 (shown in FIG. 6), disposed to receive
`one or more acoustic signals, such as those mediated by an
`ambient atmosphere or other Sonic medium. For example,
`the sonic sensor 106 can include a microphone or other
`device disposed to receive acoustic signals emitted by the
`surface 120.
`In one embodiment, the surface 120 can be disposed to
`have a shape and size, and include one or more materials
`from which it is manufactured. For a first example, the
`surface 120 can be made of metal, plastic, wood, or another
`substance. For a second example, the surface 120 can be
`laminated or covered with a secondary Substance, Such as a
`metal or wooden Surface laminated with a plastic covering.
`The shape and size, and one or more materials, can have the
`effect that the surface 120 has an acoustic impulse response
`and one or more resonant frequencies. As described herein,
`the resonant frequencies of the surface 120 can have the
`property that an acoustic signal (or portion thereof) having
`one of those resonant frequencies would be amplified when
`applied to the surface 120, and that the amplification would
`be (at least locally) maximized.
`This can have the effect that when the frequency device
`100 applies, using the speaker 102, an acoustic signal
`including one or more of the resonant frequencies to the
`surface 120, the surface 120 would amplify the portion of
`that acoustic signal including the resonant frequencies, and
`would provide to the frequency device 100 and returned
`acoustic signal in which the resonant frequencies would be
`amplified. This can have the effect that the vibration sensor
`104 and the sonic sensor 106 of the frequency device 100
`would detect the returned acoustic signal with the portion of
`the resonant frequencies having been amplified. This can
`have the effect that the frequency device 100 can detect the
`resonant frequencies in response to the surface 120. For
`example, the frequency device 100 can determine those
`frequencies at which the surface 120 returns a signal that is
`maximally amplified.
`In one embodiment, the frequency device 100 can include
`a processor 108 (shown in FIG. 6), associated with program
`and data memory 110 (shown in FIG. 6), disposed to
`interpret instructions in the program and data memory 110.
`and disposed to execute those instructions to provide one or
`more acoustic signals to the Surface 120. For example, the
`frequency device 100 can be disposed to provide acoustic
`signals to the Surface 120 including one or more impulse
`vibrations, one or more frequencies, or one or more Swept
`sinusoids emitted by the frequency device 100. In such
`cases, the frequency device 100 can be disposed to provide
`impulse vibrations as described in any known text describ
`ing generation and transmission of impulse signals, emitted
`
`IPR2022-00059
`TACTION EX2021 PAGE009
`
`

`

`US 9,430,098 B2
`
`5
`as Sound. In Such cases, the frequency device 100 can be
`disposed to provide one or more frequencies as described in
`any known text describing generation and transmission of
`known frequencies, whether pure or mixed, emitted as
`sound. In such cases, the frequency device 100 can be
`disposed to provide one or more Swept-sinusoids as
`described in any known text describing generation and
`transmission of signals having sine waves of known varying
`frequencies, emitted as Sound.
`In one embodiment, the surface 120 can include a rela
`tively flat, relatively solid object, such as a desk or a
`tabletop. For example, the surface 120 can include one or
`more regions 122 on which a user (not shown) can poke,
`scratch, slide, tap, or otherwise cause a vibration or other
`sonic impulse. This can have the effect that the surface 120,
`when the user taps on one such region 122, emits a Sonic
`impulse that can be received and interpreted by the fre
`quency device 100.
`In one embodiment, the regions 122 into which the
`Surface 120 is divided can indicate specific signals or
`symbols, such as could be used as a substitute for typewriter
`keys. In one embodiment, lines or boxes, or typography
`indicative of those signals or symbols, or other indicators for
`those signals or symbols, can be projected by the frequency
`device 100, or another device, onto the surface 120. This can
`have the effect that the regions 122 of the surface 120 can be
`so divided that the frequency device 100 can detect one of
`a multiplicity of Such signals or symbols. This can have the
`effect that the surface 120 can be used, in combination with
`the frequency device 100, to determine in what region 122
`on the surface 120 the sonic impulse occurred. For a first
`example, the user can tap in one of the corners of the surface
`120, and the frequency device 100 can determine which
`corner. For a second example, the user can tap in one of a
`multiplicity of small regions 122 of the surface 120, and the
`frequency device 100 can determine which of those small
`regions 122. In such cases, the multiplicity of Small regions
`122 could emulate a keyboard or other form of touchable
`control element.
`In one embodiment, the frequency device 100 may pre
`calibrate a set of locations where the user would swipe or tap
`on the surface 120. (In one embodiment, the frequency
`device 100 may detect when the user swipes on the surface
`120, in addition to or in alternative to tapping on the Surface
`120.) In one embodiment, the frequency device 100 may
`pre-calibrate locations by asking the user to Swipe or tap at
`each location in turn. For a first example, the user could
`Swipe or tap at each location in an order requested by the
`frequency device 100, or by Swiping or tapping at locations
`using a code to indicate which location, Such as Morse code
`or another known code for representing symbols, or by
`Swiping or tapping at locations using another fixed signal
`already known to the frequency device 100. This would have
`the effect that the frequency device 100 could match the
`indicated symbol with the acoustic signal associated with
`that location, thus identifying that symbol with that location.
`For a second example, the user could swipe or tap at each
`location with a user-defined identifiable set of touches for
`each such symbol, with the effect that the frequency device
`100 could match the indicated symbol with the user-defined
`identifiable set of touches and its associated acoustic signal.
`In one embodiment, the user may place a printed key
`board, Such as made of paper or plastic, under the frequency
`device 100. The printed keyboard may indicate a location of
`where to tap or slide to indicate particular keys or controls.
`For a first example, a plastic keyboard may include a
`material with a relatively high resolution of location, by its
`
`40
`
`45
`
`6
`own impulse response or resonant frequency. For a second
`example, the locations of keys or controls may be pre
`determined by calibration of the frequency device 100 with
`respect to the surface 120, such as described above, with the
`effect that the frequency device 100 would have relatively
`good resolution of where the user Swipes or taps, and
`without Substantial overlap of acoustic signals. For a third
`example, the printed keyboard may include a set of ridges or
`other Surface features, such that Swiping a finger (or other
`implement, Such as a stylus) on or near those Surface
`features would be detectable by the frequency device 100.
`In one embodiment, in cases in which the regions 122 of
`the surface 120 can be divided into a multiplicity of letters
`or symbols such as a virtual keyboard, the virtual keyboard
`can be combined with a display and dynamically adjusted to
`alter the letters or symbols associated with each key in
`response to one or more time-varying circumstances. For a
`first example, the virtual keyboard can be adjusted to use a
`“SHIFT key to change the presentation of letters or sym
`bols to indicate upper-case characters instead of lower-case
`characters. For a second example, the virtual keyboard can
`be adjusted to show diacritical marks or a secondary set of
`letters or symbols in response to a function key, such as with
`a scientific calculator.
`While the frequency device 100 and the surface 120, and
`associated elements, have been described with respect to one
`or more particular embodiments, alternative embodiments
`are possible that remain within the scope and spirit of the
`invention, would be clear to those of ordinary skill in the art
`after reading this application, and would not require either
`further invention or undue experiment.
`First Method of Operation
`FIG. 2 shows a conceptual drawing of a first method of
`operation.
`A first method 200 includes a set of flow points and
`method steps. In one embodiment, the method 200 can
`enable the frequency device 100 to determine one or more
`resonant frequencies of the Surface 120, and in response to
`those one or more resonant frequencies, determine informa
`tion about the Surface (such as a shape, size, and composi
`tion material of the surface 120). In one embodiment, the
`method 200 can enable the frequency device 100 to use the
`resonant frequencies of the Surface 120. Such as to use the
`Surface 120 as an alarm or noise generator, to use the Surface
`120 as an amplifier for music or other sound, to find studs,
`weak points, or other irregularities within the surface 120,
`and otherwise.
`Although these flow points and method steps are some
`times described as performed in a particular order, in the
`context of the invention, there is no particular requirement
`for any Such limitation. For example, the flow points and
`method steps could be performed in a different order,
`concurrently, in parallel, or otherwise. Similarly, although
`these flow points and method steps are shown performed by
`a general purpose processor in a force sensitive device, in
`the context of the invention, there is no particular require
`ment for any such limitation. For example, one or more Such
`method steps could be performed by special purpose pro
`cessor, by another circuit, or be offloaded to other processors
`or other circuits in other devices, such as by offloading those
`functions to nearby devices using wireless technology or by
`offloading those functions to cloud computing functions.
`Although these flow points and method steps are some
`times described as performed by the method 200, they are
`substantially performed by elements with respect to one or
`more devices or systems as described herein. For example,
`one or more such method steps could be performed by the
`
`10
`
`15
`
`25
`
`30
`
`35
`
`50
`
`55
`
`60
`
`65
`
`IPR2022-00059
`TACTION EX2021 PAGE010
`
`

`

`US 9,430,098 B2
`
`10
`
`15
`
`25
`
`30
`
`35
`
`7
`frequency device 100, by the surface 120 (or by devices
`coupled thereto), by a portion thereof, by a combination or
`conjunction thereof, or by other devices or systems as
`described herein. Moreover, one or more such method steps
`could be performed by other devices or systems not explic
`itly described herein, but which would be clear to those of
`ordinary skill in the art after reading this application, and
`which would not require either further invention or undue
`experimentation.
`At a flow point 200a, the method 200 is ready to begin.
`At a step 202, the frequency device 100 can decide
`whether it will attempt to determine resonant frequencies of
`the surface 120, or whether it will attempt to receive an
`acoustic signal from the surface 120. If the frequency device
`100 decides it will attempt to determine resonant frequencies
`of the surface 120, the method 200 proceeds with the flow
`point 220. If the frequency device 100 decides it will attempt
`to receive an acoustic signal from the surface 120, the
`method 200 proceeds with the flow point 240. In alternative
`embodiments, the frequency device 100 can proceed with
`both flow points 220 and 240 in parallel.
`At the flow point 220, the frequency device 100 is ready
`to determine resonant frequencies of the surface 120. In one
`embodiment, the frequency device 100 can attempt to deter
`mine information about one or more resonant frequencies of
`the Surface 120 by emitting an acoustic signal and receiving
`a response from the surface 120.
`At a step 222, the frequency device 100 can emit one or
`more acoustic signals, such as at the Surface 120. This can
`have the effect that the acoustic signal is transmitted to the
`surface 120. For example, the acoustic signal can include an
`impulse vibration, one or more selected frequencies, a
`time-varying signal Such as a Swept-sinusoid, or otherwise.
`For a first example, if the frequency device 100 is
`positioned near or on top of the surface 120, and the
`frequency device 100 includes a speaker 102, the frequency
`device 100 can emit a Sound that propagates through at least
`a portion of the surface 120. For a second example, if the on
`top of the surface 120, and the frequency device 100
`40
`includes a haptic element Such as a vibrating element, the
`frequency device 100 can emit a vibration impulse that
`propagates through at least a portion of the Surface 120.
`In one embodiment, the frequency device 100 can include
`a mobile media player, such as an iPodTM, iPhoneTM, or
`iPadTM, or another type of related device, interpreting or
`executing instructions from an application program.
`In one embodiment, the acoustic signal includes a Swept
`sinusoid. This can have the effect that substantially each
`frequency within the range of the Swept-sinusoid that might
`be a resonant frequency is presented to the Surface 120 as
`part of an acoustic signal, with the effect that the surface 120
`can respond by relatively amplifying the resonant frequency
`components of that acoustic signal, and relatively damping
`non-resonant frequency components of that acoustic signal.
`In one embodiment, the surface 120 can include a flat
`Surface Such as a keyboard (or a flat object painted to look
`like a keyboard), a table, or some other object. While this
`application primarily describes surfaces 120 that are sub
`stantially flat and have substantially smooth layers, in the
`context of the invention, there is no particular requirement
`for any Such limitation. For example, one or more Such
`surfaces 120 could be curved, could have ribbed or ridged
`lines or other texture, or otherwise. As described herein, for
`example, one or more such surfaces 120 could also include
`cracks, leaks, studs, or other irregularities, with concomitant
`effect on the resonant frequencies of such surfaces 120.
`
`50
`
`45
`
`55
`
`60
`
`65
`
`8
`At a step 224, the surface 120 can receive the acoustic
`signal. This can have the effect that the surface 120 relatively
`amplifies the one or more frequencies included in the signal
`that are resonant frequencies of the surface 120, and rela
`tively dampens any frequencies that are not resonant fre
`quencies in the signal. For example, if the Surface 120 has
`a resonant frequency of about 1 KHZ, the surface 120
`provides a response (whether to an impulse vibration, a set
`of selected frequencies, a Swept-sinusoid, or otherwise) in
`which the resonant frequency is relatively pronounced.
`At a step 226, the frequency device 100 receives, from the
`Surface 120, one or more responses to the acoustic signal. In
`one embodiment, the frequency device 100 can analyze the
`response and determine resonant frequencies of the Surface
`120. For a first example, the frequency device 100 can
`determine each of the resonant frequencies of the Surface
`120, or can determine a resonant frequency of the Surface
`120 with the highest relative amplification. For a second
`example, the frequency device 100 can determine an
`impulse response of the surface 120, either in response to the
`resonant frequency (or frequencies) of the Surface 120, or in
`response to a comparison of the emitted acoustic signal with
`the received acoustic signal.
`At a step 228, the frequency device 100, in response to a
`result from the previous step, can determine one or more
`characteristics of the surface 120. For example, the fre
`quency device 100 can determine one of a shape, size, or
`construction material of the surface 120, in response to
`information about t