(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2014/0191963 A1
`MURAKOSH et al.
`(43) Pub. Date:
`Jul. 10, 2014
`
`US 20140191963A1
`
`(54) APPARATUS AND METHOD FOR
`CONTROLLING AUSER INTERFACE OFA
`DEVICE
`
`(52) U.S. Cl.
`CPC .................................... G06F 3/0346 (2013.01)
`USPC .......................................................... 34.5/158
`
`(57)
`
`ABSTRACT
`
`(71) Applicant: SONY CORPORATION, Tokyo (JP)
`(72) Inventors: Sho MURAKOSHI, San Diego, CA
`S. stESSESS, Certain aspects of an apparatus and a method for controlling
`CA (US)
`a US interface of a device may comprise one or more sensors
`coupled to a vibratory Surface associated with the apparatus.
`(73) Assignee: SONY CORPORATION, Tokyo (JP)
`The one or more sensors may detect one or more vibrations of
`the vibratory surface caused by an interaction of an object
`(21) Appl. No.: 13/736,241
`with the vibratory surface. The one or more sensors may
`(22) Filed:
`Jan. 8, 2013
`generate one or more vibratory signals in response to the
`9
`detected one or more vibrations. One or more processors that
`Publication Classification
`are communicatively coupled to the one or more sensors may
`generate a control signal corresponding to the one or more
`generated vibratory signals to control the user interface of the
`device.
`
`(51) Int. Cl.
`G06F 3/0346
`
`(2006.01)
`
`
`
`08
`
`
`
`APPLE 1004
`
`1
`
`

`

`Patent Application Publication
`
`Jul. 10, 2014 Sheet 1 of 8
`
`US 2014/O191963 A1
`
`
`
`O2
`
`Device
`
`FIG.
`
`2
`
`

`

`Patent Application Publication
`
`Jul. 10, 2014 Sheet 2 of 8
`
`US 2014/O191963 A1
`
`y 04
`
`202
`
`Processor
`
`Receiver
`
`H to Y
`
`204
`
`
`
`22
`
`Sensor
`
`
`
`
`
`
`
`
`
`A/D Converter
`
`206
`
`208
`
`
`
`
`
`
`
`FIG. 2
`
`3
`
`

`

`Patent Application Publication
`
`Jul. 10, 2014 Sheet 3 of 8
`
`US 2014/O191963 A1
`
`O2
`
`
`
`Processor
`
`304
`
`Memory
`
`
`
`
`
`
`
`306
`
`
`
`
`
`30
`
`Transmitter
`
`
`
`o ? 04
`
`FIG. 3
`
`4
`
`

`

`Patent Application Publication
`
`Jul. 10, 2014 Sheet 4 of 8
`
`US 2014/O191963 A1
`
`
`
`
`
`
`
`5
`
`

`

`Patent Application Publication
`
`Jul. 10, 2014 Sheet 5 of 8
`
`US 2014/O191963 A1
`
`
`
`FIG. 5
`
`6
`
`

`

`Patent Application Publication
`
`Jul. 10, 2014 Sheet 6 of 8
`
`US 2014/O191963 A1
`
`602
`
`600
`
`Detect one or more vibrations of vibratory surface caused by an
`interaction of object with vibratory surface
`
`Generate one or more vibratory signals in response to detected
`vibration of vibratory surface
`
`Convert each of generated one or more vibratory signals into
`vibratory signal components
`
`Convert first vibratory signal component, second vibratory
`Signal component, and third vibratory signal component from
`analog form into digital form
`
`Generate first signal based on difference between first vibratory
`signal component and second vibratory signal component
`
`
`
`
`
`
`
`
`
`
`
`Generate second signal based on difference between one of first
`vibratory signal component or Second vibratory signal
`component and third vibratory signal component
`
`604
`
`606
`
`608
`
`610
`
`62
`
`64
`
`FIG 6A
`
`7
`
`

`

`Patent Application Publication
`
`Jul. 10, 2014 Sheet 7 of 8
`
`US 2014/O191963 A1
`
`/ 600
`
`Generate sample of each of generated first signal and
`generated second signal
`
`Transform each of generated Sample of first generated signal
`and generated Sample of second generated signal from time
`domain to frequency domain
`
`Normalize power of each of transformed sample of first
`generated signal and transformed Sample of Second
`generated signal
`
`
`
`
`
`
`
`Determine cross-correlation function between transformed
`sample of generated first signal and transformed sample of
`generated second signal
`
`Transform determined cross-correlation function from
`frequency domain to time domain
`
`66
`
`68
`
`620
`
`622
`
`624
`
`FIG. 6B
`
`8
`
`

`

`Patent Application Publication
`
`Jul. 10, 2014 Sheet 8 of 8
`
`US 2014/O191963 A1
`
`600
`
`Determine type of interaction of object with vibratory
`Surface based on transformed determined cross
`correlation function
`
`626
`
`Determine location that corresponds to interaction of
`object on vibratory surface based on determined cross
`correlation function
`
`628
`
`Determine vibration frequency corresponding to each
`of one or more vibratory signals generated by sensor
`
`630
`
`
`
`Generate control signal based on determined vibration
`frequency
`
`632
`
`634
`
`End
`
`FIG. 6C
`
`9
`
`

`

`US 2014/019 1963 A1
`
`Jul. 10, 2014
`
`APPARATUS AND METHOD FOR
`CONTROLLING AUSER INTERFACE OFA
`DEVICE
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS/INCORPORATION BY
`REFERENCE
`0001. This application makes reference to U.S. patent
`application Docket No. 201204500 (Ser. No.
`) filed on
`, which is hereby incorporated herein by reference in
`its entirety.
`
`FIELD
`0002 Various embodiments of the disclosure relate to a
`user interface. More specifically, various embodiments of the
`disclosure relate to an apparatus and method for controlling a
`user interface of a device.
`
`BACKGROUND
`0003. A user interface enables users to interact with
`devices. The user interface may be an input mechanism that
`enables a user to provide input to the device. The user inter
`face may also act as an output mechanism that allows the
`device to indicate results of the user input. Examples of the
`user interface may be a button, a touch screen, a Voice based
`user interface, a display screen, and the like. Generally, a user
`interface of a device may be integrated with the device or may
`be implemented on another device communicatively coupled
`to the device. Moreover, a user interface implemented using a
`certain technology may restrict the ways in which a user may
`interact with a device.
`0004 Further limitations and disadvantages of conven
`tional and traditional approaches will become apparent to one
`of skill in the art, through comparison of Such systems with
`Some aspects of the present disclosure as set forth in the
`remainder of the present application with reference to the
`drawings.
`
`SUMMARY
`0005. An apparatus and/or a method for controlling the
`user interface of a device Substantially as shown in and/or
`described in connection with at least one of the figures, as set
`forth more completely in the claims.
`0006. These and other features and advantages of the
`present disclosure may be appreciated from a review of the
`following detailed description of the present disclosure, along
`with the accompanying figures in which like reference
`numerals refer to like parts throughout.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`0007 FIG. 1 is a block diagram illustrating controlling a
`user interface of a device based on vibratory input, in accor
`dance with an embodiment of the disclosure.
`0008 FIG. 2 is a block diagram of an exemplary apparatus
`for controlling a user interface of a device, in accordance with
`an embodiment of the disclosure.
`0009 FIG. 3 is a block diagram of an exemplary device
`that may be controlled based on vibratory input, in accor
`dance with an embodiment of the disclosure
`0010 FIG. 4 is a diagram illustrating an example imple
`mentation of controlling a device within a vehicle, in accor
`dance with an embodiment of the disclosure.
`
`FIG. 5 is a diagram illustrating an example imple
`0011
`mentation of controlling a mobile phone based on vibratory
`input, in accordance with an embodiment of the disclosure.
`(0012 FIGS. 6A, 6B, and 6C are flow charts illustrating
`exemplary steps for generating a control signal in an appara
`tus for controlling a user interface of a device based on vibra
`tory input, in accordance with an embodiment of the disclo
`SUC.
`
`DETAILED DESCRIPTION
`0013 Certain implementations may be found in an appa
`ratus and/or a method for controlling a user interface of a
`device. The apparatus may detect one or more vibrations of a
`vibratory surface caused by an interaction of an object with
`the vibratory Surface. The apparatus may generate one or
`more vibratory signals in response to the detected one or more
`vibrations. The apparatus may generate a control signal cor
`responding to the one or more generated vibratory signals to
`control the user interface of the device.
`0014. The apparatus may convert each of the generated
`one or more vibratory signals into vibratory signal compo
`nents. Each of the converted vibratory signal components
`corresponds to a coordinate axis in a three-dimensional coor
`dinate system. The apparatus may generate a first signal based
`on a difference between a first vibratory signal component
`and a second vibratory signal component of the converted
`three vibratory signal components. The apparatus may gen
`erate a second signal based on a difference between one of the
`first vibratory signal component or the second vibratory sig
`nal component and a third vibratory signal component of the
`converted three vibratory signal components. The apparatus
`may determine the interaction of the object based on the
`generated first signal and the generated second signal. The
`apparatus may determine a location corresponding to the
`interaction of the object with the vibratory surface. The loca
`tion is determined based on the generated first signal and the
`generated second signal.
`0015 The apparatus may generate a sample of the gener
`ated first signal during a first pre-determined duration. The
`apparatus may generate a sample of the generated second
`signal during a second pre-determined duration. The appara
`tus may transform each of the generated samples of the gen
`erated first signal and the generated second signal from a time
`domain to a frequency domain. Each of the samples of the
`generated first signal and the generated second signal is gen
`erated by applying a window function to each of the generated
`first signal and the generated second signal. The apparatus
`may determine a cross-correlation between the transformed
`sample of the generated first signal and the transformed
`sample of the generated second signal. The apparatus may
`determine the location and/or the interaction based on the
`determined cross-correlation. The apparatus may determine a
`vibration frequency corresponding to each of the generated
`one or more vibratory signals based on one or more of a
`material of the vibratory surface, a type of the object, a type of
`the interaction, and/or a roughness of the vibratory Surface.
`The determined vibration frequency is indicative of an opera
`tion associated with the device.
`0016 FIG. 1 is a block diagram illustrating controlling a
`user interface of a device based on vibratory input, in accor
`dance with an embodiment of the disclosure. Referring to
`FIG. 1, there is shown a device 102, an apparatus 104 for
`controlling a user interface of the device 102, a vibratory
`
`10
`
`

`

`US 2014/019 1963 A1
`
`Jul. 10, 2014
`
`surface 106 associated with the apparatus 104, and an object
`108 for interacting with the vibratory surface 106.
`0017. The device 102 may correspond to a machine that
`may be operated by a user. The device 102 may perform one
`or more operations when operated by a user. The device 102
`may be an electrical device, a mechanical device, an elec
`tronic device, and/or a combination thereof. Examples of the
`device 102 may include, but are not limited to, mobile phones,
`laptops, tablet computers, televisions, Personal Digital Assis
`tant (PDA) devices, vehicles, home appliances, media play
`ing devices, and/or any other device operable by a user.
`0018. The apparatus 104 may comprise suitable logic, cir
`cuitry, interfaces, and/or code that may be operable to control
`the user interface of the device 102 based on an interaction of
`the object 108 with the vibratory surface 106. Based on the
`interaction, a user may control one or more operations of the
`device 102.
`0019. In an embodiment, the apparatus 104 may be com
`municatively coupled with the device 102 via a wired or
`wireless communication network. Examples of the commu
`nication network may include, but are not limited to, a Blue
`tooth network, a Wireless Fidelity (Wi-Fi) network, and/or a
`ZigBee network. In another embodiment, the apparatus 104
`may be integrated with the device 102.
`0020. The vibratory surface 106 may correspond to any
`Surface capable of generating vibrations. The vibratory Sur
`face 106 may be composed of various materials such as wood,
`glass, plastic, metal, cardboard, concrete, and the like.
`Examples of such vibratory surface 106 may include, but are
`not limited to, a table top, a wall, a cover of the device, and/or
`any Surface capable of generating vibrations.
`0021. The apparatus 104 may be coupled to the vibratory
`surface 106. In an embodiment, the apparatus 104 may be
`fixed on the vibratory surface 106. For example, a table top
`may be used as the vibratory surface 106. The apparatus 104
`may be fixed above and/or below the table top. In another
`embodiment, the apparatus 104 may be embedded in the
`vibratory surface 106. In another example, a dashboard of a
`vehicle may correspond to the vibratory surface 106. The
`apparatus 104 may be fixed to and/or embedded in the dash
`board. In another embodiment, the vibratory surface 106 may
`be an integrated part of the apparatus 104. For example, the
`cover of the apparatus 104 may correspond to the vibratory
`surface 106. Notwithstanding, the disclosure may not be so
`limited and any part of the body of the apparatus 104 may
`correspond to the vibratory surface 106 without limiting the
`Scope of the disclosure. In an embodiment, any part of a
`surface may correspond to the vibratory surface 106. For
`example, the entire surface of the table top to which the
`apparatus 104 is coupled may be designated as the vibratory
`surface 106. In another embodiment, a pre-defined region of
`a surface may correspond to the vibratory surface 106. For
`example, a pre-defined region of the body of the apparatus
`104 may be designated as the vibratory surface 106.
`0022. A user may interact with the vibratory surface 106 in
`many ways using one or more objects, such as the object 108.
`Examples of the object 108 may include, but are not limited
`to, a finger of a user, a finger nail of a user, a stylus, and/or any
`object capable of interacting with and producing vibrations
`on the vibratory surface 106. Examples of the interaction of
`the object 108 with the vibratory surface 106 may include, but
`are not limited to Scratching or tapping on the vibratory Sur
`face 106 using the object 108, and/or sliding or dragging the
`object 108 on the vibratory surface 106.
`
`0023. In an embodiment, the vibratory surface 106 may be
`a composite surface made up of different types of materials.
`In another embodiment, one or more properties of a region of
`the vibratory Surface 106. Such as roughness, thickness, and
`the like, may vary from of one or more properties of another
`region of the vibratory surface 106. The apparatus 104 may be
`operable to generate different control signals that correspond
`to one or more interactions performed at different regions of
`the vibratory surface 106. For example, a region near the
`center of a table may have more roughness than the regions of
`the table near the corners. The apparatus 104 may generate a
`control signal to Switch on a lamp placed on the table when a
`user may scratch on the center of the table. Similarly, a control
`signal that corresponds to Scratching near the corners may
`switch off the lamp.
`0024 FIG. 2 is a block diagram of an exemplary apparatus
`for controlling a user interface of a device, in accordance with
`an embodiment of the disclosure. The block diagram of FIG.
`2 is described in conjunction with the block diagram of FIG.
`1
`0025 Referring to FIG. 2, there is shown the apparatus
`104. The apparatus 104 may comprise one or more proces
`sors, such as a processor 202, a memory 204, one or more
`sensors, such as a sensor 206, an analog to digital converter
`208 (hereinafter referred to as A/D converter 208), a receiver
`210, and a transmitter 212.
`0026. The processor 202 may be communicatively
`coupled to the memory 204, the A/D converter 208, and the
`sensor 206. Further, the receiver 210 and the transmitter 212
`may be communicatively coupled to the processor 202, the
`memory 204, the sensor 206, and the A/D converter 208.
`0027. The processor 202 may comprise suitable logic, cir
`cuitry, and/or interfaces that may be operable to execute at
`least one code section stored in the memory 204. The proces
`sor 202 may be implemented based on a number of processor
`technologies known in the art. Examples of the processor 202
`may include, but are not limited to, an X86-based processor,
`a Reduced Instruction Set Computing (RISC) processor, an
`Application-Specific Integrated Circuit (ASIC) processor,
`and/or a Complex Instruction Set Computer (CISC) proces
`SO
`0028. The memory 204 may comprise suitable logic, cir
`cuitry, interfaces, and/or code that may be operable to store a
`machine code and/or a computer program having the at least
`one code section executable by the processor 202. Examples
`of implementation of the memory 204 may include, but are
`not limited to, Random Access Memory (RAM), Read Only
`Memory (ROM), Hard Disk Drive (HDD), and/or a Secure
`Digital (SD) card. The memory 204 may further be operable
`to store data, Such as configuration settings of the apparatus
`104, settings of the sensor 206, frequency-operation mapping
`data, and/or any other data.
`0029. The sensor 206 may comprise suitable logic, cir
`cuitry, interfaces, and/or code that may be operable to detect
`one or more vibrations of the vibratory surface 106. The one
`or more vibrations may be caused by an interaction of the
`object 108 with the vibratory surface 106. The sensor 206
`may be operable to generate one or more vibratory signals in
`response to the detected one or more vibrations. Examples of
`the sensor 206 may include, but are not limited to, an accel
`erometer, a gyroscope, an ultra-Sonic sensor, a microphone,
`and/or any sensor operable to detect vibrations of the vibra
`tory Surface 106 and generate vibratory signals in response to
`the detected vibrations.
`
`11
`
`

`

`US 2014/019 1963 A1
`
`Jul. 10, 2014
`
`0030. In an embodiment, the sensor 206 may be an integral
`part of the apparatus 104. The apparatus 104 may be coupled
`to the vibratory surface 106 in such a manner that the sensor
`206 may be in contact with the vibratory surface 106. In
`another embodiment, the sensor 206 may be external to the
`apparatus 104. The sensor 206 may be coupled to and/or
`embedded in the vibratory surface 106. In an embodiment, the
`apparatus 104 may be communicatively coupled to the sensor
`206 via a wired or wireless communication medium. In an
`embodiment, a manufacturer of the apparatus 104 may
`specify position of the sensor 206 on the vibratory surface
`106. In another embodiment, a user associated with the appa
`ratus 104 may customize the position of the sensor 206 on the
`vibratory surface 106. Examples of the communication
`medium may include, but are not limited to, a Bluetooth
`network, a Wireless Fidelity (Wi-Fi) network, and/or a Zig
`Bee network.
`0031. The A/D converter 208 may comprise suitable logic,
`circuitry, interfaces, and/or code that may be operable to
`convert a vibratory signal into a digital vibratory signal.
`Examples of the A/D converter 208 may include, but are not
`limited to, a Flash A/D converter, a Sigma-Delta A/D con
`verter, a Dual slope A/D converter, and/or a Successive
`approximation A/D converter.
`0032. The receiver 210 may comprise suitable logic, cir
`cuitry, interfaces, and/or code that may be operable to receive
`data and messages. The receiver 210 may receive data in
`accordance with various known communication protocols. In
`an embodiment, the receiver 210 may receive the vibratory
`signal generated by the sensor 206 external to the apparatus
`104. The receiver 210 may implement known technologies
`for Supporting wired or wireless communication between the
`apparatus 104 and the sensor 206 external to the apparatus
`104.
`0033. The transmitter 212 may comprise suitable logic,
`circuitry, interfaces, and/or code that may be operable to
`transmit data and/or messages. The transmitter 212 may
`transmit data, in accordance with various known communi
`cation protocols. In an embodiment, the transmitter 212 may
`transmit a control signal to control the user interface of the
`device 102.
`0034. In operation, the apparatus 104 may be coupled to
`the vibratory surface 106 such that the sensor 206 may be in
`contact with the vibratory surface 106. A user may interact
`with the vibratory surface 106 using the object 108. The
`apparatus 104 may allow a user to control the user interface of
`the device 102 based on the interaction with the vibratory
`Surface 106. In an embodiment, a user may interact at any
`location on the entire vibratory surface 106 to control the user
`interface of the device 102. In another embodiment, a user
`may interact at any location within the pre-defined region of
`the vibratory surface 106 to control the user interface of the
`device 102. In an embodiment, a user may interact with the
`vibratory surface 106 using a finger. In another embodiment,
`a user may interact with the vibratory surface 106 using a nail
`of the finger. In another embodiment, a user may interact with
`the vibratory surface 106 using the skin of the finger.
`0035. In an embodiment, a user may scratch and/or tap at
`any location on the vibratory surface 106 using the object 108,
`Such as the nail of the finger. In another embodiment, a user
`may slide and/or drag the object 108 across the vibratory
`surface 106. In another embodiment, a user may perform a
`gesture at any location on the vibratory Surface 106 using the
`
`object 108. Examples of the gesture may include, but are not
`limited to, drawing a shape and/or drawing an alphanumeric
`character.
`0036. In response to the interaction of the object 108 with
`the vibratory surface 106, the sensor 206 may sense vibra
`tions generated in the vibratory surface 106. The sensor 206
`may generate one or more vibratory signals that correspond to
`the sensed vibrations. The processor 202 may generate a
`control signal that corresponds to the generated one or more
`vibratory signals to control the user interface of the device
`102.
`0037. In an embodiment, the sensor 206 may be a 3-axis
`gyroscope. The 3-axis gyroscope may be operable to deter
`mine acceleration that corresponds to vibrations produced in
`the vibratory surface 106. The sensor 206 may be operable to
`generate the one or more vibratory signals that correspond to
`the determined acceleration.
`0038. The processor 202 may be operable to convert each
`of the generated one or more vibratory signals into vibratory
`signal components. Each converted vibratory signal compo
`nent may correspond to a coordinate axis in a three-dimen
`sional coordinate system. For example, a first vibratory signal
`component, of the converted vibratory signal components,
`may be along the X-axis of the three-dimensional coordinate
`system. A second vibratory signal component, of the con
`Verted vibratory signal components, may be along the Y-axis
`of the three-dimensional coordinate system. A third vibratory
`signal component, of the converted vibratory signal compo
`nents, may be along the Z-axis of the three-dimensional coor
`dinate system. Notwithstanding, the disclosure may not be so
`limited and the first vibratory signal component, the second
`vibratory signal component, and the third vibratory signal
`component may be along any of the X-axis, the Y-axis and the
`Z-axis of the three-dimensional coordinate system without
`limiting the Scope of the disclosure.
`0039. In an embodiment, each of the first vibratory signal
`component, the second vibratory signal component, and the
`third vibratory signal component may be in an analog form.
`The A/D converter 208 may be operable to convert the first
`vibratory signal component, the second vibratory signal com
`ponent, and the third vibratory signal component from the
`analog form into a digital form. In an embodiment, the first
`vibratory signal component, the second vibratory signal com
`ponent, and the third vibratory signal component may be
`represented as signals in time domain.
`0040. The processor 202 may generate a first signal based
`on a difference between the first vibratory signal component
`and the second vibratory signal component. The processor
`202 may generate a second signal based on a difference
`between one of the first vibratory signal component or the
`second vibratory signal component, and the third vibratory
`signal component. For example, the processor 202 may gen
`erate a first signal based on a difference between the second
`vibratory signal component along the Y-axis and the third
`vibratory signal component along the Z-axis. The processor
`202 may generate a second signal based on a difference
`between the third vibratory signal component along the
`Z-axis and a first vibratory signal component along the
`X-axis. The processor 202 may determine a type of the inter
`action based on the generated first signal and the generated
`second signal. The processor 202 may determine a location
`that corresponds to the interaction with the vibratory surface
`106 based on the generated first signal and the generated
`Second signal.
`
`12
`
`

`

`US 2014/019 1963 A1
`
`Jul. 10, 2014
`
`0041. In an embodiment, the processor 202 may generate
`a sample of the generated first signal during a first pre-deter
`mined duration. The processor 202 may generate a sample of
`the generated second signal during a second pre-determined
`duration. In an embodiment, the first pre-determined duration
`and the second pre-determined duration may be equal. In
`another embodiment, the first pre-determined duration and
`the second pre-determined duration may be different. In an
`embodiment, the processor 202 may generate the sample of
`each of the first generated signal and the second generated
`signal by applying a window function to time domain signals
`that correspond to each of the first generated signal and the
`second generated signal. Examples of such window functions
`may include, but are not limited to, a Hanning window func
`tion, a Hamming window function, a rectangular window
`function, a Gaussian window function, and/or other window
`functions. Notwithstanding, the disclosure may not be so
`limited and any method may be used to generate the sample of
`each of the first generated signal and the second generated
`signal, without limiting the scope of the disclosure.
`0042. The processor 202 may transform each of the gen
`erated samples of the first generated signal and the second
`generated signal from the time domain to the frequency
`domain. In an embodiment, the processor 202 may perform
`the transformation by applying a Fast Fourier Transformation
`to each of the generated samples of the first generated signal
`and the second generated signal. The processor 202 may
`normalize power of each of the transformed samples of the
`first generated signal and the second generated signal.
`0043. The processor 202 may determine a cross-correla
`tion function between the transformed samples of the gener
`ated first signal and the generated second signal. In an
`embodiment, the processor 202 may determine the cross
`correlation function by applying a Generalized Cross-Corre
`lation (GCC) function using the Phase Transform (GCC
`PHAT).
`0044) The processor 202 may transform the determined
`cross-correlation function from the frequency domain to the
`time domain. In an embodiment, the processor 202 may trans
`form the determined cross-correlation function from the fre
`quency domain to the time domain by applying an Inverse
`Fast Fourier Transformation.
`0045. In an embodiment, the processor 202 may deter
`mine the type of the interaction of the object 108 with the
`vibratory surface 106 based on the transformed cross-corre
`lation function. In an embodiment, when the transformed
`cross-correlation function is at a maximum level, the proces
`sor 202 may determine the type of the interaction to be
`equivalent to scratching on the vibratory surface 106.
`0046. In an embodiment, the processor 202 may deter
`mine the location that corresponds to the interaction of the
`object 108 with the vibratory surface 106 based on the deter
`mined cross-correlation function. In an embodiment, the pro
`cessor 202 may determine the location of the sensor 206 on
`the vibratory surface 106.
`0047. In an embodiment, the processor 202 may deter
`mine a vibration frequency that corresponds to each of the one
`or more vibratory signals generated by the sensor 206. The
`processor 202 may determine the vibration frequency based
`on one or more of: a material of the vibratory surface 106, a
`type of the object 108, a type of the interaction, and/or a
`roughness of the vibratory surface 106. The determined
`vibration frequency is indicative of an operation associated
`with the device 102.
`
`0048. The processor 202 may generate the control signal
`based on the determined vibration frequency. The control
`signal indicates an operation of the device 102 to be con
`trolled in response to the interaction. The processor 202 may
`communicate the generated control signal to the device 102
`via the transmitter 212. The device 102 may process the
`received control signal and perform the operation indicated
`by the control signal. In an embodiment, the processor 202
`may determine a control signal that corresponds to the deter
`mined vibration frequency based on frequency-operation
`mapping data stored in the memory 204. The frequency
`operation mapping data may specify an operation of the
`device 102 to be controlled in response to a vibration fre
`quency of a vibratory signal.
`0049. In an embodiment, the frequency-operation map
`ping data may be pre-defined. In an embodiment, the manu
`facturer associated with the apparatus 104 may define an
`operation of the device 102 to be controlled that corresponds
`to a vibratory signal produced in response to an interaction of
`the object 108 with the vibratory surface 106. In another
`embodiment, a user operating the apparatus 104 may define
`an operation of the device 102 to be controlled that corre
`sponds to a vibratory signal produced in response to an inter
`action of the object 108 with the vibratory surface 106. In an
`embodiment, the manufacturer and/or the user may define an
`operation of the device 102 to be controlled corresponding to
`a type of the interaction. For example, the manufacturer and/
`or the user may define the vibration frequency that corre
`sponds to scratching on the vibratory surface 106 that may
`indicate volume control operation of a television. Hence, by
`scratching on the vibratory Surface 106, a user may control
`Volume of the television. In another embodiment, the manu
`facturer and/or the user may define an operation of the device
`102 to be controlled corresponding to a location of the inter
`action on the vibratory surface 106. For example, the manu
`facturer and/or the user may define the vibration frequency
`that corresponds to tapping within a pre-defined region on the
`vibratory surface 106 that may indicate channel change
`operation of the television. Thus, by tapping within the pre
`defined region on the vibratory surface 106, the user may
`change channels of the television. In another embodiment, a
`user may customize a pre-defined mapping defined by the
`manufacturer.
`0050. In an embodiment, a user may perform a gesture on
`the vibratory surface 106. To perform the gesture, a user may
`perform a plurality of interactions at a plurality of locations
`on the vibratory surface 106. The sensor 206 may generate a
`plurality of vibratory signals in response to the plurality of
`interactions. The processor 202 may determine a location that
`corresponds to each of the plurality of the vibratory signals.
`The processor 202 may identify the gesture based on the
`determined locations. The processor 202 may generate a con
`trol signal that corresponds to the determined gesture. For
`example, a user may interact with a home appliance by draw
`ing a circle on the vibratory surface 106 by scratching. The
`processor 202 may generate a control signal that corresponds
`to the circle drawn. The control signal may switch on and/or
`switch off the home appliance.
`0051. In an embodiment, the apparatus 104 may be oper
`able to interact with a plurality of devices using the vibratory
`surface 106. For example, the processor 202 may interact
`with a mobile device based on the generation of a control
`signal that corresponds to