Doc Code: PD.TO.AUTH
`Document Description: Authorization to access Appl. by Trilateral Office
`
`PTOJSB/39 (07-09)
`Approved for use th'ough {i'i’fH1i'?.01?, OMB G551-G031
`U.S. Patent and Trademark Office; iJ.S. DEPARTMENT OF COMMFRCE
`Under the Paperwork Reduction Ac: of 1995, no oersons are required to respond to a collection of information unless it ciispiays a valid OMB oonlro: number.
`COMPLETE IF KNOWN
`
`A”""“°R'ZAT'°” T° '°ER""'T
`ACCESS TC AF’F"-'CAT'CN BY
`PARTICIPATING OFFICES
`
`Send completed form to: Commissioner for Patents
`PO. Box 1450, Alexandria. VA 2231 3~1 450
`
`Title
`Re - uirect
`
`METHOD ANDAFPARATUS roe PRoouciNcAoviwwi:c HAPTIC EFFECT
`
`The undersigned hereby grants the USPTO authority to provide the European Patent Office (EPO), the
`Japan Patent Office (JPO), the Korean lntellectuai Property Office (KIPO), the World lnteliectual Property
`Office (WIPO), and any other inteltectual property offices in which a foreign application claiming priority to
`the above-identified patent application is filed access to the above-identified patent application. See
`37 CFR 1.14(c) and (
`).
`
`in accordance with 37 CFR 1.14(h)(3), access will be provided to a copy of the above—identified application
`with respect to: 1) the above—identified patent application-as-filed; 2) any foreign application to which the
`above-identified patent application claims priority under 35 U.S.C. 119(3)-(d) if a copy of the foreign
`application that satisfies the certified Copy requirement of 37 CFR 1.55 has been fited in the above-
`identified patent application; and 3) any U.S. app|ication—as-filed from which benefit is sought in the above-
`identified patent application.
`
`In accordance with 37 CFR 1.14(c), access may be provided to information concerning the date of filing the
`Authorization to Permit Access to Application by Participating Offices.
`
`This written authorization should be submitted prior to the filing of a subsequent foreign application, in
`which priority is ctaimod to the above-identified patent application, with any intellectual property office (e.g.,
`the EPO, JPO, KIPO, or DAS Accessing Office). However, if applicant does not wish the EPO, JPO, KIPO,
`WIPO, or other intellectual property office in which a foreign application ctaiming priority to the above-
`identified patent application is filed to have access to the above-identified patent application, this written
`authorization shouid not be filed.
`
`No fee will be charged under 37 CFR 1.19(b)(1) for providing a participating intellectual property office with
`an electronic copy of the above-identified patent application.
`
`This form must be signed by an authorized party in accordance with 37 CFR1.14( ).
`
`/Thomas A. Hassingl
`Signature
`
`Thomas A. Hassing
`Printed or Typed Name
`
`2012-05-16
`Date
`
`408-467-1900
`Telephone Number
`
`36,159
`Registration Number, if applicable
`
`This collection of information is required by 3? CFR 1.14{h). The information is required to obtain or retain a benefit by the public which is ‘.0 fits (and by
`the USP EU to process an apptication). Contidenlaiity is governed by 35 U.S.C. 122 and 37 CFR 1.11 and 1.14. This collection is estmated to take 6
`maoutes to complete, inctudirtg gathertng, oreparing, and submitting the comoleted apoicatic-n form to the USPTO. Time WEE vary depending upon the
`indivicluat case. Any comments on the amount of time you require to complete this form andfor suggestions for reducirg this burden. should be sent to
`the Chief lnfctrralion Ofticer, US, Patent and Trademark Ofttce, US. Department of Commerce, t-’.U. Box 1450A Atexantfia. VA 22313-1450. DO NOT
`SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`
`if you need assistance in compieting the form. calf ‘I-800-PTO-9199 and select option 2.
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0001
`
`

`
`Privacy Act Statement
`
`The Privacy Act of 1974 (P.L. 93-579) requires that you be given certain information in
`connection with your submission of the attached form related to a patent application or patent.
`Accordingly, pursuant to the requirements of the Act, please be advised that: (l) the general
`authority for the collection of this information is 35 U .S.C. 2(b)(2)', (2) furnishing of the
`information solicited is voliuitaiy; and (3) the principal purpose for which the information is used
`by the U.S. Patent and Trademark Office is to process and./or examine your submission related to
`a patent application or patent. if you do not furnish the requested information, the [L8, Patent and
`Trademark Office may not be able to process and/or examine your submission, which may result
`in termination of proceedings or abandonment of the application or expiration of the patent.
`
`The information provided by you in this form will be subject to the following routine uses:
`
`1. The information on this form will be treated confidentially to the extent allowed under
`the Freedom ol"lnformation Act (5 U.S.C. 552) and the Privacy Act (5 USC. 552a).
`Records from this system of records may be disclosed to the Department of Justice to
`determine whether the Freedom of Information Act requires disclosure of these records.
`A record from this system of records may be disclosed, as a routine use, in the course of
`presenting evidence to a court, magistrate, or administrative tribunal, including
`disclosures to opposing counsel in the course of settlement negotiations.
`A record in this system of records may be disclosed, as a routine use, to a Member of
`Congress submitting a request involving an individual, to whom the record pertains,
`when the individual has requested assistance from the Member with respect to the subject
`matter of the record.
`
`A record in this system of records may be discéosed, as a routine use, to a contractor of
`the Agency having need for the information in order to perform a contract. Recipients of
`information shall be required to comply with the requirements of the Privacy Act of
`1974, as amended, pursuant to 5 U.S.C. 552a(m).
`A record related to an International Application filed under the Patent Cooperation Treaty
`in this system of records may be disclosed, as a routine use, to the International Bureau of
`the World lntcllcctuai Property Organization, pursuant to the Patent Cooperation Treaty.
`A record in this system of records may be disclosed, as a routine use, to another federal
`agency for purposes of National Security review (35 U.S.C. 181) and for review pursuant
`to the Atomic Energy Act (42 U.S.C. 21 8(0)).
`A record from this system of records may be disclosed, as a routine use, to the
`Administrator, General Services, or hisfher designee, during an inspection of records
`conducted by GSA as part of that agency's responsibility to recommend improvements in
`records management practices and programs, under authority of 44 U .S.C. 2904 and
`2906. Such disclosure shall be made in accordance with the GSA regulations governing
`inspection of records for this purpose, and any other relevant (i.e., GSA or Commerce)
`directive. Such disclosure shall not be used to make determinations about individuals.
`
`A record from this system of records may be disclosed, as a routine use, to the public
`after either publication ofthe application pursuant to 35 U.S.C. 122(1)) or issuance ofa
`patent pursuant to 35 U.S.C. 151. Further, a record may be disclosed, subject to the
`limitations of37 CPR 1.14, as a routine use, to the public if the record was filed in an
`application which became abandoned or iii which the proceedings were terminated and
`which application is referenced by either a published application, an application open to
`public inspections or an issued patent.
`A record from this system of records may be disclosed, as a routine use, to a Federal,
`State, or local law eltforcerncnt agency, if the IQSPTO becomes aware of a violation or
`potential violation of law or regulation.
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0002
`
`

`
`FOR
`UTILITY
`ORIGINAL
`DECLARATION
`
`RULE 83 (37 C.F.R.1.63)
`DECLARATION AND POWER OF ATTORNEY
`FOR PATENT APPLICATION
`FN THE UNiTED STATES PATENT AND TRADEMARK OFFICE
`
`As a below named invenlcr(s), ilwe hereby declare tnat:
`Th’s declaration is directed to:
`
`K!
`
`I:|
`
`The attached application, or
`
`United States application or PCT international application number
`
`flied on D2I15/2012
`
`[I
`
`As amended on
`
`(if app icablel:
`
`Ifwe believe that iwe am/are the original and first inventor(s) of the subject matter which is ctaimed and for which a patent is sought;
`
`I.-‘we have reviewed and understand the contents of the above-identified application, including the claims, as amended by any amendment specificaily
`referred to above. I acknowledge the duty to disclose to the Office all information known to me to be material to patentabllity as defined in 37 C.F.R.
`1.56. Except as noted below, I hereby claim foreign priority benefits under 35 U.S.C. 1‘l9(a)-(d) or 365th) of any foreign appticationts) for patent or
`inventofls certificate, or 365(a) of any PCT international Application which designated at ieast one other country than the United States. tisted below
`and have also identified below any foreign application for patent or Inventor's certificate, or PCT lnzernationai Application, tiled by me or my assignee
`disclosing the subject matter cialmed in this application and having a tiling date (1) before that or’ the application on which priority is claimed, or {'2} it no
`priority claimed, before the IIIIt‘It_._:l date of this application:
`
`PRiOR FOREIGN AF'PLICATlONtSl
`Number
`Country
`
`Filed
`
`Date First Laid Open
`_ Or Pubiished
`_I
`I
`I1“
`l
`"
`l—"
`‘I1!-J(e) or 120 andlor 365(5) of the iiidiuated Un.ted States apptications listed be'ow and
`I hereby claim domestic priority benefit under 35 U.S.C.
`Except as noted below,
`PCT international ?tppII(‘.EII§Ctt‘I5 listed above or below and, if this is a continuation-in-pert tCi5‘ } apptcatlon, insofar as the subject matter disclosed and claimed in this
`aopitcation is in addition to that rlisslosed in such prior applications,
`i acknowledge the duty to disclose to the Office all
`infoI'tTIalEun known to me to be material to
`ofthis bpplicatton:
`patentability as defined in 3?‘ C.F.R. 1.55 which became available between the filing date of each such prior application and the national or PCT Enternationat filing date
`
`Date Patented or
`Granted
`
`Priority
`Claimed
`
`PRIOR U.S. PROVtStCiNAL, NONPROVESIONAL ANDIOR PCT APPLICATION S
`Apptication Number
`Filed
`
`61/599,145
`
`I2/15/2012
`
`Status
`pendlnghabandoned. atented
`pending
`
`Priority Claimed
`__
`_
`
`yes
`
`I hereby dectare that at! statements made herein o’ my own knowiedge are true and that all statements made on information and befefare believed to he true; and
`further that these statements were made Wtlh the knowledge that waittul false statements and the iike so made are punishable by fine or imprasonment, or both, under
`Section 1001 of‘titte 18 ot the United States Code and that such wiillui false staterrents Tiayjeopardtze the validity of the spptication or any patent issued thereon,
`
`And I/we hereby appoint immersion, [to whom all communications are to be directed), and persons of that firm who are associated with USPTO
`Customer No 103772 'ndividuaIly and cotlectively myiour attorneys to prosecute this application and to transact ail business in the Patent and
`Trademark Office connected therewith and with the resulting patent, and llwe hereby author"ze them to delete trom that Customer No. names of
`persons no longer with their firm. to add new persons of their Firm to that Customer No., and to act and rely on instructions from and communicate
`directly with the persontassigneetattorneyitinnl’ organization who/which first sends/sent this case to them and by whomfwhich I/we hereby declare that
`ltwe have consented after fuli disclosure to be represented unlesstuntit I/we instruct the above Firm andior an attorney of that Hrm in writing to the
`contrary,
`
`Power of Attorney to Customer Number
`
`1 0 3 7
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0003
`
`

`
`BIRNBAUM
`Famil Name
`
`Slate/Forein Couni
`
`Cnuni
`
`of-Siiézenshi
`
`Middle Initiai
`
`CRUZ-HERNANDEZ
`Famif Name
`
`State/Fuuei n Count
`
`Count
`
`of Citizenshi
`
`State.'Forein Countrv
`
`I
`
`Count
`
`of Cilizenshi -
`
`|NVENTOR’5 SIGNATU RE:
`
`Residence
`
`Maiiing Address
`
`|NVENTOR’S SINATU RE:
`
`Mailing Address
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0004
`
`

`
`FNVENTOR'S SIGNATURE:
`
`Date:
`
`— 8IRNBAuM
`Firsl
`Middie Initial
`Famil Name
`
`——
`Stale/Fore-in Count
`Ciiy
`
`Maiiing Address
`
`,‘HJ
`
`JNVENTOR’S SIGNATURE:
`
`,/Q1} 4'”
`
`Residence
`
`Mailing Acfclress
`
`l|’~EVE.NTOR’S EHGNATURE:
`
`*£ ‘:2 ‘1 D $ K C.“ 'C<;;3.'\m an HR. W” L‘ S‘,
`C. <.',:..r\ cg. Q3» F\
`
`\U\o<\’\ -"C; ti»
`
`Name
`
`.
`
`Firs
`Middle Initial
`—‘Cit
`S1ale=.!FnrHi nCn-.mt
`Mamng Adciress
`
`Count
`
`ofcilizenshi
`
`FarnEL Name
`
`Count
`
`efcuizenshipn
`
`JNVENTOR’S S!GNATURE:
`
`— ULLRICH
`First
`
`Mailing Address
`
`Sta!e.'F0re§ n Cnunl
`
`Court!
`
`of Citizenship
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0005
`
`

`
`lNVENTOR’S SIGNATURE:
`
`Residence
`
`Mailing Address
`
`INVENTDFFS SIGNATURE:
`
`’
`=
`
`Flfiil
`Middie liwilfal
`
`Mailing Address
`
`i
`
`LF1
`d‘RuE-HERNANDE.z
`e
`
`I
`
`i
`
`E
`
`I
`
`INVENTDWS SJGNATURE:
`
`First
`Middle lnitiai
` j E
`
`Maniing Aadress
`
`'€1"1l— pptDmfl9(C~§
`U!-3,;ru,__
`‘
`i
`
`Q
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0006
`
`

`
`Residence
`
`Mailing Address
`
`|NVENTOR’S SEGNATURE:
`
`
`Mailing Address
`
`iNVENTOR’S SIGNATURE:
`
`Date:
`
` — GRANT
`‘
`'
`Middle Initial
`Residence
`
`Farnil ' Name
`
`Count
`
`' of Citizenshi
`
`Mailing Address
`
`Cit
`
`Slate/Foreign Counz
`
`Count
`
`of Ciiizenshi
`
`First
`
`Middle Enifiiai
`
`CRUZ-HERNANDEZ
`Farnii Name
`
`eC
`
`State/Forei ncoum
`
`Countl" r_1fCiEizenshi
`
`it
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0007
`
`

`
`Electronic Patent Application Fee Transmittal
`
`Title of Invention:
`
`METHOD AND APPARATUS FOR PRODUCING A DYNAMIC HAPTIC EFFECT
`
`First Named Inventor/Applicant Name:
`
`David Birnbaum
`
`Filer:
`
`Catherine C. Maresh/Dawn Rose
`
`Attorney Docket Number:
`
`IMM389C1
`
`Filed as Large Entity
`
`Trackl Prioritized Examination - Nonprovisional Application under 35 USC 111(a) Filing Fees
`
`Description
`
`Fee Code
`
`Quantity
`
`Sub-Total in
`USD(S)
`
`Basic Filing:
`
`Utility Search Fee
`
`Utility Examination Fee
`
`Request for Prioritized Examination
`
`1
`
`620
`
`1111
`
`1311
`
`620
`
`250
`
`Claims in excess of2O
`
`Miscellaneous-Filing:
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0008
`
`

`
`Description
`
`Quantity
`
`Publ. Fee- early, voluntary, or normal
`
`Processing Fee, except for Provis. apps
`
`1
`
`130
`
`Sub-Total in
`USD($)
`
`300
`
`130
`
`Patent-Appeals-and-Interference:
`
`Post-Allowance-and-Post-Issuance:
`
`Extension-of-Time:
`
`Miscellaneous:
`
`Total in USD ($)
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0009
`
`

`
`Electronic Acknowledgement Receipt
`
`12790702
`
`Confirmation Number:
`
`Title of Invention:
`
`METHOD AND APPARATUS FOR PRODUCING A DYNAMIC HAPTIC EFFECT
`
`First Named Inventor/Applicant Name:
`
`David Birnbaum
`
`Customer Number:
`
`103772
`
`Filer Authorized By:
`
`Catherine C. Maresh
`
`Attorney Docket Number:
`
`|MM389C1
`
`Time Stamp:
`
`12:22:57
`
`Application Type:
`
`Utility under 35 USC 111(a)
`
`Payment information:
`
`Submitted with Payment
`
`Payment Type
`
`Payment was successfully received in RAM
`RAM confirmation Number
`
`Deposit Account
`
`Authorized User
`
`Electronic Funds Transfer
`
`$7080
`
`Document
`Number
`
`Document Description
`
`File Size(Bytes)/
`Message Digest
`
`Pages
`Multi
`Part /.zip (ifappl.)
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0010
`
`

`
`|MM389C'| FIN/-\L.pdf
`
`9349U(P11hPha§8U737P07lT/fiela781((3d
`16225
`
`967757
`
`Multipart Description/PDF files in .zip description
`
`Document Description
`
`Specification
`
`Claims
`
`Drawings-only black and white line drawings
`
`Information:
`
`|MM389C1filetransmittalspdf
`
`623119
`
`ddbS7e15d1c95299fDD74b7696b4aa(5144
`98fl7
`
`Document Description
`
`Application Data Sheet
`
`Transmittal Letter
`
`TrackOne Request
`
`Authorization to access Appl. by Trilateral Office
`
`Oath or Declaration filed
`
`Warnings:
`
`Fee Worksheet (SBO6)
`
`Fee-info.pdf
`
`fd253l;:ae89d876efe6b38e64/I56139ab15e
`B:ae0
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0011
`
`

`
`This Acknowledgement Receipt evidences receipt on the noted date by the USPTO of the indicated documents,
`characterized by the applicant, and including page counts, where applicable. It serves as evidence of receipt similar to a
`Post Card, as described in MPEP 503.
`
`New Applications Under 35 U.S.C. 111
`lfa new application is being filed and the application includes the necessary components for a filing date (see 37 CFR
`1.53(b)-(d) and MPEP 506), a Filing Receipt (37 CFR 1.54) will be issued in due course and the date shown on this
`Acknowledgement Receipt will establish the filing date of the application.
`
`National Stage of an International Application under 35 U.S.C. 371
`lfa timely submission to enter the national stage of an international application is compliant with the conditions of 35
`U.S.C. 371 and other applicable requirements a Form PCT/DOIEOI903 indicating acceptance of the application as a
`national stage submission under 35 U.S.C. 371 will be issued in addition to the Filing Receipt, in due course.
`
`New International Application Filed with the USPTO as a Receiving Office
`lfa new international application is being filed and the international application includes the necessary components for
`an international filing date (see PCT Article 11 and MPEP 1810), a Notification of the International Application Number
`and ofthe International Filing Date (Form PCT/R0/105) will be issued in due course, subject to prescriptions concerning
`national security, and the date shown on this Acknowledgement Receipt will establish the international filing date of
`the application.
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0012
`
`

`
`Docket No: lMM389C1
`
`UNITED STATES PATENT APPLICATION
`
`FOR
`
`METHOD AND APPARATUS FOR PRODUCING A DYNAMIC HAPTIC
`
`EFFECT
`
`INVENTOR:
`
`DAVID BIRNBAUM
`
`JUAN MANUEL CRUZ-HERNANDEZ
`
`DANNY GRANT
`
`CHRIS ULLRICH
`
`PREPARED BY:
`
`IMMERSION CORPORATION
`
`ASSIGNEEI
`
`IMMERSION CORPORATION
`
`30 RIO ROBLES
`
`SAN JOSE, CA 95134
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0013
`
`

`
`Patent
`Docket No. |MM389C1
`
`METHOD AND APPARATUS FOR PRODUCING A DYNAMIC HAPTIC EFFECT
`
`CROSS-REFERENCE TO RELATED APPLICATION
`
`[0001]
`
`This application claims the benefit of priority under 35 USC § 120 to
`
`copending application 61/599,145, filed February 15, 2012.
`
`FIELD OF THE INVENTION
`
`[0002]
`
`One embodiment is directed generally to a user interface for a device,
`
`and in particular to producing a dynamic haptic effect using two or more gesture
`
`signals or real or virtual device sensor signals.
`
`BACKGROUND INFORMATION
`
`[0003]
`
`Electronic device manufacturers strive to produce a rich interface for
`
`users. Conventional devices use visual and auditory cues to provide feedback to a
`
`user.
`
`In some interface devices, kinesthetic feedback (such as active and resistive
`
`force feedback) and/or tactile feedback (such as vibration, texture, and heat) is also
`
`provided to the user, more generally known collectively as “haptic feedback” or
`
`“haptic effects”. Haptic feedback can provide cues that enhance and simplify the
`
`user interface. Specifically, vibration effects, or vibrotactile haptic effects, may be
`
`useful in providing cues to users of electronic devices to alert the user to specific
`
`events, or provide realistic feedback to create greater sensory immersion within a
`
`simulated or virtual environment.
`
`[0004]
`
`In order to generate vibration effects, many devices utilize some type of
`
`actuator or haptic output device. Known haptic output devices used for this purpose
`
`include an electromagnetic actuator such as an Eccentric Rotating Mass (“ERM”) in
`
`which an eccentric mass is moved by a motor, a Linear Resonant Actuator (“LRA”) in
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0014
`
`

`
`Patent
`Docket No. |MM389C1
`
`which a mass attached to a spring is driven back and forth, or a “smart material"
`
`such as piezoelectric, electro-active polymers or shape memory alloys. Haptic output
`
`devices also broadly include non-mechanical or non-vibratory devices such as those
`
`that use electrostatic friction (ESF), ultrasonic surface friction (USF), or those that
`
`induce acoustic radiation pressure with an ultrasonic haptic transducer, or those that
`
`use a haptic substrate and a flexible or deformable surface, or those that provide
`
`projected haptic output such as a puff of air using an air jet, and so on.
`
`[0005]
`
`Traditional architectures
`
`that provide haptic feedback only with
`
`triggered effects are available, and must be carefully designed to make sure the
`
`timing of
`
`the haptic feedback is correlated to user initiated gestures or system
`
`animations. However, because these user gestures and system animations have
`
`variable timing, their correlation to haptic feedback may be “static" and inconsistent
`
`and therefore less compelling to the user. Further, device sensor information is
`
`typically not used in combination with gestures to produce haptic feedback.
`
`[0006]
`
`Therefore,
`
`there is a need for an improved system of providing a
`
`dynamic haptic effect that includes multiple gestures or animations. There is a further
`
`need for providing haptic feedback with gestures in combination with device sensor
`
`information.
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0015
`
`

`
`Patent
`Docket No. |MM389C1
`
`SUMMARY OF THE INVENTION
`
`[0007]
`
`One embodiment is a system that produces a dynamic haptic effect
`
`and generates a drive signal that includes two or more gesture signals. The haptic
`
`effect is modified dynamically based on the gesture signals. The haptic effect may
`
`optionally be modified dynamically by using the gesture signals and two or more real
`
`or virtual device sensor signals such as from an accelerometer or gyroscope, or by
`
`signals created from processing data such as still images, video or sound.
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0016
`
`

`
`Patent
`Docket No. |MM389C1
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0008]
`
`FIG.
`
`1
`
`is a block diagram of a haptically-enabled system according to
`
`one embodiment of the present invention.
`
`[0009]
`
`FIG. 2 is a cut-away perspective view of an LRA implementation of a
`
`haptic actuator according to one embodiment of the present invention.
`
`[00010]
`
`FIG. 3 is a cut-away perspective view of an ERM implementation of a
`
`haptic actuator according to one embodiment of the present invention.
`
`[00011]
`
`FIGs. 4A-4C are views of a piezoelectric implementation of a haptic
`
`actuator according to one embodiment of the present invention.
`
`[00012]
`
`FIG. 5 is a view of a haptic device using electrostatic friction (ESF)
`
`according to one embodiment of the present invention.
`
`[00013]
`
`FIG. 6 is a view of a haptic device for inducing acoustic radiation
`
`pressure with an ultrasonic haptic transducer according to one embodiment of the
`
`present invention.
`
`[00014]
`
`FIG. 7 is a view of a haptic device using a haptic substrate and flexible
`
`or deformable surface according to one embodiment of the present invention.
`
`[00015]
`
`FIG. 8 is a view of a haptic device using ultrasonic surface friction
`
`(USF) according to one embodiment of the present invention.
`
`[00016]
`
`FIGs. 9A-9C are screen views of a user initiated dynamic haptic effect
`
`according to one embodiment of the present invention.
`
`[00017]
`
`FIGs. 10A-10B are screen views of example dynamic effects according
`
`to one embodiment of the present invention.
`
`[00018]
`
`FIGs. 11A-11F are screen views of a physics based dynamic effect
`
`according to one embodiment of the present invention.
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0017
`
`

`
`Patent
`Docket No. |MM389C1
`
`[00019]
`
`FIG. 12 is a diagram showing an example free space gesture
`
`according to one embodiment of the present invention.
`
`[00020]
`
`FlGs. 13A-13B are graphs showing a grid size variation as a function of
`
`velocity according to one embodiment of the present invention.
`
`[00021]
`
`FIG. 14 is a graph showing an effect period value as a function of
`
`velocity according to one embodiment of the present invention.
`
`[00022]
`
`FIG. 15 is a graph showing an animation duration as a function of a
`
`distance from center according to one embodiment of the present invention.
`
`[00023]
`
`FIG. 16 is a graph showing an animation duration as a function of a
`
`fling velocity according to one embodiment of the present invention.
`
`[00024]
`
`FIG. 17 is a graph showing a haptic effect magnitude as a function of a
`
`velocity according to one embodiment of the present invention.
`
`[00025]
`
`FIG. 18 is a graph showing an animation trajectory for a fall into place
`
`effect according to one embodiment of the present invention.
`
`[00026]
`
`FIG. 19 is a flow diagram for producing a dynamic haptic effect
`
`according to one embodiment of the present invention.
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0018
`
`

`
`Patent
`Docket No. |MM389C1
`
`DETAILED DESCRIPTION
`
`[00027]
`
`As described below, a dynamic haptic effect refers to a haptic effect
`
`that evolves over time as it responds to one or more input parameters. Dynamic
`
`haptic effects are haptic or vibrotactile effects displayed on haptic devices to
`
`represent a change in state of a given input signal. The input signal can be a signal
`
`captured by sensors on the device with haptic feedback,
`
`such as position,
`
`acceleration, pressure, orientation, or proximity, or signals captured by other devices
`
`and sent to the haptic device to influence the generation of the haptic effect.
`
`[00028]
`
`A dynamic effect signal can be any type of signal, but does not
`
`necessarily have to be complex. For example, a dynamic effect signal may be a
`
`simple sine wave that has some property such as phase, frequency, or amplitude
`
`that is changing over time or reacting in real time according to a mapping schema
`
`which maps an input parameter onto a changing property of the effect signal. An
`
`input parameter may be any type of input capable of being provided by a device, and
`
`typically may be any type of signal such as a device sensor signal. A device sensor
`
`signal may be generated by any means, and typically may be generated by capturing
`
`a user gesture with a device. Dynamic effects may be very useful
`
`for gesture
`
`interfaces, but the use of gestures or sensors are not necessarily required to create
`
`a dynamic signal.
`
`In the context of dynamic effects, a mapping is a method to
`
`convert the sensed information into a haptic effect by modifying one or several haptic
`
`effect parameters.
`
`[00029]
`
`One common scenario that does not
`
`involve gestures directly is
`
`defining the dynamic haptic behavior of an animated widget. For example, when a
`
`user scrolls a list,
`
`it is not typically the haptification of the gesture that will feel most
`
`intuitive, but instead the motion of the widget in response to the gesture. In the scroll
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0019
`
`

`
`Patent
`Docket No. |MM389C1
`
`list example, gently sliding the list may generate a dynamic haptic feedback that
`
`changes according to the speed of the scrolling, but flinging the scroll bar may
`
`produce dynamic haptics even after the gesture has ended. This creates the illusion
`
`that
`
`the widget has some physical properties and it provides the user with
`
`information about the state of the widget such as its velocity or whether it
`
`is in
`
`motion.
`
`[00030]
`
`A gesture is any movement of the body that conveys meaning or user
`
`intent.
`
`It will be recognized that simple gestures may be combined to form more
`
`complex gestures. For example, bringing a finger into contact with a touch sensitive
`
`surface may be referred to as a “finger on” gesture, while removing a finger from a
`
`touch sensitive surface may be referred to as a separate “finger off" gesture.
`
`If the
`
`time between the “finger on” and “finger off” gestures is
`
`relatively short,
`
`the
`
`combined gesture may be referred to as “tapping"; if the time between the “finger on"
`
`and “finger off" gestures is relatively long, the combined gesture may be referred to
`
`as “long tapping”; if the distance between the two dimensional (x,y) positions of the
`
`“finger on” and “finger off” gestures is relatively large, the combined gesture may be
`
`referred to as “swiping”; if the distance between the two dimensional (x,y) positions
`
`of the “finger on” and “finger off" gestures is relatively small, the combined gesture
`
`may be referred to as “smearing", “smudging" or “flicking”. Any number of two
`
`dimensional or three dimensional simple or complex gestures may be combined in
`
`any manner to form any number of other gestures,
`
`including, but not
`
`limited to,
`
`multiple finger contacts, palm or fist contact, or proximity to the device. A gesture can
`
`also be any form of hand movement
`
`recognized by a device having an
`
`accelerometer, gyroscope, or other motion sensor, and converted to electronic
`
`signals. Such electronic signals can activate a dynamic effect, such as shaking
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0020
`
`

`
`Patent
`Docket No. |MM389C1
`
`virtual dice, where the sensor captures the user intent that generates a dynamic
`
`effect.
`
`[00031]
`
`FIG.
`
`1
`
`is a block diagram of a haptically-enabled system 10 according
`
`to one embodiment of the present invention. System 10 includes a touch sensitive
`
`surface 11 or other type of user interface mounted within a housing 15, and may
`
`include mechanical keys/buttons 13.
`
`Internal
`
`to system 10 is a haptic feedback
`
`system that generates vibrations on system 10.
`
`In one embodiment, the vibrations
`
`are generated on touch surface 11.
`
`[00032]
`
`The haptic feedback system includes a processor 12. Coupled to
`
`processor 12 is a memory 20 and an actuator drive circuit 16, which is coupled to a
`
`haptic actuator 18. Processor 12 may be any type of general purpose processor, or
`
`could be a processor specifically designed to provide haptic effects, such as an
`
`app|ication—specific integrated circuit
`
`(“ASIC”). Processor 12 may be the same
`
`processor that operates the entire system 10, or may be a separate processor.
`
`Processor 12 can decide what haptic effects are to be played and the order in which
`
`the effects are played based on high level parameters.
`
`In general, the high level
`
`parameters that define a particular haptic effect include magnitude, frequency and
`
`duration. Low level parameters such as streaming motor commands could also be
`
`used to determine a particular haptic effect. A haptic effect may be considered
`
`dynamic if
`
`it includes some variation of these parameters when the haptic effect is
`
`generated or a variation of these parameters based on a user’s interaction.
`
`[00033]
`
`Processor 12 outputs the control signals to drive circuit 16 which
`
`includes electronic components and circuitry used to supply actuator 18 with the
`
`required electrical current and voltage to cause the desired haptic effects. System 10
`
`may include more than one actuator 18, and each actuator may include a separate
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0021
`
`

`
`Patent
`Docket No. |MM389C1
`
`drive circuit 16, all coupled to a common processor 12. Memory device 20 can be
`
`any type of storage device or computer-readable medium, such as random access
`
`memory (RAM) or
`
`read-only memory (ROM). Memory 20 stores instructions
`
`executed by processor 12. Among the instructions, memory 20 includes an actuator
`
`drive module 22 which are instructions that, when executed by processor 12,
`
`generate drive signals for actuator 18 while also determining feedback from actuator
`
`18 and adjusting the drive signals accordingly. The functionality of module 22 is
`
`discussed in more detail below. Memory 20 may also be located internal
`
`to
`
`processor 12, or any combination of internal and external memory.
`
`[00034]
`
`Touch surface 11 recognizes touches, and may also recognize the
`
`position and magnitude or pressure of
`
`touches on the surface. The data
`
`corresponding to the touches is sent to processor 12, or another processor within
`
`system 10, and processor 12 interprets the touches and in response generates
`
`haptic effect signals. Touch surface 11 may sense touches using any sensing
`
`technology,
`
`including capacitive sensing, resistive sensing, surface acoustic wave
`
`sensing, pressure sensing, optical sensing, etc. Touch surface 11 may sense multi-
`
`touch contacts and may be capable of distinguishing multiple touches that occur at
`
`the same time. Touch surface 11 may be a touchscreen that generates and displays
`
`images for the user to interact with, such as keys, dials, etc., or may be a touchpad
`
`with minimal or no images.
`
`[00035]
`
`System 10 may be a handheld device, such as a cellular telephone,
`
`PDA, computer tablet, gaming console, etc. or may be any other type of device that
`
`provides a user interface and includes a haptic effect system that includes one or
`
`more ERMs, LRAs, electrostatic or other types of actuators. The user interface may
`
`be a touch sensitive surface, or can be any other type of user interface such as a
`
`APPLE INC.
`EXHIBIT 1007 - PAGE 0022
`
`

`
`Patent
`Docket No. |MM389C1
`
`mouse,
`
`touchpad, mini-joystick,
`
`scroll wheel,
`
`trackball, game pads or game
`
`controllers, etc.
`
`In embodiments with more than one actu