Electronic Patent Application Fee Transmittal
`
`Title of Invention:
`
`Dynamic Batching for Inference System for Transformer-Based Generation
`Tasks
`
`First Named Inventor/Applicant Name:
`
`Gyeongin Yu
`
`Attorney Docket Number:
`
`39192-50678/US
`
`Filed as Small Entity
`
`Filing Fees for Utility under 35 USC 111(a)
`
`Description
`
`Fee Code
`
`Quantity
`
`Sub-Total in
`
`USD(S)
`
`prime
`
`
`
`Basic Filing:
`
`Miscellaneous-Filing:
`
`LATE FILING FEE FOROATH ORDECLARATION
`
`2051 pfmofm
`
`Patent-Appeals-and-Interference:
`
`Post-Allowance-and-Post-Issuance:
`
`1 of 265
`
`Petitioner, EX1010
`IPR2024-01234
`
`Hugging Face,Inc., v. FriendliAI Inc.
`
`Petitioner, EX1010
`IPR2024-01234
`Hugging Face, Inc., v. FriendliAI Inc.
`
`1 of 265
`
`

`

`Extension-of-Time:
`
`Total in USD ($)
`
`Miscellaneous:
`
`2 of 265
`
`2 of 265
`
`

`

`
`
`aa a
`
`Electronic AcknowledgementReceipt
`
`Application Number:
`
`17542193
`
`International Application Number:
`
`Confirmation Number:
`
`1026
`
`Title of Invention:
`
`Dynamic Batching for Inference System for Transformer-Based Generation
`Tasks
`
`Paymentinformation:
`
`37 CFR 1.17 (Patent application and reexamination processjngyfegs)
`
`Deposit Account
`
`Authorized User
`
`192555
`
`Jae Yeon Baek
`
`The Director of the USPTO is hereby authorized to charge indicated fees and credit any overpaymentas follows:
`
`37 CFR 1.16 (National application filing, search, and examination fees)
`
`3 of 265
`
`

`

`37 CFR 1.19 (Document supply fees)
`
`37 CFR 1.20 (Post Issuance fees)
`
`37 CFR 1.21 (Miscellaneous fees and charges)
`
`File Listing:
`
`Pages
`Multi
`File Size(Bytes)/
`DocumentDescription
`Document
`
`
`
`Number Message Digest|Part/.zip|P (if appl.)
`
`1
`
`Fee Worksheet (SB06)
`
`fee-info.pdf
`
`6c1d704568058937fd51 b9b6cb0ef552fa4:
`df0e
`
`2
`
`
`
`
`New Applications Under 35 U.S.C. 111
`If a new application is being filed and the application includes the necessary componentsfora filing date (see 37 CFR
`1.53(b)-(d) and MPEP 506), a Filing Receipt (37 CFR 1.54) will be issued in due course and the date shownonthis
`AcknowledgementReceiptwill establish the filing date of the application.
`
`National Stage of an International Application under 35 U.S.C. 371
`If a timely submission to enter the national stage of an international application is compliant with the conditions of 35
`U.S.C. 371 and other applicable requirements a Form PCT/DO/EO/903indicating acceptanceof the application as a
`national stage submission under35 U.S.C. 371 will be issued in addition to the Filing Receipt, in due course.
`New International Application Filed with the USPTO as a Receiving Office
`If a new international application is being filed and the international application includes the necessary components for
`an international filing date (see PCT Article 11 and MPEP 1810), a Notification of the International Application Number
`and of the International Filing Date (Form PCT/RO/105)will be issued in due course, subject to prescriptions concerning
`national security, and the date shownon this AcknowledgementReceiptwill establish the international filing date of
`the application.
`
`Information:
`
`This AcknowledgementReceipt evidences receipt on the noted date by the USPTO ofthe indicated documents,
`characterized by the applicant, and including page counts, where applicable.It serves as evidence of receipt similar to a
`Post Card, as described in MPEP 503.
`
`4 of 265
`
`4 of 265
`
`

`

`Doc Code: TRACK1.REQ
`DocumentDescription: TrackOne Request
`
`PTO/AIA/424 (04-14)
`
`CERTIFICATION AND REQUESTFOR PRIORITIZED EXAMINATION
`UNDER 37 CFR 1.102(e) (Page 1 of 1)
`
`Dynamic Batching for Inference System for Transformer-Based Generation Tasks
`
`APPLICANT HEREBYCERTIFIES THE FOLLOWING AND REQUESTSPRIORITIZED EXAMINATION FOR
`THE ABOVE-IDENTIFIED APPLICATION.
`
`1. The processing fee set forth in 37 CFR 1.17(i)(1) and the prioritized examination fee setforth in
`37 CFR 1.17(c) have been filed with the request. The publication fee requirementis met
`becausethat fee, set forth in 37 CFR 1.18(d), is currently $0. The basic filing fee, search fee,
`and examination fee arefiled with the request or have been already been paid.
`| understand
`that any required excess claims fees or application size fee must be paid for the application.
`
`| understand that the application may not contain, or be amendedto contain, more than four
`independentclaims, more than thirty total claims, or any multiple dependent claims, and that
`any request for an extension of time will cause an outstanding Track | request to be dismissed.
`
`3. The applicable box is checked below:
`
`Original Application (Track One)
`
`- Prioritized Examination under § 1.102(e)(1
`
`i.
`
`(a) The application is an original nonprovisional utility application filed under 35 U.S.C. 111(a).
`This certification and requestis being filed with the utility application via EFS-Web.
`---OR---
`(b) The application is an original nonprovisional plant application filed under 35 U.S.C. 111(a).
`This certification and requestis being filed with the plant application in paper.
`
`An executed inventor’s oath or declaration under 37 CFR 1.63 or 37 CFR 1.64 for each
`inventor, or the application data sheet meeting the conditions specified in 37 CFR 1.53(f)(3)(i) is
`filed with the application.
`
`Request for Continued Examination - Prioritized Examination under § 1.102(e)(2)
`
`forms are submitted.
`
`A request for continued examination has beenfiled with, or prior to, this form.
`If the application is a utility application, this certification and requestis being filed via EFS-Web.
`iii. The application is an original nonprovisionalutility application filed under 35 U.S.C. 111(a), or is
`a national stage entry under 35 U.S.C. 3771.
`iv. This certification and requestis being filed prior to the mailing of a first Office action responsive
`to the request for continued examination.
`No prior requestfor continued examination has been granted prioritized examination status
`under 37 CFR 1.102(e)(2).
`
`
`
`signature/Jae Yeon Baek/
`Name
`Jae Yeon Baek
`(Print/Typed)
`
`pate PECember 3, 2021
`Practitioner
`78,258
`Registration Number
`
`This form must be signed in accordance with 37 CFR 1.33. See 37 CFR 1.4(d) for signature requirements and certifications.
`Note:
`Submit multiple forms if more than one signature is required.”
`
`*Total of
`
`1
`
`5 of 265
`
`5 of 265
`
`

`

`Privacy Act Statement
`
`The Privacy Act of 1974 (P.L. 93-579) requires that you be given certain information in connection with your
`submission of the attached form related to a patent application or patent. Accordingly, pursuant to the requirements of
`the Act, please be advised that: (1) the general authority for the collection of this information is 35 U.S.C. 2(b)(2); (2)
`furnishing of the information solicited is voluntary; and (3) the principal purpose for which the information is used by the
`U.S. Patent and Trademark Office is to process and/or examine your submission related to a patent application or
`patent.
`If you do not furnish the requested information, the U.S. Patent and Trademark Office may not be able to
`process and/or examine your submission, which may result in termination of proceedings or abandonmentof the
`application or expiration of the patent.
`
`The information provided by you in this form will be subject to the following routine uses:
`
`1. The information on this form will be treated confidentially to the extent allowed under the Freedom of
`Information Act (5 U.S.C. 552) and the Privacy Act (5 U.S.C 552a). Records from this system of records may
`be disclosed to the Departmentof Justice to determine whether disclosure of these records is required by the
`Freedom ofInformation Act.
`A record from this system of records maybe disclosed, as a routine use, in the course of presenting evidence
`to a court, magistrate, or administrative tribunal, including disclosures to opposing counsel in the course of
`settlement negotiations.
`A record in this system of records maybe disclosed, as a routine use, to a Member of Congress submitting a
`request involving an individual, to whom the record pertains, when the individual has requested assistance from
`the Member with respect to the subject matter of the record.
`A record in this system of records maybe disclosed, as a routine use, to a contractor of the Agency having
`needfor the information in order to perform a contract. Recipients of information shall be required to comply
`with the requirements of the Privacy Act of 1974, as amended, pursuantto 5 U.S.C. 552a(m).
`A record related to an International Application filed under the Patent Cooperation Treaty in this system of
`records maybe disclosed, as a routine use, to the International Bureau of the World Intellectual Property
`Organization, pursuant to the Patent Cooperation Treaty.
`A record in this system of records maybe disclosed, as a routine use, to another federal agency for purposes
`of National Security review (35 U.S.C. 181) and for review pursuantto the Atomic Energy Act (42 U.S.C.
`218(c)).
`A record from this system of records may be disclosed, as a routine use, to the Administrator, General
`Services, or his/her designee, during an inspection of records conducted by GSAaspart of that agency’s
`responsibility to recommend improvements in records managementpractices and programs, under authority of
`44 U.S.C. 2904 and 2906. Such disclosure shall be made in accordance with the GSA regulations governing
`inspection of records for this purpose, and any other relevant (/.e., GSA or Commerce) directive. Such
`disclosure shall not be used to make determinations about individuals.
`A record from this system of records may be disclosed, as a routine use, to the public after either publication of
`the application pursuant to 35 U.S.C. 122(b) or issuance of a patent pursuant to 35 U.S.C. 151. Further, a
`record may be disclosed, subject to the limitations of 37 CFR 1.14, as a routine use, to the public if the record
`wasfiled in an application which became abandonedor in which the proceedings were terminated and which
`application is referenced by either a published application, an application open to public inspection or an issued
`patent.
`A record from this system of records may be disclosed, as a routine use, to a Federal, State, or local law
`enforcement agency, if the USPTO becomes awareof a violation or potential violation of law or regulation.
`
`6 of 265
`
`6 of 265
`
`

`

`Doc Code: ECOMM.AUTH/ECOMM.WTDW
`Doc Description:
`Internet Communications Authorized/Internet Communications Authorization Withdrawn
`
`PTO/SB/439 (11-15)
`
`
`AUTHORIZATION FOR INTERNET|Application No. Not Yet Known
`
`
`COMMUNICATIONS IN A PATENT|Filing Date Herewith
`
`First Named Inventor Gyeongin Yu
`APPLICATION OR REQUEST TO
`
`WITHDRAW AUTHORIZATION FOR
`|AtUnit
`Not Yet Known
`INTERNET COMMUNICATIONS
`Examiner Name
`Practitioner Docket No.
`
`
`
` Not Yet Known
`
`|39192-50678/US
`
`forms are submitted.
`
`Commissioner for Patents
`P.O. Box 1450
`
`Alexandria, VA 22313-1450
`
`1. To authorize permission for Internet Communications.
`
`v | Recognizing that Internet communications are not secure, | hereby authorize the USPTO to communicate
`with the undersigned and practitioners in accordance with 37 CFR 1.33 and 37 CFR 1.34 concerning any subject
`matter of this application via video conferencing, instant messaging, or electronic mail. | understand that a copy of
`these communications will be made of record in the application file. (MPEP 502.03)
`
`Il. To withdraw authorization for Internet Communications.
`
`, to the USPTO to communicate with the undersigned and
`The authorization given on
`any practitioner in accordance with 37 CFR 1.33 and 37 CFR 1.34 concerning any subject matter of this application
`via Internet communications such as video conferencing, instant messaging, or electronic mail is hereby
`withdrawn. | understand that the withdrawal is effective when approved rather than when received.
`
`lam the
`
`applicant.
`
`
`attorney or agent of record. Registration number 78,258
`
`attorney or agent acting under 37 CFR 1.34. Registration number
`
`
`
`
`/Jae Yeon Baek/
`Signature
`
`December 3, 2021
`Date
`
`
`Jae Yeon Baek
`Typed or printed name
`
`(650) 335-7142
`Telephone Number
`
`NOTE: This form must be signed in accordance with 37 CFR 1.33. See 37 CFR 1.4 for signature requirements and certifications. Juristic entities
`must be represented by a patentpractitioner (see 37 CFR 1.31, which is applicable to any paper filed on or after September 16, 2012, thatis
`presented on behalf of a juristic entity, regardless of application filing date). Submit multiple forms if more than one signatureis required, see
`below*.
`
`* Total of
`
`1
`
`7 of 265
`
`7 of 265
`
`

`

`Privacy Act Statement
`
`The Privacy Act of 1974 (P.L. 93-579) requires that you be given certain information in connection
`with your submission of the attached form related to a patent application or patent. Accordingly,
`pursuant to the requirements of the Act, please be advised that:
`(1) the general authority for the
`collection of this information is 35 U.S.C. 2(b)(2); (2) furnishing of the information solicited is voluntary;
`and (3) the principal purpose for which the information is used by the U.S. Patent and Trademark
`Office is to process and/or examine your submission related to a patent application or patent.
`If you do
`not furnish the requested information,
`the U.S. Patent and Trademark Office may not be able to
`process and/or examine your submission, which may result
`in termination of proceedings or
`abandonmentof the application or expiration of the patent.
`
`The information provided by you in this form will be subject to the following routine uses:
`
`1. The information on this form will be treated confidentially to the extent allowed under the
`Freedom of Information Act (5 U.S.C. 552) and the Privacy Act (5 U.S.C 552a). Records from
`this system of records may be disclosed to the Department of Justice to determine whether
`disclosure of these records is required by the Freedom of Information Act.
`in the course of
`2. A record from this system of records may be disclosed, as a routine use,
`presenting evidence to a court, magistrate, or administrative tribunal, including disclosures to
`opposing counselin the course of settlement negotiations.
`to a Member of
`3. A record in this system of records may be disclosed, as a routine use,
`Congress submitting a requestinvolving an individual, to whom the record pertains, when the
`individual has requested assistance from the Member with respect to the subject matter of the
`record.
`4. A record in this system of records may be disclosed, as a routine use, to a contractor of the
`Agency having need for the information in order to perform a contract. Recipients of
`information shall be required to comply with the requirements of the Privacy Act of 1974, as
`amended, pursuant to 5 U.S.C. 552a(m).
`5. A record related to an International Application filed under the Patent Cooperation Treaty in
`this system of records may bedisclosed, as a routine use, to the International Bureau of the
`World Intellectual Property Organization, pursuant to the Patent Cooperation Treaty.
`6. A record in this system of records may be disclosed, as a routine use, to another federal
`agencyfor purposes of National Security review (35 U.S.C. 181) and for review pursuant to
`the Atomic Energy Act (42 U.S.C. 218(c)).
`7. Arecord from this system of records may be disclosed, as a routine use, to the Administrator,
`General Services, or his/her designee, during an inspection of records conducted by GSA as
`part of that agency’s responsibility to recommend improvements in records management
`practices and programs, under authority of 44 U.S.C. 2904 and 2906. Such disclosure shall
`be made in accordance with the GSA regulations governing inspection of records for this
`purpose, and anyother relevant (/.e., GSA or Commerce) directive. Such disclosure shall not
`be used to make determinations about individuals.
`8. A record from this system of records may be disclosed, as a routine use, to the public after
`either publication of the application pursuant to 35 U.S.C. 122(b) or issuance of a patent
`pursuant to 35 U.S.C. 151. Further, a record may be disclosed, subjectto the limitations of 37
`CFR 1.14, as a routine use,
`to the public if the record wasfiled in an application which
`became abandoned or in which the proceedings were terminated and which application is
`referenced by either a published application, an application open to public inspection or an
`issued patent.
`9. Arecord from this system of records may bedisclosed, as a routine use, to a Federal, State,
`or local
`law enforcement agency,
`if the USPTO becomes aware of a violation or potential
`violation of law or regulation.
`
`8 of 265
`
`8 of 265
`
`

`

`PTO/AIAI 4 (02-18)
`Approved for use through 11/30/2020. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unlessit contains a valid OMB control number.
`
` .
`
`. Attorney Docket Number|39192-50678/US
`
`
`Application Data Sheet 37 CFR 1.76
`
`Application Number
`
`
`
`Title of Invention|Dynamic Batching for Inference System for Transformer-Based Generation Tasks
`
`
`
`
`
`The application data sheetis part of the provisional or nonprovisional application for whichit is being submitted. The following form contains the
`bibliographic data arranged in a format specified by the United States Patent and Trademark Office as outlined in 37 CFR 1.76.
`This document may be completed electronically and submitted to the Office in electronic format using the Electronic Filing System (EFS) or the
`document may be printed and included in a paperfiled application.
`
`
`
`
`
`Secrecy Order 37 CFR 5.2:
`
`Oo Portions or all of the application associated with this Application Data Sheet may fall under a Secrecy Order pursuant to
`37 CFR 5.2 (Paperfilers only. Applications that fall under Secrecy Order may not be filed electronically.)
`
`Inventor Information:
`
`Inventor
`Legal Name
`
`{1
`
`Remove
`
` |Byeonginfeds
`
`ResidenceInformation (Select One)
`City
`
`US Residency
`e@ Non US Residency
`Active US Military Service
`Country of Residence eo]
`
`Mailing Address of Inventor:
`
`Address 1
`
`
`riendliAl Inc.
`
`Address 2
`Rm. 514, Bldg. 138, Gwanak-ro, Gwanak-gu
`
`city [Pet—SSSCSCSCSCS Ssatrovince||
`Postal Code|(08826|Countryi|KR
`Inventor
`[2
`Legal Name
`
`
`
`Middle Name
`Family Name
`Prefix} Given Name
`
`El Bere [Tf
`ResidenceInformation (Select One)
`US Residency
`@) Non US Residency
`Active US Military Service
`
`
`
`
`
`
`Mailing Addressof Inventor:
`
`|Rm. 514, Bldg. 138, Gwanak-ro, Gwanak-gu
`Address 2
`[Peo———SSSC_ StatePPrvince
`city
`Postal Code
`i 08826
`Country i
`KR
`Inventor
`8
`Legal Name
`
`EFS Web 2.2.13
`
`9 of 265
`
`9 of 265
`
`

`

`
`
`
`
`PTO/AIAI 4 (02-18)
`Approved for use through 11/30/2020. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
` Application Data Sheet 37 CFR 1.76
`
`Attorney Docket Number|39192-50678/US
`
`
`
`Title of Invention
`Dynamic Batching for Inference System for Transformer-Based Generation Tasks
`
`
`Application Number
`
` joo Seong
`
`eong|[ey] pecseong feng
`
`ResidenceInformation (Select One)
`US Residency
`@) Non US Residency
`Active US Military Service
`
`
`Mailing Address of Inventor:
`
`Address 1
`Address 2
`
`riendliAl Inc.
`|Rm. 514, Bldg. 138, Gwanak-ro, Gwanak-gu
`
`5P
`
`ostal Code|(08826|Countryi|kR
`Inventor
`4
`Legal Name
`
`Middle Name El eso fe
`
`ResidenceInformation (Select One)
`
`US Residency
`
`@) Non US Residency
`
`Active US Military Service
`
`Mailing Addressof Inventor:
`
`
`
`
`Address 2|(Rm. 514, Bldg. 138, Gwanak-ro, Gwanak-gu
`
`
`Postal Code
`
`
`
`Inventor
`Legal Name
`
`
`
`
`Prefix| Given Name
`
`
`
`Residence Information (Select One)
`US Residency
`(@) Non US Residency
`Active US Military Service
`City
`Country of Residence co]
`
`Middle Name
`
`Family Name
`
`Suffix
`
`
`Address 1
`
`
`Mailing Address of Inventor:
`
`
`riendliAl Inc.
`|Rm. 514, Bldg. 138, Gwanak-ro, Gwanak-gu
`
`Address 2
`
`
`
`J sintrovines
`Postal Code
`
`
`EFS Web 2.2.13
`
`10 of 265
`
`

`

`PTO/AIAI 4 (02-18)
`Approved for use through 11/30/2020. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
` Application Data Sheet 37 CFR 1.76
`
`Attorney Docket Number|39192-50678/US
`
`
`
`Title of Invention
`Dynamic Batching for Inference System for Transformer-Based Generation Tasks
`
`
`Application Number
`
`Inventor Information blocks may be
`Inventors Must Be Listed - Additional
`All
`generatedwithin this form by selecting the Add button.
`
`
`
`
`
`
`
`CorrespondenceInformation:
`
`Enter either Customer Numberor complete the Correspondence Information section below.
`Forfurther information see 37 CFR 1.33(a).
`[_] An Addressis being provided for the correspondence Information of this application.
`
`
`Customer Number
`
`
`
`
`|pioc@fenwick.com
`
`
`Email Address
`
`
`
`Application Information:
`
`
`Title of the Invention
`
`
`
`
`powezsooreus|SmallEntiyStatusClaimedBG
`Attorney Docket Number
`
`
`
`
`[PewomontCCS
`
`Application Type
`
`
`
`
`
`ty
`Subject Matter
`
`
`Total Number of Drawing Sheets (if any)
`Suggested Figure for Publication (if any)
`
`
`Filing By Reference:
`
`Only complete this section whenfiling an application by reference under 35 U.S.C. 111(c) and 37 CFR 1.57{a). Do not complete this section if
`
`application papers including a specification and any drawings are beingfiled. Any domestic benefit or foreign priority information must be
`providedin the appropriate section(s) below (i.e., "Domestic Benefit/National Stage Information” and “Foreign Priority Information”).
`
`
`
`Publication Information:
`[_] Request Early Publication (Fee required at time of Request 37 CFR 1.219)
`Request Not to Publish. | hereby requestthat the attached application not be published under
`35 U.S.C. 122(b) and certify that the invention disclosed in the attached application has not and will not be the
`subject of an application filed in another country, or under a multilateral international agreement, that requires
`publication at eighteen monthsafterfiling.
`
`For the purposesofa filing date under 37 CFR 1.53(b), the description and any drawings of the present application are replaced by this
`reference to the previously filed application, subject to conditions and requirements of 37 CFR 1.57(a}.
`
`
`
`
`Intellectual Property Authority or Country
`
`Application numberof the previously
`filed application
`
`i
`
`
`
`Representative Information:
`
`11 of 265
`
`Representative information should be provided for all practitioners having a power of attorney in the application. Providing
`this information in the Application Data Sheet does not constitute a power of attorney in the application (see 37 CFR 1.32).
`Either enter Customer Number or complete the Representative Name section below.If both sections are completed the customer
`Numberwill be used for the Representative Information during processing.
`
`EFS Web 2.2.13
`
`11 of 265
`
`

`

`PTO/AIAI 4 (02-18)
`Approved for use through 11/30/2020. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Attorney Docket Number|39192-50678/US
`
`Application Data Sheet 37 CFR 1.76
`
`Title of Invention
`
`Dynamic Batching for Inference System for Transformer-Based Generation Tasks
`
`
`
`
`
`
`
`
`Please Select One:
`
`
`@ Customer Number
`i n0758
`
`US Patent Practitioner
`
`C) Limited Recognition (37 CFR 11.9)
`
`Domestic Benefit/National Stage Information:
`
`This section allows for the applicant to either claim benefit under 35 U.S.C. 119(e), 120, 121, 365(c), or 386(c) or indicate
`National Stage entry from a PCT application. Providing benefit claim information in the Application Data Sheet constitutes
`the specific reference required by 35 U.S.C. 119(e) or 120, and 37 CFR 1.78.
`Whenreferring to the current application, please leave the “Application Number’field blank.
`
` Prior Application Status
`
`
`Filing or 371(c) Date
`
`(YYYY-MM-DD)
`Continuity Type
`
`
`
`Customer Number
`
`
`
`
`
`Application Number
`
`Prior Application Number
`
`Additional Domestic Benefit/National Stage Data may be generated within this form
`by selecting the Add button.
`
`Foreign Priority Information:
`
`This section allows for the applicant to claim priority to a foreign application. Providing this information in the application data sheet
`constitutes the claim for priority as required by 35 U.S.C. 119(b) and 37 CFR 1.55. Whenpriority is claimed to a foreign application
`that is eligible for retrieval under the priority document exchange program (PDX)! the information will be used by the Office to
`automatically attempt retrieval pursuant to 37 CFR 1.55(1)(1) and (2). Under the PDX program, applicant bears the ultimate
`responsibility for ensuring that a copy of the foreign application is received by the Office from the participating foreign intellectual
`property office, or a certified copy of the foreign priority application is filed, within the time period specified in 37 CFR 1.55(g)(1).
`
`Remove
`Access Codel (if applicable)
`
`Filing Date (YYYY-MM-DD)
`Country!
`Application Number
`
`Additional Foreign Priority Data may be generated within this form by selecting the
`Add button.
`
`Add
`
`Statement under 37 CFR 1.55 or 1.78 for AIA (First Inventor to File) Transition
`Applications
`
`This application (1) claims priority to or the benefit of an application filed before March 16, 2013 and (2) also
`contains, or contained at any time, a claim to a claimed invention that has an effective filing date on or after March
`[] 16, 2013.
`NOTE: Byproviding this statement under 37 CFR 1.55 or 1.78,this application, with a filing date on or after March
`16, 2013, will be examined underthefirst inventorto file provisions of the AIA.
`12 of265
`
`
`
`
`
`EFS Web 2.2.13
`
`12 of 265
`
`

`

`PTO/AIAI 4 (02-18)
`Approved for use through 11/30/2020. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`cat
`Application Data Sheet 37 CFR 1.76
`
`Title of Invention|Dynamic Batching for Inference System for Transformer-Based Generation Tasks
`
`
`
`Authorization or Opt-Out of Authorization to Permit Access:
`
`
`
`
`
`Whenthis Application Data Sheet is properly signed and filed with the application, applicant has provided written
`authority to permit a participating foreign intellectual property (IP) office access to the instant application-as-filed (see
`paragraph A in subsection 1 below) and the European Patent Office (EPO) access to any search results from the instant
`application (See paragraph B in subsection 1 below).
`
`Should applicant choose not to provide an authorization identified in subsection 1 below, applicant must opt-out of the
`authorization by checking the corresponding box A or B or both in subsection 2 below.
`
`NOTE: This section of the Application Data Sheet is ONLY reviewed and processed with the INITIALfiling of an
`application. After the initial filing of an application, an Application Data Sheet cannot be used to provide or rescind
`authorization for access by a foreign IP office(s).
`Instead, Form PTO/SB/39 or PTO/SB/69 must be used as appropriate.
`
`1. Authorization to Permit Access by a Foreign Intellectual Property Office(s)
`
`A. Priority Document Exchange (PDX)- Unless box A in subsection 2 (opt-out of authorization) is checked, the
`undersigned hereby grants the USPTO authority to provide the European Patent Office (EPO), the Japan Patent Office
`(JPO), the Korean Intellectual Property Office (KIP©), the State Intellectual Property Office of the People’s Republic of
`China (SIPO), the World Intellectual Property Organization (WIPO), and any other foreign intellectual property office
`participating with the USPTOin a bilateral or multilateral priority document exchange agreementin which a foreign
`application claiming priority to the instant patent application is filed, access to: (1) the instant patent application-as-filed
`andits related bibliographic data, (2) any foreign or domestic application to which priority or benefit is claimed by the
`instant application and its related bibliographic data, and (3) the date of filing of this Authorization. See 37 CFR 1.14(h)
`(1).
`
`B. Search Results from U.S. Application to EPO - Unless box B in subsection 2 (opt-out of authorization) is checked,
`the undersigned hereby grants the USPTO authority to provide the EPO accessto the bibliographic data and search
`results from the instant patent application when a European patent application claiming priority to the instant patent
`applicationis filed. See 37 CFR 1.14(h)(2).
`
`The applicant is reminded that the EPO’s Rule 141(1) EPC (European Patent Convention} requires applicants to submit a
`copy of search results from the instant application without delay in a European patent application that claims priority to
`the instant application.
`
`2. Opt-Out of Authorizations to Permit Access by a Foreign Intellectual Property Office(s)}
`
`[|
`
`A. Applicant DOES NOT authorize the USPTOto permit a participating foreign IP office access to the instant
`application-as-filed.
`If this box is checked, the USPTOwill not be providing a participating foreign IP office with
`any documents andinformation identified in subsection 1A above.
`
`B. Applicant DOES NOTauthorize the USPTOto transmit to the EPO any search results from the instant patent
`|] application. If this box is checked, the USPTO will not be providing the EPO with search results from the instant
`application.
`NOTE: Oncethe application has published or is otherwise publicly available, the USPTO may provide accessto the
`application in accordance with 37 CFR 1.14.
`
`EFS Web 2.2.13
`
`13 of 265
`
`13 of 265
`
`

`

`PTO/AIAI 4 (02-18)
`Approved for use through 11/30/2020. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`ee Attorney Docket Number|39192-50678/US
`
`Application Data Sheet 37 CFR 1.76
`
`— Title of Invention|Dynamic Batching for Inference System for Transformer-Based Generation Tasks
`
`Applicant Information:
`
`Providing assignment information in this section does not substitute for compliance with any requirementof part 3 of Title 37 of CFR
`to have an assignment recorded by the Office.
`
`{1
`Applicant
`If the applicant is the inventor (or the remaining joint inventor or inventors under 37 CFR 1.45), this section should not be completed.
`The information to be provided in this section is the name and addressof the legal representative whois the applicant under 37 CFR
`1.43; or the name and addressof the assignee, person to whom the inventor is under an obligation to assign the invention, or person
`who otherwise showssufficient proprietary interest in the matter who is the applicant under 37 CFR 1.46. If the applicantis an
`applicant under 37 CFR 1.46 (assignee, person to whem theinventoris obligated to assign, or person who otherwise showssufficient
`proprietary interest) together with one or morejoint inventors, then the joint inventor or inventors who are also the applicant should be
`identified in this section.
`
`
`Clear
`
`@ Assignee
`
`
`
`Legal Representative under 35 U.S.C. 117
`
`Joint Inventor
`
`Nameof the Deceased or Legally Incapacitated Inventor:Po
`If the Applicant is an Organization check here.
`Xx]
`
`Organization Name
`
`i riendliAl Inc.
`
`Person who showssufficient proprietary interest
`Person to whom the inventoris obligated to assign.
`
`lf applicant is the legal representative, indicate the authority to file the patent application, the inventor is:
`
`Mailing Address Information For Applicant:
`Address 1|Rm. 514, Bldg. 138, Gwanak-ro, Gwanak-gu
`;
`Fer SC~*dSSitePrvince|
`
`Address 2
`
`city
`
`
`
`Email Address
`
`
`PhoneNumber [|FaxNumber|
`I
`
`Additional Applicant Data may be generated within this form by selecting the Add button.
`
`Add
`
`EFS Web 2.2.13
`
`14 of 265
`
`
`
`14 of 265
`
`

`

`PTO/AIAI 4 (02-18)
`Approved for use through 11/30/2020. OMB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it contains a valid OMB control number.
`
`Attorney Docket Number|39192-50678/US
`
`
` Application Data Sheet 37 CFR 1.76
`
`
`Title of Invention
`Dynamic Batching for Inference System for Transformer-Based Generation Tasks
`
`Applicant b
`
`Application Number