PTOISB/05 (O4-04)
`Approved for use through 07/31/2006. OMB 0651-0032
`US. Patent and Trademark Office. U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number.
`
`—L
`U1
`)
`0')
`
`®0
`
`UTILITY
`
`PATENT APPLICATION
`
`TRANSMITTAL
`(Only for new nonprovisional applications under 37 C.F.R. 1.53(b))
`
`
`
`9432-°°°386
`Hongxing Hu, et al.
`
`HUMAN MACHINE INTERFACE METHOD AND DEVICE
`FOR CELLULAR TELEPHONE OPERATION IN
`AUTOMOTIVE INFOTAINMENT SYSTEMS
`
`APPLICATION ELEMENTS
`See MPEP chapter 600 concerning utility patent application contents.
`
`ADDRESS T0_-
`
`Commissioner for Patents
`P.0. Box 1450
`Alexandria VA 22313-1450
`
`Fee Transmittal Fonn (e.g., PTO/SB/17)
`(Submit an original and a duplicate for fee processing)
`Applicant claims small entity status.
`See 37 CFR 1.27.
`
`[Total Pages Q
`Specification
`(preferred arrangement set forth below)
`Specification
`- Descriptive title of the invention
`8
`- Cross Reference to Related Applications
`— Statement Regarding Fed sponsored R & D
`- Reference to sequence listing, a table,
`or a computer program listing appendix
`- Background of the Invention
`- Brief Summary of the Invention
`- Brief Description of the Drawings ( if filed)
`- Detailed Description
`- Claim(s)
`- Abstract of the Disclosure
`
`filed in English
`
`7. D CD-ROM or CD-R in duplicate, large table or
`Computer Program (Appendix)
`8. Nucleotide and/or Amino Acid Sequence Submission
`{if applicable, all necessary)
`a. D Computer Readable Form (CRF)
`b,
`Specification Sequence Listing on:
`i. I] CD-ROM or CD-R (2 copies); or
`“I D Paper
`c. [I Statements veri
`
`in '
`
`113000U.S.PO
`
`051906
`
`9. E]
`10. E]
`
`Assignment Papers (cover sheet & document(s))
`37 C.F.R. 3.73(b) Statement
`E] Power of
`(when there is an assignee)
`Attorney
`
`1
`
`[Total Sheets §
`4. E Drawing(s) (35 u.s.c.113)
`[Total Sheets
`5. Oath or Declaration
`a. C] Newly executed (original or copy)
`b. E] Copy from a prior application (37 CFR 1.63 (d))
`(for a continuation/divisional with Box 18 completed)
`i. E] DELETION OF INVENTORQS)
`Signed statement attached deleting inventor(s)
`named in the prior application, see 37 CFR
`1.63(d)(2) and 1.33(b).
`
`6. [Z] Application Data Sheet. See 37 CFR 1.76
`
`17. C]
`
`D Copies of IDS
`Citations
`
`English Translation Document (if applicable)
`lnfonnation Disclosure
`Statement (IDS)/PTO-1449
`Preliminary Amendment
`Return Receipt Postcard (MPEP 503)
`(Should be specifically itemized)
`Certified Copy of Priority Document(s)
`(if foreign priority is claimed)
`Nonpublication Request under 35 U.S.C. 122
`(b)(2)(B)(i). Applicant must attach form PTOlSB/35
`or its equivalent.
`Other:
`
`18. If a CONTINUING APPLICATION, check appropriate box, and supply the requisite information below and in the first sentence of the
`specification following the title, or in an Application Data Sheet under 37 CFR 1. 76:
`of prior application No:
`C! Continuation
`E] Divisional
`C] Continuation—in-part (CIP)
`Art Unit:
`Prior application information:
`Examiner
`For CONTINUATION or DIVISIONAL APPS only: The entire disclosure of the prior application, from which an oath or declaration is supplied under Box 5b,
`is considered a part of the disclosure of the accompanying or divisional application and is hereby incorporated by reference. The Incorporation can only
`be relied upon when a portion has been inadvertently omitted from the submitted application parts.
`19. CORRESPONDENCE ADDRESS
`
`l
`
`8 Customer Number
`
`52800
`
`OR I]
`
`Correspondence address below
`
`Name
`
`Address
`
`Cny
`
`C°“’"’Y
`
`Harness, Dickey & Pierce, P.L.C.
`
`P.O. Box 828
`
`Bloomfield Hills
`United States of America
`
`Name (Print/Type)
`
`Jennifer S. Brooks
`
`ea._
`248-641-160°
`Registration No. (Attomey/Agent)
`
`48303
`
`248-641-0270
`
`@
`/.
`This collection of information is re red by 37 CFR 1.53(b). The information is required to obtain or retain a benefit by the public which is to file (and by the USPTO to
`process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This collection is estimated to take 12 minutes to complete, including gathering,
`preparing, and submitting the completed application form to the USPTO. Time will vary depending upon the individual case. Any comments on the amount of time you
`require to complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S. Patent and Trademark Office, U.S.
`Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Mail Stop
`Patent Application, Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`If you need assistance in completing the form, call 1-800-PTO-9199 and select option 2.
`
`May 19, 2006
`
`Samsung Ex. 1304 p. 32
`Ev 853 856 352 us
`
`Samsung Ex. 1304 p. 32
`
`

`
`
`
`’
`
`"
`
`
`
`PTO/SB/17 (01 -06)
`Approved for use through 07/31/2006. OMB 0651-0032
`US. Patent and Trademark Office: U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number.
`
`Complete if Known
`
`
`Fees pursuant to the Consolidated Appropriations Act, 2005 (H. R. 4818).
`FEE TRANSMITTAL
`for FY 2005
`U APP"°a"*°'a""SSma''°“‘"VS*a‘“S- 39937 CFR ‘-27
`
`
`
`
`
`TOTAL AMOUNT OF PAYMENT
`
`($) 2400
`
`
`
`METHOD OF PAYMENT (check all that apply)
`
`E Check El Credit Card [I Money Order CI None I:] Other (please identify) 2
`
`
`
`
`
`Deposit Account Name: Harness, Dickey & Pierce, PLC
`E] Deposit Account Deposit Account Number: 08-0750
`For the above-identified deposit account, the Director is hereby authorized to: (check all that apply)
`
`I: Charge fee(s) indicated below
`
`I:I Charge fee(s) indicated below, except for the filing fee
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`1. BASIC FILING, SEARCH, AND EXAMINATION FEES
`
`FILING FEES
`SEARCH FEES
`
`
`
`E Charge any additional fee(s) or underpayments of fee(s)
`Under 37 CFR 1.16 and 1.17
`WARNING: Information on this form may become public. Credit card information should not be included on this form. Provide credit card
`intormation and authorization on PTO-2038.
`
`X Credit any overpayments
`
`FEE CALCULATION
`
`Application Type
`Utility
`Design
`Plant
`Reissue
`Provisional
`
`Fee (§)
`300
`200
`200
`300
`200
`
`Small Entity
`Fee(§)
`150
`100
`100
`150
`100
`
`Fee(§)
`500
`100
`300
`500
`0
`
`Small Entity
`Fee(§)
`250
`50
`150
`250
`O
`
`2. EXCESS CLAIM FEES
`Fee Description
`Each claim over 20 (including Reissues)
`Each independent claim over 3 (including Reissues)
`Multiple dependent claims
`Fee(§)
`Extra Claims
`Total Claims
`_5_()_
`x
`5g
`-20 or HP: g
`HP = highest number of total claims paid for, if greater than 20.
`
`Fee Paid (§)
`= E
`
`Extra Claims
`lndep. Claims
`=
`x
`0
`3
`- 3 or HP:
`_HP = highest number of independent claims paid for, if greater than 3.
`3. APPLICATION SIZE FEE
`
`Fee(§)
`
`Fee Paid (§)
`0
`
`EXAMINATION FEES
`
`Fee
`200
`130
`160
`600
`0
`
`Small Entity
`Fee(§)
`100
`65
`80
`300
`0
`
`Fees Paid (§)
`gm
`_
`__
`:
`
`Small Entity
`Fee (§)
`Fee (§)
`25
`50
`100
`200
`180
`360
`Multiple Dependent Claims
`Fee (§)
`Fee Paid (§)
`
`If the specification and drawings exceed 100 sheets of paper (excluding electronically filed sequence or computer
`listings under 37 CFR 1.52(e)), the application size fee due is $250 ($125 for small entity) for each additional 50
`sheets or fraction thereof. See 35 U.S.C. 41(a)(1)(G) and 37 CFR 1.16(s).
`Total Sheets
`Extra Sheets
`Number of each additional 50 or fraction thereof Fee (§)
`-
`= _Q_
`/50 =
`9
`(round up to a whole number) x
`
`Fee Paid (§)
`=
`Q
`
`_
`
`Fees Paid (§)
`
`4. OTHER FEE(S)
`Non-English Specification, $130 fee (no small entity discount)
`Other (e.g., late filing surcharge) :
`
`SUBMITTED BY
`
`
`
`,
`
`’
`1 - ; /
`
`(248)641-1600
`Telephone
`Signature
`May19. 2006
`Date
`Narne(Print/Type)
`
`This collection of infomtation is required by 37 CFR 1.136. The information is required to obtain or retain a benefit by the public which is to file (and by the USPTO to process) an application.
`Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This collection is estimated to take 30 rnlnutes to complete, including gathering, preparing, and submitting the completed
`application form to the USPTO. Tlrne will vary depending upon the Individual case. Any comments on the amount of time you require to complete this form andlor suggestions tor reducing this
`burden. should be sent to the Chief lnfomtation Officer. US. Patent and Trademark Office, U.S. Department of Commerce, P.O. Box 1450. Alexandria. VA 22313-1450. DO NOT SEND FEES
`OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.0. Box 1450. Alexandria, VA 22313-1450.
`
`Registration No.
`Moms /Aem
`
`51,501
`
`Ifyou need assistance in completing this form, call 1-800~PTO-9199 (1-800-786-9199) and select optiosgam Sung E X. 1
`
`4 p. 33
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Samsung Ex. 1304 p. 33
`
`

`
`PTOISB/05 (O4-04)
`Approved for use through 07/31/2006. OMB 0651-0032
`US. Patent and Trademark Office. U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number.
`
`—L
`U1
`)
`0')
`
`®0
`
`UTILITY
`
`PATENT APPLICATION
`
`TRANSMITTAL
`(Only for new nonprovisional applications under 37 C.F.R. 1.53(b))
`
`
`
`9432-°°°386
`Hongxing Hu, et al.
`
`HUMAN MACHINE INTERFACE METHOD AND DEVICE
`FOR CELLULAR TELEPHONE OPERATION IN
`AUTOMOTIVE INFOTAINMENT SYSTEMS
`
`APPLICATION ELEMENTS
`See MPEP chapter 600 concerning utility patent application contents.
`
`ADDRESS T0_-
`
`Commissioner for Patents
`P.0. Box 1450
`Alexandria VA 22313-1450
`
`Fee Transmittal Fonn (e.g., PTO/SB/17)
`(Submit an original and a duplicate for fee processing)
`Applicant claims small entity status.
`See 37 CFR 1.27.
`
`[Total Pages Q
`Specification
`(preferred arrangement set forth below)
`Specification
`- Descriptive title of the invention
`8
`- Cross Reference to Related Applications
`— Statement Regarding Fed sponsored R & D
`- Reference to sequence listing, a table,
`or a computer program listing appendix
`- Background of the Invention
`- Brief Summary of the Invention
`- Brief Description of the Drawings ( if filed)
`- Detailed Description
`- Claim(s)
`- Abstract of the Disclosure
`
`filed in English
`
`7. D CD-ROM or CD-R in duplicate, large table or
`Computer Program (Appendix)
`8. Nucleotide and/or Amino Acid Sequence Submission
`{if applicable, all necessary)
`a. D Computer Readable Form (CRF)
`b,
`Specification Sequence Listing on:
`i. I] CD-ROM or CD-R (2 copies); or
`“I D Paper
`c. [I Statements veri
`
`in '
`
`113000U.S.PO
`
`051906
`
`9. E]
`10. E]
`
`Assignment Papers (cover sheet & document(s))
`37 C.F.R. 3.73(b) Statement
`E] Power of
`(when there is an assignee)
`Attorney
`
`1
`
`[Total Sheets §
`4. E Drawing(s) (35 u.s.c.113)
`[Total Sheets
`5. Oath or Declaration
`a. C] Newly executed (original or copy)
`b. E] Copy from a prior application (37 CFR 1.63 (d))
`(for a continuation/divisional with Box 18 completed)
`i. E] DELETION OF INVENTORQS)
`Signed statement attached deleting inventor(s)
`named in the prior application, see 37 CFR
`1.63(d)(2) and 1.33(b).
`
`6. [Z] Application Data Sheet. See 37 CFR 1.76
`
`17. C]
`
`D Copies of IDS
`Citations
`
`English Translation Document (if applicable)
`lnfonnation Disclosure
`Statement (IDS)/PTO-1449
`Preliminary Amendment
`Return Receipt Postcard (MPEP 503)
`(Should be specifically itemized)
`Certified Copy of Priority Document(s)
`(if foreign priority is claimed)
`Nonpublication Request under 35 U.S.C. 122
`(b)(2)(B)(i). Applicant must attach form PTOlSB/35
`or its equivalent.
`Other:
`
`18. If a CONTINUING APPLICATION, check appropriate box, and supply the requisite information below and in the first sentence of the
`specification following the title, or in an Application Data Sheet under 37 CFR 1. 76:
`of prior application No:
`C! Continuation
`E] Divisional
`C] Continuation—in-part (CIP)
`Art Unit:
`Prior application information:
`Examiner
`For CONTINUATION or DIVISIONAL APPS only: The entire disclosure of the prior application, from which an oath or declaration is supplied under Box 5b,
`is considered a part of the disclosure of the accompanying or divisional application and is hereby incorporated by reference. The Incorporation can only
`be relied upon when a portion has been inadvertently omitted from the submitted application parts.
`19. CORRESPONDENCE ADDRESS
`
`l
`
`8 Customer Number
`
`52800
`
`OR I]
`
`Correspondence address below
`
`Name
`
`Address
`
`Cny
`
`C°“’"’Y
`
`Harness, Dickey & Pierce, P.L.C.
`
`P.O. Box 828
`
`Bloomfield Hills
`United States of America
`
`Name (Print/Type)
`
`Jennifer S. Brooks
`
`ea._
`248-641-160°
`Registration No. (Attomey/Agent)
`
`48303
`
`248-641-0270
`
`@
`/.
`This collection of information is re red by 37 CFR 1.53(b). The information is required to obtain or retain a benefit by the public which is to file (and by the USPTO to
`process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This collection is estimated to take 12 minutes to complete, including gathering,
`preparing, and submitting the completed application form to the USPTO. Time will vary depending upon the individual case. Any comments on the amount of time you
`require to complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S. Patent and Trademark Office, U.S.
`Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Mail Stop
`Patent Application, Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450.
`If you need assistance in completing the form, call 1-800-PTO-9199 and select option 2.
`
`May 19, 2006
`
`Samsung Ex. 1304 p. 34
`Ev 853 856 352 us
`
`Samsung Ex. 1304 p. 34
`
`

`
`
`
`’
`
`"
`
`
`
`PTO/SB/17 (01 -06)
`Approved for use through 07/31/2006. OMB 0651-0032
`US. Patent and Trademark Office: U.S. DEPARTMENT OF COMMERCE
`Underthe Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number.
`
`Complete if Known
`
`
`Fees pursuant to the Consolidated Appropriations Act, 2005 (H. R. 4818).
`FEE TRANSMITTAL
`for FY 2005
`U APP"°a"*°'a""SSma''°“‘"VS*a‘“S- 39937 CFR ‘-27
`
`
`
`
`
`TOTAL AMOUNT OF PAYMENT
`
`($) 2400
`
`
`
`METHOD OF PAYMENT (check all that apply)
`
`E Check El Credit Card [I Money Order CI None I:] Other (please identify) 2
`
`
`
`
`
`Deposit Account Name: Harness, Dickey & Pierce, PLC
`E] Deposit Account Deposit Account Number: 08-0750
`For the above-identified deposit account, the Director is hereby authorized to: (check all that apply)
`
`I: Charge fee(s) indicated below
`
`I:I Charge fee(s) indicated below, except for the filing fee
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`1. BASIC FILING, SEARCH, AND EXAMINATION FEES
`
`FILING FEES
`SEARCH FEES
`
`
`
`E Charge any additional fee(s) or underpayments of fee(s)
`Under 37 CFR 1.16 and 1.17
`WARNING: Information on this form may become public. Credit card information should not be included on this form. Provide credit card
`intormation and authorization on PTO-2038.
`
`X Credit any overpayments
`
`FEE CALCULATION
`
`Application Type
`Utility
`Design
`Plant
`Reissue
`Provisional
`
`Fee (§)
`300
`200
`200
`300
`200
`
`Small Entity
`Fee(§)
`150
`100
`100
`150
`100
`
`Fee(§)
`500
`100
`300
`500
`0
`
`Small Entity
`Fee(§)
`250
`50
`150
`250
`O
`
`2. EXCESS CLAIM FEES
`Fee Description
`Each claim over 20 (including Reissues)
`Each independent claim over 3 (including Reissues)
`Multiple dependent claims
`Fee(§)
`Extra Claims
`Total Claims
`_5_()_
`x
`5g
`-20 or HP: g
`HP = highest number of total claims paid for, if greater than 20.
`
`Fee Paid (§)
`= E
`
`Extra Claims
`lndep. Claims
`=
`x
`0
`3
`- 3 or HP:
`_HP = highest number of independent claims paid for, if greater than 3.
`3. APPLICATION SIZE FEE
`
`Fee(§)
`
`Fee Paid (§)
`0
`
`EXAMINATION FEES
`
`Fee
`200
`130
`160
`600
`0
`
`Small Entity
`Fee(§)
`100
`65
`80
`300
`0
`
`Fees Paid (§)
`gm
`_
`__
`:
`
`Small Entity
`Fee (§)
`Fee (§)
`25
`50
`100
`200
`180
`360
`Multiple Dependent Claims
`Fee (§)
`Fee Paid (§)
`
`If the specification and drawings exceed 100 sheets of paper (excluding electronically filed sequence or computer
`listings under 37 CFR 1.52(e)), the application size fee due is $250 ($125 for small entity) for each additional 50
`sheets or fraction thereof. See 35 U.S.C. 41(a)(1)(G) and 37 CFR 1.16(s).
`Total Sheets
`Extra Sheets
`Number of each additional 50 or fraction thereof Fee (§)
`-
`= _Q_
`/50 =
`9
`(round up to a whole number) x
`
`Fee Paid (§)
`=
`Q
`
`_
`
`Fees Paid (§)
`
`4. OTHER FEE(S)
`Non-English Specification, $130 fee (no small entity discount)
`Other (e.g., late filing surcharge) :
`
`SUBMITTED BY
`
`
`
`,
`
`’
`1 - ; /
`
`(248)641-1600
`Telephone
`Signature
`May19. 2006
`Date
`Narne(Print/Type)
`
`This collection of infomtation is required by 37 CFR 1.136. The information is required to obtain or retain a benefit by the public which is to file (and by the USPTO to process) an application.
`Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This collection is estimated to take 30 rnlnutes to complete, including gathering, preparing, and submitting the completed
`application form to the USPTO. Tlrne will vary depending upon the Individual case. Any comments on the amount of time you require to complete this form andlor suggestions tor reducing this
`burden. should be sent to the Chief lnfomtation Officer. US. Patent and Trademark Office, U.S. Department of Commerce, P.O. Box 1450. Alexandria. VA 22313-1450. DO NOT SEND FEES
`OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.0. Box 1450. Alexandria, VA 22313-1450.
`
`Registration No.
`Moms /Aem
`
`51,501
`
`Ifyou need assistance in completing this form, call 1-800~PTO-9199 (1-800-786-9199) and select optiosgam Sung E X. 1
`
`4 p. 35
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Samsung Ex. 1304 p. 35
`
`

`
`Attorney Docket No. 9432-000386
`
`HUMAN MACHINE INTERFACE METHOD AND DEVICE
`
`FOR CELLULAR TELEPHONE OPERATION IN AUTOMOTIVE
`
`INFOTAINMENT SYSTEMS
`
`CROSS-REFERENCE TO RELATED APPLICATIONS
`
`[0001]
`
`This application is a continuation-in-part of United States Patent
`
`Application No. 11/384,923 filed on March 17, 2006, which is a continuation-in-
`
`part of United States Patent Application No. 11/119,402 filed on April 29, 2005,
`
`which claims the benefit of U.S. Provisional Application No. 60/669,951, filed on
`
`April 8, 2005. The disclosures of the above applications are incorporated herein
`
`by reference in their entirety for any purpose.
`
`FIELD
`
`[0002]
`
`The present invention relates to human machine interfaces and,
`
`more particularly, to an improved control interface for a driver of a vehicle.
`
`BACKGROUND
`
`[0003]
`
`The statements in this section merely provide background
`
`information related to the present disclosure and may not constitute prior art.
`
`[0004] Market research has shown that operating a handheld cellular
`
`phone while driving is one of the most common causes of distractions that can
`
`significantly increase the risk of crashes. As a solution, many automotive vehicle
`
`manufactures now offer hands free cellular telephone capability, whereby the
`vehicle occupant can place and answer cellular telephone calls without the need
`
`to press tiny buttons or read the tiny display of the cellular telephone device.
`
`1
`
`Samsung Ex. 1304 p. 36
`
`Samsung Ex. 1304 p. 36
`
`

`
`Attorney Docket No. 9432-000386
`
`Hands free cellular telephone features are usually incorporated into the vehicle’s
`
`audio system and include basic speech recognition capability, so that the user
`
`can issue dialing commands by voice.
`
`[0005]
`
`Some hands free systems actually embed cellular telephone
`
`transmitting and receiving equipment within the audio system of the vehicle.
`
`In
`
`these systems, the user must typically subscribe to a special cellular telephone
`
`service, which may be in addition to the user’s personal cellular telephone
`
`service.
`
`In other systems,
`
`the user’s existing cellular telephone (and cellular
`
`telephone account) are integrated with the vehicle audio system via a Bluetooth
`
`wireless connection. In these wireless systems, the cellular telephone must have
`
`Bluetooth wireless capability, and also the ability to support the hands free
`
`protocols used by the vehicle audio system. In these wireless systems, the user
`
`provides dialing commands (or answering commands) by speaking. The vehicle
`
`audio system employs a speech recognizer that interprets the user’s speech and
`
`issues (via Bluetooth) the necessary hands free commands to cause the user’s
`
`cellular telephone to initiate (or answer) a call. Once the call is established, the
`
`conversation is routed (via Bluetooth) to the audio system, so the user can hold
`
`the conversation by simply speaking within the vehicle and without the need to
`
`physically handle the cellular phone. The phone can be kept in the user’s pocket
`
`or purse, or anywhere within Bluetooth range of the vehicle audio system.
`
`[0006] While hands free capability is quite popular, current systems are
`
`far from perfect. Menu navigation and phonebook navigation are two weak
`
`points. In conventional systems, the user navigates through a menu of command
`
`2
`
`Samsung Ex. 1304 p. 37
`
`Samsung Ex. 1304 p. 37
`
`

`
`Attorney Docket No. 9432-000386
`
`choices and phonebook entries by issuing voice commands. However,
`
`the
`
`vehicle is a particularly noisy environment where speech recognition systems
`
`may not perform well. To address this, most speech recognition systems support
`
`only a limited number of commands. Selection of names from a lengthy
`
`phonebook may simply not be possible, due to the likelihood of confusion
`
`between similar sounding names.
`
`[0007]
`
`The present invention addresses this shortcoming by employing
`
`a touchpad with character/stroke recognition capability by which menu navigation
`
`and phonebook name selection can be made by hand drawing characters on the
`
`touchpad with the fingertip. The touchpad can be used alone or in conjunction
`
`with speech to give the user excellent control over navigation choices.
`
`SUMMARY
`
`A system for controlling cellular telephone from within a vehicle, includes a cell
`
`phone interface disposed within the vehicle and configured to establish data
`
`communication with a cellular telephone disposed within the vehicle. A touchpad
`
`supplies input from a vehicle occupant
`
`including at least motion vectors. A
`
`control unit coupled to the cell phone interface effects data communication with
`
`the cellular telephone via the cell phone interface at least in part in response to
`
`the motion vectors.
`
`[0008]
`
`In some embodiments, the system may include a visual display,
`
`such as a heads up display or other secondary display unit on dash board,
`
`driving information center or rear view mirror as example, or a panel display of
`
`3
`
`Samsung Ex. 1304 p. 33
`
`Samsung Ex. 1304 p. 38
`
`

`
`Attorney Docket No. 9432-000386
`
`the type used in vehicle navigation systems. The visual display may be used to
`
`present menu navigation choices and phonebook choices to the user, where
`
`navigation is performed using the touchpad.
`
`If desired, the visual display can
`
`also function as a media viewer to display media content stored in the cellular
`
`telephone, in a media player (e.g., iPod) attached to the vehicle audio system, or
`
`in a media storage system integrated with the vehicle audio system.
`
`[0009]
`
`Further areas of applicability will become apparent from the
`
`description provided herein.
`
`It should be understood that the description and
`
`specific examples are intended for purposes of illustration only and are not
`
`intended to limit the scope of the present disclosure.
`
`DRAWINGS
`
`[0010]
`
`The drawings described herein are for illustration purposes only‘
`
`and are not intended to limit the scope of the present disclosure in any way.
`
`[0011]
`
`Figure 1
`
`is an exemplary perspective view of the instrument
`
`panel of a vehicle, showing a typical environment in which the human machine
`
`interface for automotive entertainment system may be deployed.
`
`[0012]
`
`Figure 2 is a plan view of an exemplary steering wheel,
`
`illustrating the multifunction selection switches and multifunction touchpad
`
`components.
`
`[0013]
`
`Figure 3 is a block diagram illustrating hardware and software
`
`components that may be used to define the human machine interface for hands
`
`free cellular telephone operation.
`
`4
`
`Samsung Ex. 1304 p. 39
`
`Samsung Ex. 1304 p. 39
`
`

`
`Attorney Docket No. 9432-000386
`
`[0014]
`
`Figure 4 is a functional block diagram illustrating certain
`
`functional aspects of the human machine interface, including the dynamic prompt
`
`system and character (stroke) input system, and further including the cell phone
`
`interface and video interface.
`
`[0015]
`
`Figure 5 is a flow diagram‘
`
`illustrating sequential views of
`
`displays of the user interface during user selection and employment of a search
`
`mode.
`
`[0016]
`
`Figure 6 is a flow diagram illustrating sequential views of
`
`displays of the user interface in response to user manipulation of a touchpad
`
`switch component of the user interface during user employment of a number
`
`entry mode.
`
`[0017]
`
`Figure 7 is a flow diagram illustrating sequential views of
`
`displays of the user interface in response to user manipulation of a touchpad
`
`switch component of the user interface during employment of an ordered list
`
`element selection mode.
`
`[0018]
`
`Figure 8 is a flow diagram illustrating sequential views of
`
`displays of the user interface in response to user manipulation of a touchpad
`
`switch component of the user interface during employment of an alphabetized list
`
`element selection mode.
`
`[0019]
`
`Figure 9 is a flow diagram illustrating a method of user selection
`
`of an alphabetized list element using a combination of user manipulation of a
`
`touchpad switch component of the user interface and a user speech input.
`
`5
`
`Samsung Ex. 1304 p. 40
`
`Samsung Ex. 1304 p. 40
`
`

`
`‘\
`
`ll
`
`Attorney Docket No. 9432-000386
`
`DETAILED DESCRIPTION
`
`[0020]
`
`The following description is merely exemplary in nature and is
`
`not intended to limit the present disclosure, application, or uses.
`
`It should be
`
`understood that
`
`throughout
`
`the drawings, corresponding reference numerals
`
`indicate like or corresponding parts and features.
`
`[0021]
`
`Figure 1
`
`illustrates an improved human machine interface for
`
`automotive entertainment systems in an exemplary vehicle cockpit at 10. The
`
`human machine interface allows a vehicle occupant, such as the driver, to control
`
`audio-video components mounted or carried within the vehicle, portable digital
`
`players, vehicle mounted digital players and other audio-video components.
`
`[0022]
`
`The human machine interface includes, in a presently preferred
`
`embodiment, a collection of multifunction switches 20 and a touchpad input
`
`device 14 that are conveniently mounted on the steering wheel 12. As will be
`
`more fully explained, the switches and touchpad are used to receive human input
`
`commands for controlling the audio-video equipment and selecting particular
`
`entertainment content. The human machine interface provides feedback to the
`
`user preferably in a multimodal fashion. The system provides visual feedback on
`
`a suitable display device.
`
`In Figure 1,
`
`two exemplary display devices are
`
`illustrated: a heads-up display 16 and a dashboard-mounted display panel 18.
`
`The heads-up display 16 projects a visual display onto the vehicle windshield.
`
`Display panel 18 may be a dedicated display for use with the automotive
`
`entertainment system, or it may be combined with other functions such as a
`
`vehicle navigation system function. Of course, various kinds of displays can be
`
`5
`
`Samsung Ex. 1304 p. 41
`
`Samsung Ex. 1304 p. 41
`
`

`
`Attorney Docket No. 9432-000386
`
`employed.
`
`For example, another kind of display can be a display in the
`
`instrument cluster. Still another kind of display can be a display on the rear view
`
`mirror.
`
`[0023]
`
`if desired, the operation functionality of the touchpad can be
`
`user-configurable. For example, some people like to search by inputting the first
`
`character of an item, while others like to use motion to traverse a list of items.
`
`Also, people who are generally familiar with an interface of a particular media
`
`player can select to cause the touchpad to mimic the interface of that media
`
`player.
`
`In particular, switches embedded in locations of the touchpad can be
`
`assigned functions of similarly arranged buttons of an iPodTM interface, including
`
`top for go back, center for select,
`
`left and right for seek, and bottom for
`
`play&pause. Yet, users familiar with other kinds of interfaces may prefer another
`
`kind of definition of switch operation on the touchpad.
`
`It is envisioned that the
`
`user can select a template of switch operation, assign individual switches an
`
`operation of choice, or a combination of these.
`
`[0024]
`
`Figure 2 shows the steering wheel 12 in greater detail.
`
`In the
`
`preferred embodiment, the touchpad input device 14 is positioned on one of the
`
`steering wheel spokes, thus placing it in convenient position for input character
`
`strokes drawn by the fingertip of the driver. The multifunction switches 20 are
`
`located on the opposite spoke.
`
`If desired,
`
`the touchpad and multifunction
`
`switches can be connected to the steering wheel using suitable detachable
`
`connectors to allow the position of the touchpad and multifunction switches to be
`
`reversed for the convenience of left handed persons. The touchpad may have
`
`7
`
`Samsung Ex. 1304 p. 42
`
`Samsung Ex. 1304 p. 42
`
`

`
`Attorney Docket No. 9432-000386
`
`embedded pushbutton switches or dedicated regions where key press selections
`
`can be made. Typically such regions would be arranged geometrically, such as
`
`in the four corners, along the sides,
`
`top and bottom and in the center.
`
`Accordingly, the touchpad input device 14 can have switch equivalent positions
`
`on the touchpad that can be operated to accomplish the switching functions of
`
`switches 20.
`
`It is envisioned that the touchpad can be used to draw characters
`
`when a character is expected, and used to actuate switch functions when a
`
`character is not expected. Thus, dual modes of operation for the touchpad can
`
`be employed, with the user interface switching between the modes based on a
`
`position in a dialogue state machine.
`
`[0025]
`
`The human machine interface concept can be deployed in both
`
`original equipment manufacture (OEM) and aftermarket configurations.
`
`In the
`
`OEM configuration it
`
`is
`
`frequently most suitable to include the electronic
`
`components in the head unit associated with the entertainment system.
`
`In an
`
`aftermarket configuration the electronic components may be implemented as a
`
`separate package that is powered by the vehicle electrical system and connected
`
`to the existing audio amplifier through a suitable audio connection or through a
`
`wireless radio (e.g., FM radio, Bluetooth) connection.
`
`[0026]
`
`Figure 3 shows the basic components of an implementation to
`
`support hands free control of a cellular telephone 26 using the touchpad. The
`
`switch module (comprising support for various switches such as switches 14 and
`
`20) is coupled to the human machine interface control module 21. Also coupled
`
`to control module 21 is the display (such as display 14 and/or display 18), as well
`
`8
`
`Samsung Ex. 1304 p. 43
`
`Samsung Ex. 1304 p. 43
`
`

`
`Attorney Docket No. 9432-000386
`
`as the vehicle audio system 23. To support spoken commands, a microphone 22
`
`is also coupled to the control module 21. Although not necessary to support
`
`hands free control of the cellular telephone 26, a dock interface 24 is also shown
`
`in Figure 3, to illustrate how the control module 21 can also be connected to
`
`media players, such as iPodTM 50.
`
`[0027]
`
`In a presently preferred embodiment, a wireless communication
`
`module 25 is coupled to the control module 21
`
`and provides wireless
`
`communication with
`
`cellular phone 26.
`
`In one
`
`embodiment, Bluetooth
`
`communication is employed. Of course, other wireless or wired communication
`
`links are also possible. The wireless link supports bi-directional communication of
`
`both control commands and speech communication data, as well as other forms
`
`of data.
`
`[0028]
`
`The cellular telephone 26 may include an internal phonebook
`
`27, containing phone numbers previously stored by the user in the cellular
`
`telephone memory. The control module 21 can provide search commands to the
`
`cellular phone, causing the phonebook to be searched for a desired number to
`
`be dialed. In an alternate embodiment, a copy of the phonebook 27 can be made
`
`and stored within memory managed by the control module 21. The control
`
`module can then send a dial instruction to the phone to initiate dialing. Once the
`
`call is established, the two-way voice communication between the user and the
`
`other party are sent via the wireless connection so that the microphone 22 can
`
`be used to receive the user's speech and the veh