(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2006/0262103 A1
`(43) Pub. Date: NOV. 23, 2006
`
`Hu et al.
`
`US 20060262103A1
`
`(54) HUMAN MACHINE INTERFACE METHOD
`AND DEVICE FOR CELLULAR TELEPHONE
`OPERATION IN AUTOMOTIVE
`INFOTAINMENT SYSTEMS
`
`(75)
`
`Inventors: Hongxing Hu, West Bloomfield, MI
`(US); Jie Chen, Windsor (CA)
`
`Correspondence Address:
`GREGORY A. STOBBS
`5445 CORPORATE DRIVE
`SUITE 400
`TROY, MI 48098 (US)
`
`(73) Assignee: Matsushita Electric Industrial Co.,
`Ltd., Osaka (JP)
`
`(21) Appl. No.:
`
`11/438,016
`
`(22)
`
`Filed:
`
`May 19, 2006
`
`Related US. Application Data
`
`(63) Continuation-in-part of application No. 11/384,923,
`filed on Mar. 17, 2006, which is a continuation-in—part
`of application No. 11/119,402, filed on Apr. 29, 2005.
`
`(60) Provisional application No. 60/669,951, filed on Apr.
`8, 2005.
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`(2006.01)
`G09G 5/00
`(52) US. Cl.
`.............................................................. 345/173
`
`(57)
`
`ABSTRACT
`
`A system for controlling cellular telephone from within a
`vehicle, includes a cell phone interface disposed within the
`vehicle and configured to establish data communication with
`a cellular telephone disposed within the vehicle. A touchpad
`supplies input from a vehicle occupant including at least
`motion vectors. A control unit coupled to the cell phone
`interface effects data communication with the cellular tele-
`
`phone via the cell phone interface at least in part in response
`to the motion vectors.
`
`
`
`Samsung EX. 1303 p. 1
`
`Samsung Ex. 1303 p. 1
`
`

`

`Patent Application Publication Nov. 23, 2006 Sheet 1 0f 8
`
`US 2006/0262103 A1
`
`
`
`Samsung EX. 1303 p. 2
`
`Samsung Ex. 1303 p. 2
`
`

`

`Patent Application Publication Nov. 23, 2006 Sheet 2 0f 8
`
`US 2006/0262103 A1
`
`2.2
`
`microphone
`
`16, 1 8
`
`display
`
`Human Machine
`
`Interface.
`
`control module'
`
`wireless
`
`communication
`module
`
`24
`
`vehicle-audio.
`
`system
`
`'50
`
`Samsung EX. 1303 p. 3
`
`Samsung Ex. 1303 p. 3
`
`

`

`Patent Application Publication Nov. 23, 2006 Sheet 3 of 8
`
`US 2006/0262103 A1
`
`40
`
`command
`.
`interpreter
`
`»
`
`stare
`.
`machine
`
`
`
`voice
`r m
`p 0 pt
`system
`
`42
`
`character
`(stroke)
`recognizer
`
`wireless Communication
`module
`
`
`audio
`controller
`
`
`
`amplifier
`
`
`
`video
`processor
`
`w (—30
`
`
`
`
`iogi: 64
`
`A
`selection
`SENEI'
`
`50
`
`34 J
`
`play
`
`selection
`table
`
`audio
`video
`media
`
`67
`
`62
`
`contact
`
`information
`and phone
`book
`
`information
`
`schedule
`
`68
`
`57
`
`_
`Video
`interface
`
`SS
`
`32
`
`50
`
`.
`Fig. 4
`
`Samsung EX. 1303 p. 4
`
`Samsung Ex. 1303 p. 4
`
`

`

`Patent Application Publication Nov. 23, 2006
`
`Sheet 4 of 8
`
`US 2006/0262103 A1
`
`Select a search
`method
`
`Phone
`Vi ew address book
`InpUt .a writer to dl ‘al
`Vl ewoutgoi ng calls
`w ewi nconing calls
`
`Mew nissed calls
`
`Select / input a
`phone number
`Address Book
`
`
`Mam (l-bne)
`Bob (Cffice)
`
`
`(htherim (Mabile)
`Dave (Hana)
`
`
`Ed (O‘flce)
`
`Frank (Mblle)
`
`Input a nunber to dial
`
`1234-56789»0<<
`
`73
`
`84
`
`86
`
`88
`
` Ongoing can 1 s
`
`
`248 1111111
`248 2222222
`
`
`248 3333333
`
`
`248 W
`248' 5555555
`
`248 6666666
`
` lnconing Gal ls
`
`248 1111111
`248 2222222
`248 3333333
`
`248 4444444
`248 5555555
`248 6666666
`
`
`
`
`
`
`
`
`
`
`
`
`M ssed Oil | s
`
`
`
`248 1111111
`
`248 2222222
`
`
`248 3333333
`
`
`248 4444444
`
`
`248 5555555
`248 6666666
`
`
`Search by input a
`character on touchpad
`
`p
`Address Book
`
`Jane
`(Harte)
`
`
`Janet (nubile)
`
`
`J'ennl fer (Cfflce)
`Joann (Hunt)
`
`
`
`76
`Search by using
`motion to select digits
`rto-Ia
`nput a nu :
`
`
`248 12
`
`
`1234567890<<
`
`
`
`82
`
`80 \
`Wien user
`
`input digit
`
`Fig. 5
`
`Samsung EX. 1303 p. 5
`
`Samsung Ex. 1303 p. 5
`
`

`

`Patent Application Publication Nov. 23, 2006 Sheet 5 of 8
`
`US 2006/0262103 A1
`
`(90
`
`(92
`
`('94
`
`Info displayed on small
`dis )lay
`
`Switch op emtion
`
`
`
`Info displayed on
`head 1mit
`
`
`_ “WWW“
`3 :23 45678 90’“ #4—
`
`
`
`€§£§23456 7890*544—
`
`horizontally on
`
`
`
`tOUChpad t0 highlight a
`.
`Input amberld dial
`Inputammbertodial
`
`
`
`different digit 1:233 456 78 90M“—
`1i 33 4 5 5'7 3 9o * #+—
`
`
`
`
`
`
`
`7‘ npuf a. xumber to dial
`
`_ ‘
`' putammbextq‘ -'
`
`mausaassrumm—
`
`
`
` 1 213345673 smud—
`
` nputammbextodial
`
`
`12313335673 90*!“—
`
`iA
`
`tammgrlo -=
`.
`_
`l23€§567890*#<—
`
`Inputarnm-Ibeztodial
`12~3{36789.0*#<—
`
`'
`
`
` [nput a rumba: to dial
` 123¢3357390wm.
`
`
`
`Inputa .
`-erto .'_.
`Input a number to dial
`
`-:7890*#¢—
`
` 123'4
`.
`.
`1 234333.189U*#¢—
`
`
`
`Press Center cif touchpad
`Input :1 muuherto dial
`
`
`to make asel'ectiun
`6
`
`
`6 _
`lmtamnbertodia'l
`
`
`1234‘ ‘:7890“‘#(—
`Izaasfirzssowh
`98
`
`
`K,
`
`
`
`
`Fig. 6
`
`Samsung EX. 1303 p. 6
`
`Samsung Ex. 1303 p. 6
`
`

`

`Patent Application Publication Nov. 23, 2006 Sheet 6 of 8
`
`US 2006/0262103 A1
`
`('90
`Info displayed on small
`‘d‘n: win '
`
`{-92
`
`(‘94
`
`to lint: dawn
`
`1.00
`K,
`
` Press right of touchpad
`
`Press cénter n mumpad
`,
`to make a‘ selection
`102
`
`248 ?65432 1
`
`Samsung EX. 1303 p. 7
`
`Samsung Ex. 1303 p. 7
`
`

`

`Patent Application Publication Nov. 23, 2006 Sheet 7 of 8
`
`US 2006/0262103 A1
`
`(.90
`
`(-92
`
`(94
`
`Info displayed onsmall
`display
`
`Info displayed on
`head unit
`
`Write the irst character
`
`of the contact name on
`
`touchpad.
`104
`0“
`
`248 1234567
`
`Press ri- totouc pad
`105
`to line down
`gA
`
`Press center 0 tone-pad,
`81:0 make a selection
`
`Joan
`
`Samsung EX. 1303 p. 8
`
`Samsung Ex. 1303 p. 8
`
`

`

`Patent Application Publication Nov. 23, 2006 Sheet 8 of 8
`
`US 2006/0262103 A1
`
`START
`
`
`
`ENTER A SEARCH ALPHABETIZED TEXTUAL
`LIST MODE
`
`RECOGNIZE USER DRAWN LETTER ON
`TOUCHPAD
`
`
`
`
` CONSTRAIN
`
`RECOGNITION OF
`
`USER SPEECH
`
`INPUT TO
`
`CONTENTS OF THE
`
`LIST THAT BEGIN
`
`WITH THE USER
`DRAWN LETTER
`
`
`
`USER
`.
`
`DRAWN
`SCROLL
`DOWN
`LETTER
`
` COMMAND
`
`
` ‘ PRESENT LIST OF
` USER SPEECH INPUT
`CANDIDATES To USER
`
`FOR FINAL SELECTION
`CONSTRAIN RECOGNITION OF
`
`USER SPEECH INPUT To
`
`CONTENTS OF THE LIST THAT
`ARE WITHIN A PREDETERMINED
`
`DISTANCE OF THE LIST
`ELEMENT HAVING THE FOCUS
`
`
`Fig. 9
`
`132
`
`Samsung EX. 1303 p. 9
`
`Samsung Ex. 1303 p. 9
`
`

`

`US 2006/0262103 A1
`
`Nov. 23, 2006
`
`HUMAN MACHINE INTERFACE METHOD AND
`DEVICE FOR CELLULAR TELEPHONE
`OPERATION IN AUTOMOTIVE INFOTAINMENT
`SYSTEMS
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] This application is a continuation-in-part of US.
`patent application Ser. No. 11/384,923 filed on Mar. 17,
`2006, which is a continuation-in-part of US. patent appli-
`cation Ser. No. 11/119,402 filed on Apr. 29, 2005, which
`claims the benefit of US. Provisional Application No.
`60/669,951, filed on Apr. 8, 2005. The disclosures of the
`above applications are incorporated herein by reference in
`their entirety for any purpose.
`
`FIELD
`
`[0002] The present invention relates to human machine
`interfaces and, more particularly, to an improved control
`interface for a driver of a vehicle.
`
`BACKGROUND
`
`[0003] The statements in this section merely provide back-
`ground information related to the present disclosure and may
`not constitute prior art.
`
`[0004] Market research has shown that operating a hand-
`held cellular phone while driving is one of the most common
`causes of distractions that can significantly increase the risk
`of crashes. As a solution, many automotive vehicle manu-
`factures now offer hands free cellular telephone capability,
`whereby the vehicle occupant can place and answer cellular
`telephone calls without the need to press tiny buttons or read
`the tiny display of the cellular telephone device. Hands free
`cellular telephone features are usually incorporated into the
`vehicle’s audio system and include basic speech recognition
`capability, so that the user can issue dialing commands by
`v01ce.
`
`Some hands free systems actually embed cellular
`[0005]
`telephone transmitting and receiving equipment within the
`audio system of the vehicle. In these systems, the user must
`typically subscribe to a special cellular telephone service,
`which may be in addition to the user’s personal cellular
`telephone service. In other systems,
`the user’s existing
`cellular telephone (and cellular telephone account) are inte-
`grated with the vehicle audio system via a Bluetooth wire-
`less connection.
`In these wireless systems,
`the cellular
`telephone must have Bluetooth wireless capability, and also
`the ability to support the hands free protocols used by the
`vehicle audio system. In these wireless systems, the user
`provides dialing commands (or answering commands) by
`speaking. The vehicle audio system employs a speech rec-
`ognizer that interprets the user’s speech and issues (via
`Bluetooth) the necessary hands free commands to cause the
`user’s cellular telephone to initiate (or answer) a call. Once
`the call is established, the conversation is routed (via Blue-
`tooth) to the audio system, so the user can hold the conver-
`sation by simply speaking within the vehicle and without the
`need to physically handle the cellular phone. The phone can
`be kept in the user’s pocket or purse, or anywhere within
`Bluetooth range of the vehicle audio system.
`
`[0006] While hands free capability is quite popular, cur-
`rent systems are far from perfect. Menu navigation and
`
`phonebook navigation are two weak points. In conventional
`systems, the user navigates through a menu of command
`choices and phonebook entries by issuing voice commands.
`However, the vehicle is a particularly noisy environment
`where speech recognition systems may not perform well. To
`address this, most speech recognition systems support only
`a limited number of commands. Selection of names from a
`
`lengthy phonebook may simply not be possible, due to the
`likelihood of confusion between similar sounding names.
`
`[0007] The present invention addresses this shortcoming
`by employing a touchpad with character/stroke recognition
`capability by which menu navigation and phonebook name
`selection can be made by hand drawing characters on the
`touchpad with the fingertip. The touchpad can be used alone
`or in conjunction with speech to give the user excellent
`control over navigation choices.
`
`SUMMARY
`
`[0008] A system for controlling cellular telephone from
`within a vehicle, includes a cell phone interface disposed
`within the vehicle and configured to establish data commu-
`nication with a cellular telephone disposed within the
`vehicle. A touchpad supplies input from a vehicle occupant
`including at least motion vectors. A control unit coupled to
`the cell phone interface effects data communication with the
`cellular telephone via the cell phone interface at least in part
`in response to the motion vectors.
`
`In some embodiments, the system may include a
`[0009]
`visual display, such as a heads up display or other secondary
`display unit on dash board, driving information center or
`rear view mirror as example, or a panel display of the type
`used in vehicle navigation systems. The visual display may
`be used to present menu navigation choices and phonebook
`choices to the user, where navigation is performed using the
`touchpad. If desired, the visual display can also function as
`a media viewer to display media content stored in the
`cellular telephone, in a media player (e.g., iPod) attached to
`the vehicle audio system, or in a media storage system
`integrated with the vehicle audio system.
`
`[0010] Further areas of applicability will become apparent
`from the description provided herein. It should be under-
`stood that the description and specific examples are intended
`for purposes of illustration only and are not intended to limit
`the scope of the present disclosure.
`
`DRAWINGS
`
`[0011] The drawings described herein are for illustration
`purposes only and are not intended to limit the scope of the
`present disclosure in any way.
`
`[0012] FIG. 1 is an exemplary perspective view of the
`instrument panel of a vehicle, showing a typical environ-
`ment in which the human machine interface for automotive
`
`entertainment system may be deployed.
`
`[0013] FIG. 2 is a plan view of an exemplary steering
`wheel, illustrating the multifunction selection switches and
`multifunction touchpad components.
`
`[0014] FIG. 3 is a block diagram illustrating hardware and
`software components that may be used to define the human
`machine interface for hands free cellular telephone opera-
`tion.
`
`Samsung EX. 1303 p. 10
`
`Samsung Ex. 1303 p. 10
`
`

`

`US 2006/0262103 A1
`
`Nov. 23, 2006
`
`[0015] FIG. 4 is a functional block diagram illustrating
`certain functional aspects of the human machine interface,
`including the dynamic prompt system and character (stroke)
`input system, and further including the cell phone interface
`and Video interface.
`
`[0016] FIG. 5 is a flow diagram illustrating sequential
`views of displays of the user interface during user selection
`and employment of a search mode.
`
`[0017] FIG. 6 is a flow diagram illustrating sequential
`views of displays of the user interface in response to user
`manipulation of a touchpad switch component of the user
`interface during user employment of a number entry mode.
`
`[0018] FIG. 7 is a flow diagram illustrating sequential
`views of displays of the user interface in response to user
`manipulation of a touchpad switch component of the user
`interface during employment of an ordered list element
`selection mode.
`
`[0019] FIG. 8 is a flow diagram illustrating sequential
`views of displays of the user interface in response to user
`manipulation of a touchpad switch component of the user
`interface during employment of an alphabetized list element
`selection mode.
`
`[0020] FIG. 9 is a flow diagram illustrating a method of
`user selection of an alphabetized list element using a com-
`bination of user manipulation of a touchpad switch compo-
`nent of the user interface and a user speech input.
`
`DETAILED DESCRIPTION
`
`[0021] The following description is merely exemplary in
`nature and is not intended to limit the present disclosure,
`application, or uses. It should be understood that throughout
`the drawings, corresponding reference numerals indicate
`like or corresponding parts and features.
`
`[0022] FIG. 1 illustrates an improved human machine
`interface for automotive entertainment systems in an exem-
`plary vehicle cockpit at 10. The human machine interface
`allows a vehicle occupant, such as the driver, to control
`audio-video components mounted or carried within the
`vehicle, portable digital players, vehicle mounted digital
`players and other audio-video components.
`
`[0023] The human machine interface includes, in a pres-
`ently preferred embodiment, a collection of multifunction
`switches 20 and a touchpad input device 14 that are conve-
`niently mounted on the steering wheel 12. As will be more
`fully explained,
`the switches and touchpad are used to
`receive human input commands for controlling the audio-
`video equipment and selecting particular entertainment con-
`tent. The human machine interface provides feedback to the
`user preferably in a multimodal fashion. The system pro-
`vides visual feedback on a suitable display device. In FIG.
`1, two exemplary display devices are illustrated: a heads-up
`display 16 and a dashboard-mounted display panel 18. The
`heads-up display 16 projects a visual display onto the
`vehicle windshield. Display panel 18 may be a dedicated
`display for use with the automotive entertainment system, or
`it may be combined with other functions such as a vehicle
`navigation system function. Of course, various kinds of
`displays can be employed. For example, another kind of
`display can be a display in the instrument cluster. Still
`another kind of display can be a display on the rear view
`mirror.
`
`If desired, the operation functionality of the touch-
`[0024]
`pad can be user-configurable. For example, some people like
`to search by inputting the first character of an item, while
`others like to use motion to traverse a list of items. Also,
`people who are generally familiar with an interface of a
`particular media player can select to cause the touchpad to
`mimic the interface of that media player. In particular,
`switches embedded in locations of the touchpad can be
`assigned functions of similarly arranged buttons of an
`iPodTM interface, including top for go back, center for select,
`left and right for seek, and bottom for play&pause. Yet, users
`familiar with other kinds of interfaces may prefer another
`kind of definition of switch operation on the touchpad. It is
`envisioned that the user can select a template of switch
`operation, assign individual switches an operation of choice,
`or a combination of these.
`
`[0025] FIG. 2 shows the steering wheel 12 in greater
`detail. In the preferred embodiment,
`the touchpad input
`device 14 is positioned on one of the steering wheel spokes,
`thus placing it in convenient position for input character
`strokes drawn by the fingertip of the driver. The multifunc-
`tion switches 20 are located on the opposite spoke. If
`desired, the touchpad and multifunction switches can be
`connected to the steering wheel using suitable detachable
`connectors to allow the position of the touchpad and mul-
`tifunction switches to be reversed for the convenience of left
`
`handed persons. The touchpad may have embedded push-
`button switches or dedicated regions where key press selec-
`tions can be made. Typically such regions would be arranged
`geometrically, such as in the four corners, along the sides,
`top and bottom and in the center. Accordingly, the touchpad
`input device 14 can have switch equivalent positions on the
`touchpad that can be operated to accomplish the switching
`functions of switches 20. It is envisioned that the touchpad
`can be used to draw characters when a character is expected,
`and used to actuate switch functions when a character is not
`
`expected. Thus, dual modes of operation for the touchpad
`can be employed, with the user interface switching between
`the modes based on a position in a dialogue state machine.
`
`[0026] The human machine interface concept can be
`deployed in both original equipment manufacture (OEM)
`and aftermarket configurations. In the OEM configuration it
`is frequently most suitable to include the electronic compo-
`nents in the head unit associated with the entertainment
`
`system. In an aftermarket configuration the electronic com-
`ponents may be implemented as a separate package that is
`powered by the vehicle electrical system and connected to
`the existing audio amplifier through a suitable audio con-
`nection or through a wireless radio (e.g., FM radio, Blue-
`tooth) connection.
`
`[0027] FIG. 3 shows the basic components of an imple-
`mentation to support hands free control of a cellular tele-
`phone 26 using the touchpad. The switch module (compris-
`ing support for various switches such as switches 14 and 20)
`is coupled to the human machine interface control module
`21. Also coupled to control module 21 is the display (such
`as display 14 and/or display 18), as well as the vehicle audio
`system 23. To support spoken commands, a microphone 22
`is also coupled to the control module 21. Although not
`necessary to support hands free control of the cellular
`telephone 26, a dock interface 24 is also shown in FIG. 3,
`to illustrate how the control module 21 can also be con-
`
`nected to media players, such as iPodTM50.
`
`Samsung EX. 1303 p. 11
`
`Samsung Ex. 1303 p. 11
`
`

`

`US 2006/0262103 A1
`
`Nov. 23, 2006
`
`In a presently preferred embodiment, a wireless
`[0028]
`communication module 25 is coupled to the control module
`21 and provides wireless communication with cellular phone
`26.
`In one embodiment, Bluetooth communication is
`employed. Of course, other wireless or wired communica-
`tion links are also possible. The wireless link supports
`bi-directional communication of both control commands
`
`and speech communication data, as well as other forms of
`data.
`
`[0029] The cellular telephone 26 may include an internal
`phonebook 27, containing phone numbers previously stored
`by the user in the cellular telephone memory. The control
`module 21 can provide search commands to the cellular
`phone, causing the phonebook to be searched for a desired
`number to be dialed. In an alternate embodiment, a copy of
`the phonebook 27 can be made and stored within memory
`managed by the control module 21. The control module can
`then send a dial instruction to the phone to initiate dialing.
`Once the call is established, the two-way voice communi-
`cation between the user and the other party are sent via the
`wireless connection so that the microphone 22 can be used
`to receive the user’s speech and the vehicle audio system 23
`can be used to make audible the other party’s speech.
`
`[0030] The wireless communication module can also sup-
`port other forrns of data transmission, such as for audio/
`video playback of media content stored in the cellular
`telephone. Current Bluetooth technology will support bit
`rates up to approximately 192 bits per second. Future
`extensions of this technology are expected to provide higher
`bit rates, allowing even higher quality audio and video to be
`sent wirelessly to the control module 21. Current IEEE
`802.11 (WiFi) wireless communication technology supports
`even higher data rates and may also be used where wireless
`transmission of video is desired. In this regard, where the
`stored media includes video content, that content can be
`played back on the display 16, 18.
`
`[0031] The hands free operation of the cellular telephone
`can follow many of the same navigational patterns (and
`gestural dialogues) used to control the media player. More-
`over, both the cellular telephone and the media play can
`store media content that may be played back using the
`vehicle audio system. Thus the user does not really need to
`care which device is being controlled. If media playback is
`desired, either the cellular phone or the media player can
`provide that content. The user interface (touchpad control)
`remains essentially the same. If the user wishes to obtain
`information from a personal information manager (PIM)
`feature of the cellular phone or media player, again, the user
`simply requests that information through touchpad control.
`The control module 21 is designed to integrate all devices,
`so that the user does not have to worry about which device
`he or she needs to interact with to obtain the desired results.
`
`[0032] FIG. 4 depicts an exemplary embodiment that may
`be adapted for either OEM or aftermarket use. In this
`implementation, the human machine interface control mod-
`ule 21 (FIG. 3) employs three basic subsections: a human
`machine interface subsection 30, a digital media player
`interface subsection 32, and a database subsection 34. The
`human machine interface subsection includes a user inter-
`
`face module 40 that supplies textual and visual information
`through the displays (e.g., heads-up display 16 and display
`panel 18 of FIG. 1). The human machine interface also
`
`includes a voice prompt system 42 that provides synthesized
`voice prompts or feedback to the user through the audio
`portion of the automotive entertainment system.
`
`[0033] Coupled to the user interface module 40 is a
`command interpreter 44 that includes a character or stroke
`recognizer 46 that is used to decode the hand drawn user
`input from the touchpad input device 14. A state machine 48
`(shown more fully in FIG. 4) maintains system knowledge
`of which mode of operation is currently invoked. The state
`machine works in conjunction with a dynamic prompt
`system that will be discussed more fully below. The state
`machine controls what menu displays are presented to the
`user and works in conjunction with the dynamic prompt
`system to control what prompts or messages will be sent via
`the voice prompt system 42.
`
`[0034] The state machine can be reconfigurable. In par-
`ticular, there can be different search logic implementations
`from which the user can select one to fit their needs. For
`
`example, when trying to control the audio program, some
`people need to access the control of the audio source (e.g.,
`FM/AM/satellite/CD/ .
`.
`. ) most often, so these controls can
`be provided at a first layer of the state machine. On the other
`hand, some people need to access the equalizer most often,
`so these controls can be provided at the first layer.
`
`[0035] The digital media player subsection 32 is shown
`making an interface connection with a portable media player
`50, such as an iPodTM. For iPodTM connectivity, the connec-
`tion is made through the iPodTM dock connector. For this
`purpose, a serial interface 52, an audio interface 54, and a
`video interface 55 are provided. The iPodTM dock connector
`supplies both serial (USB) and audio signals through the
`dock connector port. The signals are appropriately commu-
`nicated to the serial interface and audio interface respec-
`tively. The audio interface 54 couples the audio signals to the
`audio amplifier 56 of the automotive entertainment system.
`Serial interface 52 couples to a controller logic module 58
`that responds to instructions received from the human
`machine interface subsection 30 and the database subsection
`
`34 to provide control commands to the media player via the
`serial interface 52 and also to receive digital data from the
`media player through the serial
`interface 52. The video
`interface 55 couples to a video processor 57 that renders
`stored video data so that it can be displayed on the vehicle
`display (e.g., on the display 18 (FIG. 1).
`
`[0036] The wireless communication module 25 couples to
`each of the controller logic 58, the audio amplifier 56, and
`the video processor 57,
`so that control commands and
`audio/video data can be input and output via the wireless
`link.
`
`[0037] The database subsection 34 includes a selection
`server 60 with an associated database 62. The database
`
`stores a variety of information, including audio and video
`playlist information and other metadata reflecting the con-
`tents of the media player (e.g., iPodTM50) or of the cellular
`phone 26 if it also stores media content. The playlist data can
`include metadata for various types of media,
`including
`audio, video, information of recorded satellite programs, or
`other data. Database 62 may also store contact information,
`schedule information and phonebook information (down-
`loaded from the memory of the cellular phone 26, from the
`media player 50, or from some other information manage-
`ment device or Internet site.
`
`Samsung EX. 1303 p. 12
`
`Samsung Ex. 1303 p. 12
`
`

`

`US 2006/0262103 A1
`
`Nov. 23, 2006
`
`[0038] For hands free cellular phone operation, the selec-
`tion server 60 responds to instructions from command
`interpreter 44 to initiate database lookup operations using a
`suitable structured query language (SQL). The lookup
`operation may return a phone number of a requested party,
`which can be displayed on the display screen, or provided
`verbally through text-to-speech synthesis or other voice
`response prompting.
`
`the selection server 60
`[0039] For media playback,
`responds to instructions from command interpreter 44 to
`initiate database lookup operations using a suitable struc-
`tured query language (SQL). The selection server populates
`a play table 64 and a selection table 66 based on the results
`of queries made of the song database at 62. The selection
`table 66 is used to provide a list of items that the user can
`select from during the entertainment selection process. The
`play table 64 provides a list of media selections or songs to
`play. The selection table is used in conjunction with the state
`machine 48 to determine what visual display and/or voice
`prompts will be provided to the user at any given point
`during the system navigation. The play table provides
`instructions that are ultimately used to control which media
`content items (e.g., songs) are requested for playback by the
`media player (iPod).
`
`[0040] When the media player is first plugged in to the
`digital media player subsection 32, an initializing routine
`executes to cause the song database 62 to be populated with
`data reflecting the contents of the media player. Specifically,
`the controller logic module 58 detects the presence of a
`connected media player. Then, the controller logic module
`can send a command to the media player that causes the
`media player to enter a particular mode of operation, such as
`an advanced mode. Next, the controller logic module can
`send a control command to the media player requesting a
`data dump of the player’s playlist information, including
`artist, album, song, genre and other metadata used for
`content selection. If available, the data that is pumped can
`include the media player’s internal content reference iden-
`tifiers for accessing the content described by the metadata.
`The controller logic module 58 routes this information to the
`selection server 60, which loads it into the song database 62.
`It is envisioned that a plurality of different types of ports can
`be provided for connecting to a plurality of different types of
`media players, and that controller logic module 58 can
`distinguish which type of media player is connected and
`respond accordingly. It is also envisioned that certain types
`of connectors can be useful for connecting to more than one
`type of media player, and that controller logic module can
`alternatively or additionally be configured to distinguish
`which type of media player is connected via a particular
`port, and respond accordingly.
`
`It should be readily understood that some media
`[0041]
`players can be capable of responding to search commands
`by searching using their own interface and providing filtered
`data. Accordingly, while it is presently preferred to initiate
`a data dump to obtain a mirror of the metadata on the
`portable media player, and to search using the constructed
`database, other embodiments are also possible. In particular,
`additional and alternative embodiments can include search-
`
`ing using the search interface of the portable media player by
`sending control commands to the player, receiving filtered
`data from the player, and ultimately receiving selected
`
`media content from the player for delivery to the user over
`a multimedia system of the vehicle.
`
`[0042] As might be expected, in a moving vehicle it can
`sometimes be difficult to neatly supply input characters. To
`handle this, the recognition system is designed to work using
`probabilities, where the recognizer calculates a likelihood
`score for each letter of the alphabet, representing the degree
`of confidence (confidence level) that the character (stroke)
`recognizer assigns to each letter, based on the user’s input.
`Where the confidence level of a single character input is
`high,
`the results of that single recognition may be sent
`directly to the selection server 60 (FIG. 4) to retrieve all
`matching selections from the database 62. However,
`if
`recognition scores are low, or if there is more than one high
`scoring candidate,
`then the system will supply a visual
`and/or verbal feedback to the user that identifies the top few
`choices and requests the user to pick one. Thus, when the
`character or stroke input mechanism 92 is used, the input
`character is interpreted at 96 and the results are optionally
`presented to the user to confirm at 98 and/or select the
`correct input from a list of the n-most probable interpreta-
`tions.
`
`It should be readily understood that vector (stroke)
`[0043]
`data can be used to train hidden Markov models or other
`
`vector-based models for recognizing handwritten characters.
`In such cases, user-independent models can be initially
`provided and later adapted to the habits of a particular user.
`Alternatively or additionally, models can be trained for the
`user, and still adapted over time to the user’s habits.
`
`It is envisioned that models can be stored and
`[0044]
`trained for multiple drivers, and that the drivers’ identities at
`time of use can be determined in a variety if ways. For
`example, some vehicles have different key fobs for different
`users, so that the driver can be identified based on detection
`of presence of a particular key fob in the vehicle. Also, some
`vehicles allow drivers to save and retrieve their settings for
`mirror positions, seat positions, radio station presets, and
`other driver preferences;
`thus the driver identity can be
`determined based on the currently employed settings. Fur-
`ther,
`the driver can be directly queried to provide their
`identity. Finally, the driver identity can be recognized auto-
`matically by driver biometrics, which can include driver
`handwriting, speech, weight in the driver’s seat, or other
`measurable driver characteristics.
`
`It should also be readily understood that the afore-
`[0045]
`mentioned human machine interface can be employed to
`provide users access to media content that
`is stored in
`memory of the vehicle, such as a hard disk of a satellite
`radio, or other memory. Accordingly, users can be permitted
`to access media content of different system drives using the
`human machine interface, with a media player temporarily
`connected to the vehicle being but one type of drive of the
`system. Moreover, the system can be used to allow users to
`browse content available for streaming over a communica-
`ti