PROVISIONAL APPLICATION COVER
`
`SHEET
`
`_
`A/PROV
`
`This is a requestfor filing a PROVISIONAL APPLICATION FOR PATENTunder 37 CFR 1.53{(c).
`
`EM470250995US
`
`Docket No.
`
`03797,.00074
`
`Type a plus sign (+)
`inside this box-
`
`INVENTOR(S)/APPLICANTS(S)
`
`
`
`UU/Ub/TLAOld‘S'n22900.
`
`LAST NAME
`
`FIRST NAME
`
`Me Charlton
`
`MIDDLE
`INITIAL
`
`RESIDENCE
`{City and either state or foreign country)
`
`Redmond,Washington
`
` 11-43-00
`
`
`
`TITLE OF THE INVENTION (280 character maximum)
`
`“SYSTEM AND METHOD FOR ACCEPTING DISPARATE TYPES OF USER INPUT”
`
`CORRESPONDENCE ADDRESS
`
`
`
`STATE|ttinois—_|ZIP CODE|60606|COUNTRY
`
`Banner & Witcoff, Ltd.
`Ten South Wacker Drive, Suite 3000, Chicago
`
`ENCLOSED APPLICATION PARTS(checkall that apply)
`
`Specification
`Drawing(s)
`
`Number of Pages
`Numberof Sheets
`
`Small Entity Statement
`Other(specify):
`
`METHOD OF PAYMENT FOR THIS PROVISIONAL APPLICATION FOR PATENT
`
`A check or money order is enclosed to cover the Provisional
`Filing Fee
`
`The Commissioner is hereby authorized to charge filing fees
`and credit Deposit Account Number: 19-0733
`
`PROVISIONAL
`FILING FEE
`AMOUNT ($}
`
`$150.00
`
`The invention was made by an agency of the United States Government or under a contract with an agency of the United States Government.
`
`No.
`
`Yes, the name of the U.S. Government agency and the Government contract numberare:
`
`Respectfully submitted,
`
`SIGNATURE: Lite f. Mp date:
`
`[! 1/0; CO
`
`TYPED or PRINTED NAME
`
`Christopher P. Moreno
`
`REG. NO, 38,566
`
`Additional inventors are being named on separately numbered sheets attached hereto.
`
`USE ONLY FOR FILING A PROVISIONAL APPLICATION FOR PATENT
`Burden Hour Statement: This form is estimated to take 2 hours to complete. Time will very depending upon the needs af the individual case. Any comments on the amount
`of time you are required to complete this form should be sent to the Office of Assistance Quality and EnhancementDivision, Patent and Trademark Office, Washington, 0.C.
`20231, and to the Office of information and Regulatory Affairs, Office of Management and Budget {Project 065 1-OOXX), Washington, D.C 20503. DO NOT SEND FEES
`OR COMPLETED FORMS TO THIS ADDRESS, SEND TO: Commisstoner of Patents and Trademarks, Washington, 0.C, 20231.
`Valve Exhibit 1013
`Valve Exhibit 1013
`Valve v. Immersion
`Valve v. Immersion
`
`EX1013 - 1
`
`EX1013 - 1
`
`

`

`CERTIFICATE OF MAILING BY “EXPRESS MAIL”
`(NEW PROVISIONAL PATENT APPLICATION)
`
`i
`
`w
`}
`
`Deposited
`
`November 10, 2000
`
`I hereby certify that the attached correspondence, identified below, is being deposited with the United States
`
`Postal Service as "Express Mail Post Office to Addressee" under 37 CFR § 1.10 on the date indicated above and is
`
`addressed to the Asst. Commissioner for Patents, Washington, DC 20231.
`
`glo)Howls
`
`(person actually depositing)
`
`
`
`In the Application of.
`
`Charlton E. Lui
`
`Serial No.:
`
`TBA
`
`Filing Date:
`
`November 10, 2000
`
`Title:
`
`and Method for Acceptin: isparate Types of User Input”
`“System
`
`1.53 (c) Provisional Patent Application Cover Sheet (12 pages 18 sheet of drawings)
`X__
`X_. Postcard
`
`x Check in the amount of $150.00
`
`Attomey Docket No.: 03797.00074
`
`EX1013 - 2
`EX1013 - 2
`
`

`

`—_—
`
`SYSTEM AND METHOD FOR ACCEPTING DISPARATE TYPES OF USER INPUT
`
`CROSS-REFERENCE TO RELATED APPLICATIONS
`
`The present application is related to application Serial No. (Atty docket 3797.00066),
`
`entitled Method and Apparatus For Improving the Appearance of Digitally Represented
`
`Handwriting, filed concurrently with the present application; to application Serial No. (Atty
`
`docket 3797.00067), entitled Highlevel Active Pen Matrix, and filed concurrently with the
`
`present application;
`
`to application Serial No.
`
`(Atty docket 3797.00069), entitled Selection
`
`Handles in Editing Electronic Documents, and filed concurrently with the present application; to
`
`application Serial No. (Atty docket 3797.00070), entitled Insertion Point Bungee Space Tool,
`
`and filed concurrently with the present application; to application Serial No. (Atty docket
`
`3797.00072), entitled Simulating Gestures of a Mouse Using a Stylus and Providing Feedback
`
`Thereto, andfiled concurrent with the present application; to application Serial No. (Atty docket
`
`3797,00075), entitled In Air Gestures, and filed concurrently with the present application; to
`
`application Serial No. (Atty docket 3797.00076), entitled Mouse Input Panel WindowsClass
`
`List, and filed concurrently with the present application; to application Serial No. (Atty docket
`
`3797.00077), entitled Mouse Input Panel and User Interface, and filed concurrently with the
`
`present application; to application Serial No. (Atty docket 3797.00079), entitled System and
`
`Method For Inserting Implicit Page Breaks, and filed concurrently with the present application;
`
`each of which is incorporated by reference herein.
`
`BACKGROUNDOF THE INVENTION
`
`Computer users are generally familiar with interacting with a personal computer via a
`
`mouse and keyboard. Tablet PC's, however, generally do not have a physical keyboard or a
`
`
`
`20
`
`21
`
`22
`
`0379700074; 164085.1
`
`EX1013 - 3
`EX1013 - 3
`
`

`

`mouseaspart ofits user interface.
`
`Instead, the user will often interact with a tablet PC in the
`
`form of inputting textual information, navigating among documents, entering commands, and the
`
`like, using a pen or stylus on the tablet PC's display.
`
`Conventional stylus and tablet user interfaces are typically cumbersometo use, limit a
`
`user to one mode of inputting text information at a time, and require that the user manually
`
`switch between the various input modes.
`
`Because handwritten notes are more appropriate in a meeting setting, while speech may
`
`be more efficient for entering text into correspondence fromarelatively private setting, such as a
`
`user's office or home, an integrated spectrum of various ways to enter textual information into a
`
`tablet PC is desirable.
`
`Accordingly, there is a need for an improved user interface that allows users of tablet
`
`PC's to input synchronized multimedia text information in various ways, while minimizing the
`
`amount of switching between input modesthat is necessary.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`The present invention may be more readily described with reference to FIGS. 1-12.
`
`FIG. 1
`
`illustrates a schematic diagram of a conventional general-purpose digital computing
`
`environment that can be used to implement various aspects of the present invention. In FIG. 1, a
`
`computer 100 includes a processing unit 110, a system memory 120, and a system bus 130 that
`
`couples various system components including the system memory to the processing unit 110.
`
`The system bus 130 may be any of several types of bus structures including a memory bus or
`
`memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures.
`
`
`
`
`
`19
`
`20
`
`21
`
`03797.00074, 164085.1
`
`EX1013 - 4
`EX1013 - 4
`
`

`

`The system memory 120 includes read only memory (ROM) 140 and random access memory
`
`(RAM) 150.
`
`A basic input/output system 160 (BIOS), containing the basic routines that help to
`
`transfer information between elements within the computer 100, such as during start-up, is stored
`
`in the ROM 140. The computer 100 also includes a hard disk drive 170 for reading from and
`
`writing to a hard disk (not shown), a magnetic disk drive 180 for reading from or writing to a
`
`removable magnetic disk 190, and an optical disk drive 191 for reading from or writing to a
`
`removable optical disk 192 such as a CD ROM orother optical media. The hard disk drive 170,
`
`magnetic disk drive 180, and optical disk drive 191 are connected to the system bus 130 by a
`
`hard disk drive interface 192, a magnetic disk drive interface 193, and an optical disk drive
`
`interface 194, respectively. The drives and their associated computer-readable media provide
`
`nonvolatile storage of computer readable instructions, data structures, program modules and
`
`other data for the personal computer 100.
`
`It will be appreciated by those skilled in the art that
`
`other types of computer readable media that can store data that is accessible by a computer, such
`
`as magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random
`
`access memories (RAMs), read only memories (ROMs), and the like, may also be used in the
`
`example operating environment.
`
`A numberof program modules can be stored on the hard disk drive 170, magnetic disk
`
`190, optical disk 192, ROM 140 or RAM 150, including an operating system 195, one or more
`
`application programs 196, other program modules 197, and program data 198. A user can enter
`
`commands and information into the computer 100 through input devices such as a keyboard 101
`
`and pointing device 102. Other input devices (not shown) may include a microphone,joystick,
`
`
`
`19
`
`20
`
`21
`
`22
`
`03797.00074;, 164085.1
`
`EX1013 - 5
`EX1013 -5
`
`

`

`game pad, satellite dish, scanner or the like. These and other input devices are often connected
`
`to the processing unit 110 throughaserial port interface 106 that is coupled to the system bus,
`
`but may be connected by other interfaces, such as a parallel port, game port or a universalserial
`
`bus (USB). Furtherstill, these devices may be coupled directly to the system bus 130 via an
`
`appropriate interface (not shown). A monitor 107 or other type of display device is also
`
`connected to the system bus 130 via an interface, such as a video adapter 108. In addition to the
`
`monitor, personal computers typically include other peripheral output devices (not shown), such
`
`as speakers and printers.
`
`In a preferred embodiment, a pen digitizer 165 and accompanying pen
`
`or stylus 166 are provided in order to digitally capture freehand input. Although a direct
`
`connection between the pen digitizer 165 and the processing unit 110 is shown, in practice, the
`
`pen digitizer 165 may be coupled to the processing unit 110 via a serial port, parallel port or
`
`other interface and the system bus 130 as known in the art. Furthermore, although the digitizer
`
`165 is shown apart from the monitor 107, it is preferred that the usable input area of the digitizer
`
`165 be co-extensive with the display area of the monitor 107. Furtherstill, the digitizer 165 may
`
`be integrated in the monitor 107, or may exist as a separate device overlaying or otherwise
`
`appended to the monitor 107.
`
`
`
`The computer 100 can operate in a networked environment using logical connections to
`
`one or more remote computers, such as a remote computer 109. The remote computer 109 can
`
`- 19
`
`be a server, a router, a network PC, a peer device or other common network node, and typically
`
`20
`
`21
`
`22
`
`includes manyorall of the elements described aboverelative to the computer 100, although only
`
`a memory storage device 111 has beenillustrated in FIG. 1. The logical connections depicted in
`
`FIG. 1
`
`include a local area network (LAN) 112 and a wide area network (WAN) 113. Such
`
`03797.00074; 164085.1
`
`EX1013 - 6
`EX1013 - 6
`
`

`

`networking environments are commonplace in offices, enterprise-wide computer networks,
`
`intranets and the Internet.
`
`When used in a LAN networking environment, the computer 100 is connected to the
`
`local network 112 through a network interface or adapter 114. When used in a WAN networking
`
`environment, the personal computer 100 typically includes a modem 115 or other means for
`
`establishing a communications over the wide area network 113, such as the Internet. The
`
`modem 115, which may be internal or external, is connected to the system bus 130 viathe serial
`
`port interface 106.
`
`In a networked environment, program modules depicted relative to the
`
`personal computer 100, or portions thereof, may be stored in the remote memory storage device.
`
`It will be appreciated that the network connections shown are exemplary and other
`
`techniques for establishing a communications link between the computers can be used. The
`
`existence of any of various well-known protocols such as TCP/IP, Ethernet, FTP, HTTP and the
`
`like is presumed, and the system can be operated in a client-server configuration to permit a user
`
`to retrieve web pages from a web-based server. Any of various conventional web browsers can
`
`be used to display and manipulate data on web pages.
`
`FIG. 2 illustrates a tablet and stylus computer that can be used in accordance with various
`
`aspects of the present invention. Any orall of the features, subsystems, and functions in the
`
`system of Figure 1 can be included in the computer of FIG. 2. The computer 201 includes a
`
`large display surface 202, e.g., a digitizing flat panel display, preferably, a liquid crystal display
`
`(LCD)screen, on which a plurality of graphical user interface windows 203 is displayed. The
`
`display is preferably oriented in "portrait" mode (Le., vertically), as opposed to “landscape"
`
`mode (i.e., horizontally). Using stylus 204, a user can select, highlight, and write on the
`
`
`
`17
`
`18
`
`19
`
`20
`
`21
`
`22
`
`03797.00074; 164085, 1
`
`EX1013 - 7
`EX1013 - 7
`
`

`

`digitizing display area. Examples of suitable digitizing display panels include electromagnetic
`
`pen digitizers, such as the Mutoh or Wacom pendigitizers. Other types of pen digitizers, ¢.g.,
`
`optical digitizers, may also be used. The computer 201 interprets marks made using stylus 204
`
`in order to manipulate data, enter text, and execute conventional computer application tasks such
`
`as spreadsheets, word processing programs, and the like. One commercially available tablet and
`
`stylus computer incorporating many of these features is the Stylistic 2300 computer sold by
`
`Fujitsu Personal Systems, Inc., of Santa Clara, California.
`
`A stylus could be equipped with buttons or other features to augment its selection
`
`capabilities. In one embodiment, a stylus could be implemented as a “pencil” or “pen”, in which
`
`one end constitutes a writing portion and the other end constitutes an “eraser” end, and which,
`
`when moved across the display, indicates portions of the display are to be erased. Additionally,
`
`a user’s own finger could be used for selecting or indicating portions of the displayed image on a
`
`touch-sensitive or proximity-sensitive display.
`
`In accordance with various inventive principles, a tablet PC user interface accepts a
`
`spectrum of input ranging from entering characters via a simple virtual keyboard through single
`
`stroke or single character recognition. Single stroke refers to using one stroke to symbolize a
`
`character. The spectrum continues from single character through cursive recognition, and
`
`through to speech recognition. A user interface in accordance with the principles of this
`
`invention, integrates these concepts together into a single user interface that allows a user to
`
`input text information via various types of input in a seamlessly integrated and synchronized
`
`manner.
`
`
`
`
`19
`
`20
`
`21
`
`03797.00074; 164085.1
`
`EX1013 - 8
`EX1013 - 8
`
`

`

`These text
`
`input
`
`techniques work differently for different users.
`
`For example,
`
`handwriting recognition and speech recognition work well for some users and not as well for
`
`other users. Of course, any particular user is morelikely to use recognition techniques that work
`
`relatively more efficiently than other techniques based upon any particular circumstances. For
`
`instance, while speech recognition may work well for a user, it might be inappropriate for a
`
`social context such a meeting with other people. For dictating a letter in a relatively private
`
`setting, however, speech recognition may be more appropriate. Ambient noise mayalso affect
`
`the effectiveness of speech recognition.
`
`In general terms,
`
`individual users will tend to use
`
`different input methods at different times. Depending upon whatthe inputis, different types of
`
`recognition may be more effective. For instance, cursive handwriting recognition may be very
`
`effective for a letter without many special symbols, but URL's and/or mathematical equations
`
`and the like typically will be more effectively recognized by a symbol recognizer.
`
`Preferably, a user is able to configure the user interface to the user's preferences. For
`
`example, the character recognizer may be shown or hidden based upon how the user configures
`
`the user interface. Several variations are set forth in the figures and are discussed below.
`
`Figure 3 depicts several example layouts for a slide out text input panel having three tabs
`
`for switching between input recognizers, namely, Words, Keyboard, and Characters. The Words
`
`tab is a word recognizer with a symbol button pad. The symbolbutton pad facilitates recognition
`
`of symbols characters, such as the symbols shown in the symbol pad of example layout 1 of
`
`Figure 3. The example layouts shown in Figure 3 are numbered in the lower right hand corner of
`
`each example layout from 1 through 7.
`
`
`
`19
`
`20
`
`21
`
`0379700074; 164085. 1
`
`EX1013 - 9
`EX1013 -9
`
`

`

`]
`
`2
`
`3.
`
`4
`
`5
`
`6
`7
`
`8
`
`9
`
`The view menu on the tab bar allows a user to select between using this tab with a
`
`symbol pad, character recognizer, or noneatall, as depicted in example layouts 1, 2, and 3 of
`
`FIG.3, respectively. The Charactertab also has the same interaction with the view menu. Users
`
`can toggle on/off or swap the symbol pad with the word recognizer , as depicted in example
`
`layouts 5 and 7 of FIG.3, respectively. The Keyboard is a simplified "Qwerty" layout without
`
`the function keys. The function keys can be accessed by the Fn button, which will open a pop-
`‘menu of F1-12. Sym key will do the same for symbols. The Symbols menu item in the tab bar
`
`will also bring up a MRU(mostrecently used) menu of symbols plus other prioritized symbols.
`
`User assistance can be found in a status help area on example layouts 1,2,3,5, and 7 of
`
`FIG. 3. These example layouts use the area just below the recognition pads (the area where
`
`“word recognizer" appears in layout 1) to give the user, better cues on what each tab does and
`
`how it works. The word recognition grid also uses a watermark, which disappears when the pen
`
` is hovered over it, that shows users where recognized ink should be written. The Stage, which is
`
`
`142 an area for displaying a preview of recognized characters, symbols, or words, also has
`
`descriptive text that appears whenit is first opened, as shown near the top of layout 3.
`
`The "thumb tab" appearing near the middle from top to bottom on the right side of each
`
`17.
`
`18
`
`19
`
`20
`
`21.
`
`22
`
`example layout in FIG. 3 can be usedto slide out a text input panel when a user wantsto use the
`
`text input panel. The thumb tab can be used again after the user is done with the text input panel
`
`to "hide" the text input panel, with the exception of the thumb tab.
`
`FIG. 4 depicts several example layouts for the Word tab of FIG. 3. A gray border area
`
`~+may be included to focus a user's attention to the edit line areas. Anything written in the gray
`
`area could be neither recognized nor rendered on the screen as ink. The bottom right sketch
`
`0379700074, 164085.1
`
`EX1013 - 10
`EX1013 - 10
`
`

`

`includes a grid design for the character recognizer on the right side with discrete areas for
`
`- capital, lower case, number, and symbol characters.
`
`FIG. 5 depicts a text input panel docked at the taskbar and launched from the right of the
`
`status area. The keyboard and word recognizer are presented as tabs in the taskbar. This
`
`example layout also has a menu bar on top with a keybar below. This layout occupies the full
`
`width of the display screen. The text input panel depicted in FIG. 5 could be grabbed by the top
`
`bar and ripped off (i.e., dragged away from) the taskbar to float like a separate window.
`
`FIG. 6 depicts the text input panel docked at the taskbar as in FIG. 5 with the "jot" (ie.,
`
`character recognizer) selected from the menubar.
`
`FIG. 7 depicts the text input panel docked at the taskbar as in FIG. 5 with the keyboard
`
`displayed.
`
`FIG. 8 depicts the text input panel docked at the taskbar as in FIG. 5 with a toggle-on
`
`button in the lower right-hand corner. The toggle-on button can be changed using the pop-up
`
`menu arrow to switch between writing and keyboard or by using the tabs. This layout includes
`
`
`
`f the keybar as a button pad to the right.
`
`
`
`18
`
`19
`
`20
`
`21
`
`22
`
`FIG. 9 depicts the character recognizer on and as a single pad: The pad can beset to
`
`recognize capital, lower case, or numbers and symbols by selecting the buttons belowit.
`
`FIG. 10 depicts the docked text input panel with a multi-line stage.
`
`FIG. 11 depicts the docked text input panel with a full width keyboard. As will be
`
`apparent other similar layouts could also be used.
`
`Referring to FIG. 12, a soft keyboard 1200 processes input from a tablet PC's virtual
`
`keyboard/key bar/symbols.
`
`In other words, the soft keyboard 1200 processes input other than
`
`03797,00074; 164085. 1
`
`EX1013 - 11
`EX1013 - 11
`
`

`

`handwriting in the form of button clicks and menu choices. A word recognizer 1202 and a
`
`character recognizer 1204, on the other hand are grouped together within a box drawn in dashed
`
`lines to indicate that the user gets both of them together, subject to the user configuring the text
`
`input panel otherwise. The dashed line box around soft keyboard 1200 indicates that, from the
`
`user's perspective, the soft keyboard is a different part of the user interface than the word and
`
`character recognizers. A speech recognizer 1206 translates the user's speech into text.
`
`A users goal is getting text into an application program 1208. The soft keyboard is a
`
`reliable way to enter text into an application. The user brings up the soft keyboard and actuates
`
`it by tapping on keys with the user's pen. On screen presses are translated into actual key stroke
`
`commandsthat an operating system understands.
`
`The soft keyboard may besized to approximately the samesize that the word recognizer
`
`and character recognizer previously occupied on the display. Alternatively, separate sizes could
`
`be stored for use with the soft keyboard on the one hand and the character and word recognizers
`
`on the other hand.
`
`The soft keyboard, character, word, and speech recognizers each pass data to the
`
`background recognizer 1210, which synchronizes input from these sourcessothat if a user inputs
`
`some handwriting and then taps on a soft keyboard key, background recognizer 1210 preserves
`
`the order in which the user entered the input from various sources. Notwithstanding that the
`
`word recognizer operates fairly quickly as perceived by the user, the synchronization mentioned
`
`above is desirable because the word recognizer typically takes longer to recognize words than the
`
`soft keyboard takes to recognize key presses. Accordingly, if a user writes several words in the
`
`word recognizer area, also referred to as the word pad, then taps the space key, the words are
`
`
`
`19
`
`20
`
`21
`
`22
`
`03797.00074; 164085.1
`
`-10-
`
`EX1013 - 12
`EX1013 - 12
`
`

`

`1
`
`2
`
`3
`
`4
`
`5
`
`preferably recognizedfirst. Then the space is entered rather than performing whatever operation
`
`can be finished first. Speech recognition, like handwriting recognition, is typically relatively
`
`slower than recognition ofa soft keyboardpress.
`
`In addition, a user can preferably turn off automatic word recognition, which otherwise
`
`preferably occurs after user configurable timeout expires following a period of inking inactivity.
`
`6 When automatic word recognition is turned off, word recognition will not occur until the user
`
`7
`
`8
`
`9
`
`performs a text input panel operation other than writing words.
`
`The handwriting recognizer 1214 executes on a separate thread to allow the user interface
`
`to remain responsive to incoming requests from the user. Recognition results are then passed
`
`through the background recognizer to the operating system 1212, which passes the recognition
`
`Recognition results may optionally be passed to a window for providing the user a
`
`preview of the recognition results. This preview windowis also referred to as a stage andis
`
`depicted in FIG. 12 with reference number 1216.
`
` results, typically in the form of text, to the application 1208.
`
`Because the text
`
`input panel
`
`typically does not have direct access to the various
`
`applications running on the user’s system, the recognized text is displayed and a menu of
`
`alternate choices that have come back from the recognizer may also be provided so that the user
`
`18
`
`19
`
`20
`
`21
`
`can correct recognition inaccuracies before the text input panel sends the text to an application.
`
`A re-do/re-send button may be provided so that a user can send the sametext to multiple
`
`applications or can re-send text that did not go the intended application. The stage passes the
`
`‘recognition results to the operating system messagerouter.
`
`03797.00074; 164085.1
`
`-ll-
`
`EX1013 - 13
`EX1013 - 13
`
`

`

`1
`
`2
`
`3.
`
`4
`
`5
`
`6
`
`The character recognizer preferably decides what various strokes should be based onit’s
`
`vocabulary of knowing strokes and it provides a recognition result. Some gestures are carried
`
`over from the character recognizer to the word recognizer. There is a left to right stroke in the
`
`character recognizer that is recognized as space anda right to left stroke that is recognized as
`
`backspace. Because spaces and back spaces are entered frequently,
`
`the text
`
`input panel
`
`recognizes these gestures entered into an empty word recognizer area. Having a vocabulary of
`
`7~~gestures that a user can mix with the user's natural handwriting provides significant convenience
`
`8
`
`and increased efficiency to the user.
`
`9
`
`A user can preferably have a text input panel displayed and also get to see through it
`
`what's underneath the text input panel. Because displaying the text input panel in a translucent
`
`fashion may be undesirable to some users under certain circumstance, users are preferably able
`
`to have the text input panel displayed in translucent form never, always, or when the user's pen
`
` pad would advantageously increase the accuracy ofthe left-to-right gesture being interpreted as a
`
`hovers over the text input panel.
`
`Like the symbol and character recognizer pads shown in various Figures and discussed
`
`above, a gesture pad could be provided. A user's inking or gestures in the such a gesture pad
`
`area would be interpreted as a gesture as opposed to a symbolor other character. Such a gesture
`
`space instead ofbeing erroneously recognized as a hyphen or an underscore, for instance.
`
`18
`
`19
`
`03797.00074; 164085.1
`
`-12-
`
`EX1013 - 14
`EX1013 - 14
`
`

`

`
`
`AYOWAW|GOLellauvossay(19![oF08)aooo:-Z6L
`
`
`GObfhEEEESTOSSASSae
`
`
`
`SMOMIENVauvVDOTWidasWOlLdoOLLENOVWCYVH
`
`
`
`bbbasnowwvaDoud|20+Neto.96+ouvordd|2°ONiveadO
`(WOH)qk001WALSAS AMOWAW
`
`
`YSZILIOIGozh_|O91solg
`
`YOLINONOAdIAONISSHOONdS6lonrivesao
`
`
`
`(_____wacon|IOn‘i*MYOMLAN
`ZOLgg}.SAvuOOud
`
`
`
`NOLLVoMdel¥vivasnveooudWALSAS
`
`SwvuooudSandon
`
`
`
`SRIOMIN.LuOd3AINd3AMYSICysia
`
`
`SOvaNaLN!||SOVSYSLNIFOVIYSLNI3OVINELNI
`SNWALSASYSHLO
`L60gOZ==]og,[=I|
`
`
`vaseYaLdvavLNA
`
`“,“7
`
`
`—Ort
`
`99f
`
`SLOWSY
`
`YaLNdWOSD
`
`ZLL
`
`SdIM
`
`VauV
`
`v6L
`
`|Old
`
`NOILVOMddv
`
`
`
`Ost(Wu)
`
`264wWvEooud
`
`sa1ndow
`
`EX1013 - 15G
`
`
`
`l-€LOLXS3
`
`
`
`
`
`
`
`

`

` =!Li
`
`GG
`
`
`
`nHetepee,
`
`*
`
`202
`
` 20t-7
`
`203
`
`FIG. 2
`
`EX1013 - 16
`EX1013 - 16
`
`
`

`

`"End | Hone
`
`"Tab
`
`Fee:
`
`CES Se:
`¢
`
`ckSpACe
`
`- Dale: 2
`
`Space.
`
`word recognizer.
`WeRt On tis BGS Outs se {5
`Se
`KOE LPI,
`
`BRcecesecsegeenes
`
`we
`AR ane
`RODGNAEACh
`abarres
`
`Word VEGOQWLZEr.
`iste sor the bababees, along tp eategrins vor):
`
`};i
`
`tine lined eon PEOET
`
`PSE ponannngewe wT
`
`Eat oy
`psondvanntinungt.
`Qiw
`
`
`
`a G) oo
`
`EX1013 - 17
`EX1013 - 17
`
`

`

`
`
`81-€LOLXA
`
`EX1013 - 18
`
`WAM
`
`ahGYceSeereesUESEAnGHRHOELEAOTDSOASOrd
`
`aREEafSaedeBieriTBfiveihevestler
`
`
`
`LazIMGOIATLAO.
`
`weds
`
`AaZloosasr
`
`fASe
`
`4GARoohakpaey,
`
`Saceies
`Semeees
`
`Loweneset
`
`"gS&4StesOtudone,
`
`rentttaceawae
`
`
`
`D353.wedeiieg|
`
`et
`
`sone
`
`“HORUSBESAENBehe
`
`e
`
`.
`
`=
`
`we
`
`ccreageennNTSNTNes
`
`AIZIMOOIIA
`
`AIM
`
`
`
`AIZIMGAIGAAIM
`
`aredsyiedEtis
`-ey
`
`
`
`

`

`eoeees
`:
`an ‘
`Rf av Hi Yew
`
`.
`
`Symbols Modhfiers
`
`SORE
`DASSRGESERS
`SSee
`Options
`
`Ctrl|Alt}Home}End
`
`View
`
`Symbols Modifiers
`
`Options
`
`yveeions bs wyke ona chargchay at 2 tite...
`
`EX1013 - 19
`EX1013 - 19
`
`

`

`RONEN
`
`Se
`
`Backspace § Home
`
`carreraNOIpace
`
`EX1013 - 20
`EX1013 - 20
`
`

`

`ee
`
`$
`
`es wee
`
`Neate
`~
`rate
`rena,
`Shaeseeennee ees
`es
`ek
`:
`Se
`=
`Ses
`nat ea
`Bates
`-
`yuma RR
`Soa
`=
`Sane
`
`acest eSaTICY eISeysetaeniieeeaCEIAeRSIUM GAMERA 0
`sat enCm
`SosetesoectsTete
`
`ceSRNNmSRRCLARANRNINNAARANSNAPORNANNOORNAPONOESRDONAKNDNANONNAANNMARARRONNARUN 7
`RAPAAAARAMOCARRASACAPDODOKeSAAANARECAPROGAAAI RII =
`
`lohYraaton tha wild ete chesattes ab a hier...
`
`=
`Sieecscuceess
`aS SR
`
`S
`
`Pee
`: See
`
` shen
`
`beyat
`Fcae
`Wodass
`Ha"
`ay4g
`Bi
`
`ihe
`
` soages1
`pee ae
`
`earegy
`
`
`sateHAi,ottttee
`
`(ltaen)
`Deimape
`
`III
`
`Tethereresnsanctats
`
`*
`
`ETONANANANO
`
`
`
`
`:
`$3
`eae
`ie
`secuapbenagmee
`sehen
`“
`SESS ER een
`PISO OORT
`
`a
`%
`
`Soe
`mS
`
`:
`
`ne
`Peas
`eee
`meaner
`See
`
`Y
`
`rice
`S
`
`EX1013 - 21
`EX1013 - 21
`
`

`

`
`
`He
`
` idaseGI
`
`
`
`
`
`a8
`
`Seca
`
`= Pgon
`
`Redirect:
`“
`
`: Poup
`
`\G@. LL
`
`EX1013 - 22
`EX1013 - 22
`
`

`

`EX1013 - 23€¢
`
`
`
`-€LOLXA
`
`vLZlOLZt
`
`uoleoydde
`
`80cl
`
`Buijesedo
`
`wa}shs
`
`eBessow
`
`J9}NoJ
`
`CLL
`
`e6e}s
`
`ObcL
`
`GbOld
`
`
`
`
`
`punoByoeq||JeziuBooesJezjuBooesiBunuMpuey
`
`yoseds
`
`JeziuBooe
`
`9071
`
`||
`
`Joyoeseyo
`
`Jeziubooes
`
`vOEl
`
`JaziuBooa
`
`cOCh
`
`0oO0amBaowemta
`
`oAAAeRRUEHE
`
` |AaghNeoseAemeittaeeeeerERSDAOOwaAOOLEAIAaAtenenOTeRLAreeeatAnerwoememataecoeerneemaeayeagema
`
`
`
`
`preteeneeeeneerenercrewaghanaeeneneeenneneSeereagenenerneeeeeeeneQorreneemenerrneesetcamnneeney
`
`
`PJOMyos
`
`pieoghey
`
`0021
`
`i
`
`
`
`
`
`
`
`

`

` He
`
`
`
`SERUAMSReazenedteasedeanmesDnanasentestes
`
`zs resatan
`
`Se Nee yeean te oe eyee oun yale anevnrrtnn sad aaemaaad trae gnnt opera reeeEennetd dens denen cenderee tneese enna naw analy em namin
`
`RIANSARIAIAN
`Sa eee
`ae an
`
`es
`
`Backspace
`
`Version with a docked TIP with multi-line stage and tabs on the right.
`
`EX1013 - 24
`EX1013 - 24
`
`SLESOSIOIENOECOTION
`Bearasonorepteperenaa areae
`
`ane Senate LRMOReTR SOSAeNOAA Nee Seen rooms
`
`
` 25
`
`2
`
`geeg, as
`
`wh
`yg Fe
`
`

`

`cet i
`SRE Alt
`
`PHHORRDENNONOWARVERONGTAATENTADOUNEEDUANDEHAIUREMNEMNEMHOUHENOLEDOONEENSAMDENOREDORDENGSPUGAGEDEUREULAMHAEAGMNANNDANYRRMSYESHUEEOENAREDANSSYOOYAUDAUYOLONYHONONYKULsoUROEHA:
`
`NESTSESARISARIALETESTEPLPREDRISERSPAIREIERISER
`SARIS
`NRANLSOEAe SRSeA mena
`ERAONUMN eaten
`AS
`LARA
`AR
`
`oa
`CANAANAUT 1
`SANTANA
`
`Stage.
`
`seequensene:
`
`CENAENeHegareUN Ene EMUWileEUTOUTE TUNtNAeotey DAY 8UI L6H SNeOLE INTELNeLETTEEYIG AOE NMHEUMTG Taewytha
`AO AE ee Ae me he nw ene PL Oto web oe
`thm Ea wR EAR ORY we enw OR Eee OH Hee aw De me eae te
`
`fone
`
`er RE re OP nat OR a te ne a Ee TE DR nee Ee
`Deveteera reneaetameenrenisereeeas:
`
`Version ofdocked1TIP with a double line word recognizer and a double stacked keybar
`and stage.
`
`EX1013 - 25
`EX1013 - 25
`
`

`

`aneaRboanesuentnnsectuconsenersenesestene’
`
` ‘
`
`aotvorsnnesFanasaccursecsvesronssenarnaeass:
`
`PeeEnreeeneeamreRnRpRyeeeRe gecan eeeeae tee ne tedesdereenteeeaee anena nc enteees etneeennennenesfemme
`
`g z
`
`avetanepereceaspaannecepreses
`
`oi
`prs
`ea
`
`;
`i
`%:
`
`Seana
`
`Version ofdocked TIP with‘Stage
`
`ononbottom andkeybar as left pad
`
`EX1013 - 26
`EX1013 - 26
`
`

`

`MaaSpevounen Soees
`
`naaateneavendreasascecsseasssunsneracsesoee:
`
`Writing
`ereteervueeeernyy
`roe
`ee
`
`
`
`Stage onbottom with different keyboard layout using a inverted“—. for.arrows and
`numberpadcloserto real keyboard
`
`g
`*a
`wreclirsstcanipoensoee
`
`Zi
`
`Be
`aSates
`
`a
`
`EX1013 - 27
`EX1013 - 27
`
`

`

`
`
`
`
` seers
`
`aS
`3
`
`
`Rees
`i
`ried
`.
` om
`SREPacoheanBeachamne rma oone
`mee
`
`
`Men
` Se
`mac
`
`:
` Se eea Sse
`a
`RRRnaanee
`
`ermnanrenannnen
`
`we
`=]
`
`é
`RSa ea aa
`
`ae
`SineetstehnateeeeeeSerm
`
`wey487 1
`
`
`
`
`
`
`
`
`i
`Seeel
`has
`Suan
`
` I:
`
`ijiii;
`i
`i
`
`i
`Hy
`
`Bata, tothe I
`fected bathe
`3
`Sh SS
`
`Dear John,
`
`How is the weatherir]
`
`cederenn eeeanteegeennaargaseundseqeneessneewenanentye enasersesagaseeeeraoetaes.
`
`
`
`
`
`=
`
`ee:
`:
`
`a 2aelDovivaanererties eae
`
`EX1013 - 28
`EX1013 - 28
`
`

`

`ue
`
`sane
`neenannteatetenatyy
`Sees ee
`enue SENS
`
`EX1013 - 29
`EX1013 - 29
`
`
`
`aot
`
`& w
`
`pBe
`
`geeangesfee
`
`
`
`bmany2
`2
`eea
`
`#3
`
`Micrasatt
`fan ateta
`ae
`
`SENOSSPEEATRSLOTNT
`PPSnere
`. FORRES aAnEAAS
`an cnetevens SeeINTEoLeeT
`
`
`SAAS AASAAAAAAAAAS AASRAULASAARAAAN GAS
`
`Stats a hein asa,
`
`pasa
`Roca ce
`
`

`

`
`
`Serdwich vito
`stakes aroe
`
`Sardivichvas
`Wok closed
`wich quay
`
`38 Ot Tt Or
`
`
`
`
`
`
` Se EeRaeS
`
`EX1013 - 30
`EX1013 - 30
`
`

`

`waveeeee vaeeeetoe
`
`Bnav ettnereerere een enn antes vneae nnengeebngae teen esters genta eeneeree nae tee daedebe ene ne doce ren eeece nse tng ree ea ees
`
`Be
`
`~
`
`:
`
`fe
`
`Stabug ot Hekt area...
`
`anime
`©Poe: Se
`SEUae eas
`os
`a
`
`i es
`
`SENSORS
`ee
`g ES Sete
`ss
`SEE Conan Ae
`oe
`os
`5
`oe
`eee
`ener
`syueenren
`ae
`rata resem
`ee
`Ee eeees
`
`Seay.
`penance
`
`se
`
`amaunsacnad
`
`a
`
`EX1013 - 31
`EX1013 - 31
`
`

`

`
`
`
`
`AAAARAAIAARARAAAR UALARAAAAAASARS RASA RY
`
`a
`kspace|Del
`ogevwuvebueseed
`“4
`
`
`aneerbannandansonee
`ab} HejEnd §
`
`
`+
`
`aseedeccrcegenneegezeses
`
`
`Stabs ar hein asa,
`
`ecernemnncents:
`eee
`
`SS
`
`