avy United States
`a2) Patent Application Publication (0) Pub. No.: US 2003/0128195 Al
`(43) Pub. Date: Jul. 10, 2003
`
`Banerjee et al.
`
`US 20030128195A1
`
`(54) TOUCHSCREEN USER INTERFACE:
`BLUETOOTH ([00d6] STYLUS FOR
`PERFORMING RIGHT MOUSE CLICKS
`
`(75)
`
`Inventors: Dwip Banerjee, Austin, ‘IX (US);
`Rabindranath Dutta, Austin, TX (US);
`Robert J. Kamper, Round Rock, TX
`(US)
`
`Correspondence Address:
`Duke W.Yee
`Carstens, Yee & Cahoon, LLP
`P.O. Box 802334
`Dallas, TX 75380 (US)
`
`(73) Assignee:
`
`International Business Machines Cor-
`poration, Armonk, NY (US)
`
`(21) Appl. No.:
`
`10/042,048
`
`(22) Filed:
`
`Jan. 8, 2002
`
`Publication Classification
`
`
`Int. CL? ....
`(51)
`(52) US.Ch ...
`
`cosvessceseesneeeseesuveneceaeeanees G09G 5/00
`soeesecescesseesueesutssssseteeneesneenies 345/179
`
`(57)
`
`ABSTRACT
`
`A method, program and system for enabling alternate input
`commands by meansofa stylus associated with a personal
`digital assistant (PDA) are provided. The method comprises
`applying pressure to a pressure sensor on the stylus, which
`invokes an application on the PDA that interprets stylus
`input as cquivalcnt to a right mouse click on a computer. In
`response to the stylus being touched to an object displayed
`by the PDA,the application opens a menu associated with
`that object, wherein the menu allows a user to initiate
`specified object functions and to change specified properties
`of the object.
`Invoking the application on the PDA is
`accomplished via a Bluetooth™ signal between the stylus
`and PDA.
`
`Apple Inc.
`Exhibit 1009
`Page 001
`
`|
`
`
`
`Bluetooth
`301
`
`
`
`Stytus
`
`Blue
`tooth
`3124
`
`310
`
`
`
`Apple Inc.
`Exhibit 1009
`Page 001
`
`

`

`Patent Application Publication
`
`Jul. 10,2003 Sheet 1 of 9
`
`US 2003/0128195 Al
`
`
`
`100
`
`Network
`
`Figure
`
`Apple Inc.
`Exhibit 1009
`Page 002
`
`Apple Inc.
`Exhibit 1009
`Page 002
`
`

`

`Patent Application Publication
`
`Jul. 10,2003 Sheet 2 of 9
`
`US 2003/0128195 Al
`
`204
`
`Figure 2A
`
`Display
`
`Keypad
`Adapter
`
`Pracessor
`224
`
`Memory
`226
`
` Main
`
`Figure 2B
`
`Apple Inc.
`Exhibit 1009
`Page 003
`
`Apple Inc.
`Exhibit 1009
`Page 003
`
`

`

`Patent Application Publication
`
`Jul. 10, 2003 Sheet 3 of 9
`
`US 2003/0128195 Al
`
`Stytus
`
`| Blue
`taoth
`312
`—
`
`310
`
`—-——_—-—— —- —-—
`|
`
`
`
`
`
`PRA
`300
`
`Bluetooth
`301
`
`Figure 3
`
`Apple Inc.
`Exhibit 1009
`Page 004
`
`Apple Inc.
`Exhibit 1009
`Page 004
`
`

`

`Patent Application Publication
`
`Jul. 10,2003 Sheet 4 of 9
`
`US 2003/0128195 Al
`
` 4
`
`Useractivates pressure sensor
`
`
`401
`
`|
`
`——n.
`
`—
`
`—
`
`Pressure sensorintiates Bluetooth
`protocol
`402
`
`
`
`Biuetoath protocol instructs PDA to
`interprei stylus input as equivalent ta
`
`403
`
`
`
`
`Z rightmouseclickfunction
`4}
`
`
`User touches stylus to icon on PDA
`display
`404
`
`|
`
`Icon displays properties popup memu
`405
`
`
`
`
`
`User adjusts properties of object or
`application
`406
`
`
`
`Figure 4
`
`Apple Inc.
`Exhibit 1009
`Page 005
`
`Apple Inc.
`Exhibit 1009
`Page 005
`
`

`

`Patent Application Publication
`
`Jul. 10,2003 Sheet 5 of 9
`
`US 2003/0128195 Al
`
` are
`
`User presses button to invoke function
`504
`
`Lo
`
`Button press mapped to correspanding
`application
`502
`
`Application on stylus invokes corresponding
`503
`dL
`
`application on PDA
`
`
`
`|
`|
`
`
`
`
`Data exchange(in the application concept)
`using the stylus capabilities
`504
`
`fT
`
`
`
`Close connection
`
`505
`
`
`Figure 5
`
`Apple Inc.
`Exhibit 1009
`Page 006
`
`Apple Inc.
`Exhibit 1009
`Page 006
`
`

`

`Patent Application Publication
`
`Jul. 10,2003 Sheet 6 of 9
`
`US 2003/0128195 Al
`
`[
`
`
`
`|
`
` !
`
`User presses button to invoke application that uses
`Bluetooth communication to accomplish specific tasks
`601
`
`
`
`
`
`
`
`|
`Btuetoothdialup networking[fsinvoked
`fe—
`
`602
`
`
`
`Establishlink from stylus to PDA
`603
`
`Use service Discovery Protocel to find out what services
`
`are supportedbythe PDA
`
`Establishconnectiontoexchangedata |
`
`
`
`605
`
`
`Invoke specific services
`fo
`606
`
`
`607
`
`Exchange data
`
`
`Data
`
`
`exchange complete?
`608
`
`
`
`
`Close Bluetooth connection
`609
`
`FIgure 6
`
`Apple Inc.
`Exhibit 1009
`Page 007
`
`Apple Inc.
`Exhibit 1009
`Page 007
`
`

`

`Patent Application Publication
`
`Jul. 10,2003 Sheet 7 of 9
`
`US 2003/0128195 Al
`
`
`
`Sendinquiry packet
`
`701
`
`
`Receive FHS packet from other
`Bluetooth device
`702
`
`
`Look uplist of devices towhich a
`
`connection can be established
`703
`
`
`
`Passlist of devices to the application
`invoking Bluetooth
`
`704
` User selects device
`
`765
`
`Fig uré 7
`
`Apple Inc.
`Exhibit 1009
`Page 008
`
`Apple Inc.
`Exhibit 1009
`Page 008
`
`

`

`Patent Application Publication
`
`Jul. 10,2003 Sheet 8 of 9
`
`US 2003/0128195 A1
`
`|
`
`got
`
`Stylus pages PDA
`| —
`
`|
`|
`
`PBAscans for pages and initiated
`ACLsetue
`802
`
`
`L2CAP connection set up to transfer data
`between devices
`803
`
`
`
`
`L2CAP used to connect to service
`discovery on PDA
`804
`
`
`
`
`
`Stylus requests all information about
`pertinent application profile(s)
`805
`
`
`
`|
`
`L
`
`
`809a |
`
`_
`[styluscollectsservicediscoveryerm
`
`808
`
`Stylus closes SDP connection once all
`
`| servicediscoveryinformation is received
`
`807
`
`|
`I.
`
`User chooses which service to use
`
`808
`- J
`~ Establish connection to use the selected
`|
`service
`L.
`
`Figure 8
`
`Apple Inc.
`Exhibit 1009
`Page 009
`
`Apple Inc.
`Exhibit 1009
`Page 009
`
`

`

`Patent Application Publication
`
`Jul. 10,2003 Sheet 9 of 9
`
`US 2003/0128195 Al
`
`I
`
`[ Application sends quality of service
`requirements to the bluetooth module
`using HC!
`902
`
`Le.
`
`
`
`-
`
`
`
`
`Start paging process tp set up
`Establish a new connection
`|
`baseband ACLlink
`908
`|
`
`901
`.
`.
`.
`
`
`Devicein range?
`907
`
`
`
`
`
`
`Service complete?~~~
`910
`
`Yes
`
`
`Disconnect
`911
`
`
`
`
`Send and receive data
`906
`
`
`
`Configure link to meet quality of service
`requirments by means of LIMP
`903
`
`Continue using connection
`| 909
`
`
`
`Set up L2CAP connection
`904
`
`No
`
`LoTT
`
`Set up DUN connection
`905
`
`
`
`Figure 9
`
`Apple Inc.
`Exhibit 1009
`Page 010
`
`Apple Inc.
`Exhibit 1009
`Page 010
`
`

`

`US 2003/0128195 Al
`
`Jul. 10, 2003
`
`TOUCHSCREEN USER INTERFACE:
`BLUETOOTH [00D6] STYLUS FOR PERFORMING
`RIGHT MOUSE CLICKS
`
`BACKGROUND OF THE INVENTION
`
`[0001]
`
`1. Technical Field
`
`[0002] The present invention relates generally to portable
`computing deviccs and more specifically to data input.
`
`[0003]
`
`2. Description of Related Art
`
`[0004] Personal Digital Assistants (PDAs) often rely on a
`stylus to allowthe user to select objects and icons displayed
`on the PDA touchscreen. In traditional desktop and laptop
`computers employing a mouse or mouse equivalent (for
`laptops), sclection of icons and objects may be performed
`with either type of mouse click. Traditionally, a left mouse
`click opens or initiates an underlying object or application
`represented by an icon. Right mouse clicks are used to
`display property menus associated with an icon, which allow
`the user to make adjustments to the function of the appli-
`cations in question.
`
`[0005] Current stylus-based systems of writing on touch-
`screens use the stylus as the equivalent of a single-click
`mouse (usually equivalent to a traditional left mouse click).
`Ilowever, many applicationsare better if designed to accom-
`modate two mouseclick functions(i.e. left and right click).
`
`[0006] Therefore, it would be desirable to have a method
`for enabling the equivalent of two mouse click functions
`with a single writing stylus.
`
`SUMMARYOF THE INVENTION
`
`[0007] The present invention provides a method, program
`and system for enabling alternate inpul commands by means
`of a stylus associated with a personaldigital assistant (PDA).
`The method compriscs applying pressure to a pressure
`sensor on the stylus, which invokes an application on the
`PDAthat interprets stylus input as equivalent to a right
`mouse click on a computer. In response to the stylus being
`touched to an object displayed by the PDA, the application
`opens a menu associated with that object, wherein the menu
`allows a user to initiate specified object functions and to
`change specified properties of the object.
`Invoking the
`application on the PDA is accomplished via a Bluetooth™
`signal between the stylus and PDA.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`‘Ihe novel features believed characteristic of the
`[0008]
`invention are set forth in the appended claims. The invention
`itself, however, as well as a preferred mode of use, further
`objectives and advantages thereof, will best be understood
`by reference to the following detailed description of an
`illustrative embodiment when read in conjunction with the
`accompanying drawings, wherein:
`
`[0009] FIG. 1 depicts a pictorial representation of a net-
`work of data processing systems in which the present
`invention may be implemented;
`
`[0010] FIG. 2A depicts a diagramof a client in the form
`of a personal digital assistant (PDA) in accordance with a
`preferred embodiment of the present invention;
`
`[0011] FIG. 2B depicts a block diagramillustrating the
`hardware configuration of a PDA in accordance with a
`preferred embodiment of the present invention;
`
`[0012] FIG. 3 depicts a schematic diagram illustrating the
`incorporation of Bluetooth technology into a PDA/stylus
`design in accordance with the present invention;
`
`[0013] FIG. 4 depicts a flowchartillustrating the process
`of simulating a mouse rightclick with a stylus in accordance
`with the present invention;
`
`[0014] FIG. 5 depicts a flowchartillustrating the general
`algorithm for invoking the Bluetooth to carry out the desired
`function in accordance with the present invention;
`
`[0015] FIG. 6 depicts a flowchart illustrating the process
`of Bluetooth service discovery during connection setup in
`accordance with the present invention;
`
`[0016] FIG. 7 depicts a flowchartillustrating the process
`of establishing a link to other Bluetooth devices in accor-
`dance with the present invention;
`
`[0017] FIG. 8 depicts a diagram illustrating the process of
`determining what services are supported by a Bluetooth
`device in accordance with the present invention; and
`
` [0018] FIG. 9 dcpicts a flowchartillustrating the proccss
`
`of establishing a Bluetooth connection to a service in
`accordance with the present invention.
`
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENT
`
`[0019] With reference now to the figures, FIG. 1 depicts
`a pictorial representation of a network of data processing
`systems in which the present
`invention may be imple-
`mented. Network data processing system 100 is a network of
`computers in which the prescnt invention may be imple-
`mented. Network data processing system 100 contains a
`network 102, which is the medium used to provide commu-
`nications links between various devices and computers
`connected together within network data proccssing system
`100. Network 102 may include connections, such as wire,
`wireless communication links, or fiber optic cables.
`
`Inthe depicted example, a server 104 is connected
`[0020]
`to network 102 along with storage unit 106. In addition,
`clients 108, 110, and 112 also are connected to network 102.
`These clients 108, 110, and 112 may be, for example,
`personal computers or network computers. In the depicted
`example, server 104 provides data, such as boot files,
`operating system images, and applications to clients 108-
`112. Clients 108, 110, and 112 are clients to server 104.
`Network data processing system 100 may include additional
`servers, clients, and other devices not shown.
`
`In the depicted example, network data processing
`[0021]
`system 100 is the Internet with network 102 representing a
`worldwide collection of networks and gatcwaysthat usc the
`TCP/IP suite of protocols to communicate with one another.
`Atthe heart of the Internet is a backbone of high-speed data
`communication lines between major nodes or host comput-
`ers, consisting of thousands of commercial, government,
`educational and other computer systems that route data and
`messages, Of course, network data processing system 100
`also may be implemented as a numberof different types of
`networks, such as for example, an intranet, a local area
`
`Apple Inc.
`Exhibit 1009
`Page 011
`
`Apple Inc.
`Exhibit 1009
`Page 011
`
`

`

`US 2003/0128195 Al
`
`Jul. 10, 2003
`
`network (LAN), a wide area network (WAN), or a wireless
`network. FIG. 1 is intended as an example, and not as an
`architectural limitation for the present invention.
`
`[0022] With reference now to FIG. 2A, a diagram of a
`client in the form of a personal digital assistant (PDA) is
`depicted in accordance with a preferred embodimentof the
`present
`invention. PDA 200 includes a display 202 for
`presenting textual and graphical information. Display 202
`may be a knowndisplay device, such as a liquid crystal
`display (LCD) device. The display may be used to present a
`map or directions, calendar information, a telephone direc-
`tory, or an electronic mail message.
`In these examples,
`screen 202 may receive user input using an input device such
`as, for example, stylus 210. The present invention relates
`specifically to improving and expanding input options via
`stylus, such as stylus 210.
`
`[0023] PDA 200 may also include keypad 204, speaker
`206, and antenna 208. Keypad 204 may be used to receive
`user input in addition to using screen 202. Speaker 206
`provides a mechanism for audio output, such as presentation
`of an audio file. Antenna 208 provides a mechanism used in
`establishing a wireless communications link between PDA
`200 and a nctwork, such as nctwork 100 in FIG. 1.
`
`[0024] PDA 200 also preferably includes a graphical user
`interface that may be implemented by means of systems
`software residing in computer readable media in operation
`within PDA 200.
`
`[0025] Turning now to FIG. 2B, a block diagramillus-
`trating the hardware configuration of PDA 200 is shown in
`accordance with a preferred embodiment of the present
`invention. PDA 200 is an example of a PDA in which code
`or instructions implementing the processes of the present
`invention may be located. PDA 200 includes a bus 222 to
`which processor 224 and main memory 226 are connected.
`Display adapter 228, keypad adapter 230, storage 232, and
`audio adapter 234 also are connected to bus 222. Cradle link
`236 provides a mechanism to connect PDA 200 to a cradle
`used in synchronizing data in PDA 200 with another data
`processing system. Further, display adapter 228 also
`includes a mechanism to reccive uscr input from a stylus
`when a touch screen display is employed.
`
`[0026] An operating system runs on processor 224 and is
`used to coordinate and provide control of various compo-
`nents within PDA 200 in FIG. 2B. The operating system
`may be, for cxample, a commercially available operating
`system such as Windows CE, which is available from
`Microsoft Corporation. lostructions for the operating system
`and applications or programsare located on storage devices,
`such as storage 232, and may be loaded into main memory
`226 for execution by processor 224.
`
`[0027] Those of ordinary skill in the art will appreciate
`that the hardware in FIG. 2B may vary depending on the
`implementation. Other
`internal hardware or peripheral
`devices, such as flash ROM (or equivalent nonvolatile
`memory) or optical disk drives and the like, may be used in
`addition to or in place of the hardware depicted in FIG. 2B.
`
`[0028] With current stylus-based systems for writing on
`touchscreens, as in PalmOS or PocketPC, the stylus acts
`essentially as a single-click mouse with one button. How-
`ever, many applications are better designed with two mouse
`clicks (i.e.
`left and right clicking). The present invention
`
`addresses the problem of how to arrange for two mouseclick
`functions (the cquivalcnt of Icft and right clicking) with a
`single stylus, such as stylus 210 in FIG. 2. This is accom-
`plished by means of Bluetooth technology.
`
`[0029] Bluetooth is a wireless personal area network
`(PAN) technology. It is an open protocol for short-range
`transmission of digital data between mobile devices (e.g.
`PDA and mobile phones) and desktop devices. Bluetooth
`-cnabled mobile deviccs can communicate among them-
`selves without cables. Bluetooth supports both point-to-
`point and multipoint applications. Bluetooth can provide up
`to 720 Kbpsof data transfer within 10 meters (and up to 100
`meter with a power boost). Bluetooth does nat require line
`of sight, but instead uses omnidirectional radio waves, and
`employs a frequency hopping spread spectrum technique
`that changes the signal 1600 times per second. In casc of
`interference from other devices, transmission speed is down-
`graded, but the transmission does not stop. New chips and
`cards for laptop computers, as well as new PDAs,are being
`equipped with Bluetooth technology for communication
`with LANs,cell phones, and other network technologies.
`
`[0030] Referring to FIG. 3, a schematic diagram illustrat-
`ing the incorporation of Bluetooth technology into a PDA/
`stylus design is depicted in accordance with the present
`invention. PDA 300 and stylus 310 both incorporate Blue-
`ooth elements 301 and 312 respectively. These Bluetooth
`elements 301 and 312 facilitate the special features of the
`present invention. A pressure sensor 311 on stylus 310
`activates the Bluetooth-based communication and makesthe
`PDA 300 regard the traditional stylus click as equivalent to
`a right mouseclick.
`
`the user may press down on the
`[0031] Alternatively,
`pressure scnsor 311, without releasing pressure, to indicate
`an alternate state to the stylus action. For example,if the user
`resses with the stylus on anicon, the application or object
`represented by the icon will open normally(i.e. equivalent
`o left click function on a mouse). On the other hand, if the
`userpresses on the pressure sensor before pressing the stylus
`on the icon, the icon/object will display a properties page
`hat allows the userto set or adjust certain properties for that
`icon object or application.
`
`
` [0033]
`
`In yet another embodiment, the user may simulate
`[0032]
`a right click function by pressing on the pressure sensor of
`he stylus and, without releasing the pressure, touching the
`stylus to the icon. This action will result in the display of a
`popup menu with action options that may be performed on
`or bythe object.
`
`If the user presses the pressure sensor and then,
`withoutreleasing, touches the stylus to the pad and draws a
`cirele around a plurality of icons or objects, the resulting
`display will be a popup menu with action items that maybe
`erformed on or byall of the grouped icons.
`
`[0034] Referring to FIG. 4, a flowchart illustrating the
`process of simulating a mouse right click with a stylus is
`depicted in accordance with the present
`invention.
`‘The
`flowchart in FIG. 4 is an overview that encompasses all of
`he variants described above. The process is begun when the
`user activates the pressure sensor in the stylus (step 401). As
`described above, the user may activate the pressure sensor
`by pressing and then releasing it or by maintaining pressure
`hroughout the desired function. Activation of the pressure
`
`Apple Inc.
`Exhibit 1009
`Page 012
`
`Apple Inc.
`Exhibit 1009
`Page 012
`
`

`

`US 2003/0128195 Al
`
`Jul. 10, 2003
`
`sensor initiates the Bluetooth communication protocol (step
`402). The Bluctooth protocol then instructs the PDA to
`interpret subsequent stylus input as equivalent to a mouse
`right click (i.e. a request to display a properties/functions
`menu)(step 403). The user touches the stylus to an icon on
`the PDA display (step 404) and the icon displays a popup
`properties menu (step 405). From there, the user may make
`adjustments to the underlying object/ application, just as a
`user may do when using a mouse with a PC (step 406).
`
`[0035] Referring now to FIG. 5, a flowchart illustrating
`the general algorithm for invoking the Bluetoothto carry out
`the desired function is depicted in accordance with the
`present
`invention. The user presses the button (pressure
`sensor) to invoke the desired function (i.e. right click) (step
`501). The button press is mapped to a corresponding appli-
`cation on the stylus (stcp 502). This application then invokes
`the corresponding application on the PDA by using the
`Bluetooth module for communication between the stylus
`and the PDA (step 503). The necessary data is exchanged,
`within the application context, using the stylus Bluetooth
`capabilities (step 504). When the data exchange is finished,
`the communication connection is closed (step 505).
`
`[0036] Referring to FIG. 6, a flowchart illustrating the
`process of Bluetooth service discovery and data exchange
`during connection setup is depicted in accordance with the
`present
`invention. After the user activates the pressure
`sensorto invoke the application using Bluetooth (step 601),
`Bluetooth dialup networking is invoked (step 602). A link is
`established between the stylus and PDA(step 603), and the
`stylus uscs Service Discovery Protocol (SDP) to find out
`what services are supported by the PDA (step 604). SDP
`allows the stylus to be used with multiple devices and
`multiple services. Once the stylus knows which services are
`supported by the PDA, a connectionis established between
`the stylus and PDA (step 605) and specific services are
`invoked (step 606). In the present example,
`the specific
`services in question are those associated with a mouseright
`click, as explained above.
`
`[0037] Examples of other specific services which may be
`accessed with the present invention include calling up a
`calendaror e-mail by double clicking the pressure sensor or
`by means of another pressure sensor(s) on the stylus. E-mail
`messages or annotations to the calendar may then be hand
`written using the stylus.
`
`[0038] Data related to the specilic service is exchanged
`(step 607), and the processes is continually monitored to
`determine if the data exchange is complctc (step 608). If the
`exchange is not yet complete, the process continues. Once
`the data exchange is complete, the Bluetooth connectionis
`closed (step 609).
`
`[0039] Referring to FIG. 7, a flowchart illustrating the
`process of establishing a link to other Bluetooth devices is
`depicted in accordance with the present
`invention. An
`inquiry packet is sent from the stylus to the PDA (step 701).
`The PDA returns a Frequency Hop Synchronization (FHS)
`packet (step 702). The FHS packet contains the necessary
`information to establish a connection between the two
`devices.
`
`in the present example the PDA will be on the list of
`compatible devices. However, as mentioned above,
`the
`stylus may also be used with other devices and services.
`
`[0041] The user then selects the device (ie. PDA) to
`which a connectionis desired (step 705). Within the context
`of the present example (right clicking),
`the last step of
`selecting the device (PDA) can be performed automatically
`by the application.
`[0042] Referring to FIG. 8, a diagram illustrating the
`process of determining what services are supported by a
`Bluetooth device is depicted in accordance with the present
`invention. The stylus pages the PDA using information
`gathered during the inquiry (described above) (step 801).
`‘Vhe PDAscans[or and respondsto the pages [rom the stylus
`and initiates an Asynchronous ConnectionLess (ACL) link
`sctup (step 802). A logical
`link control and adaptation
`protocol (L2CAP) connection is set up to transfer data
`between the stylus and PDA(step 803). The L2CAP con-
`nection is used to access the service discovery function on
`the PDA (step 804). The stylus then requests all information
`about
`the pertinent application prolile(s)(slep 805), and
`collects the service discovery information (step 806).
`Optionally, the stylus mayclose the SDP connection onceall
`of the service discovery information is received (step 807).
`‘The user then chooses the desired service (step 808). As
`described above, the step of choosing the service may be
`performed automatically. Once the service is selected, a
`connection is established to use that service (step 809).
`[0043] Referring to FIG. 9, a flowchart illustrating the
`process of establishing a Bluetooth connection to a service
`is depicted in accordance with the present invention. The
`stylus starts the paging process to set up a baseband ACL
`link with the PDA (step 901). If the there are quality-of-
`service requirements, the application sends these require-
`ments to the Bluctooth module by means of a Host Con-
`troller Interface (HCT) (step 902). The Bluetooth module’s
`link manager then configures the link to meet the require-
`ments by means of Link Manager Protocol (step 903).
`
`[0044] After the ACL connection is set up, a L2CAP
`connection is sct up (step 904). Radio Frequency Commu-
`nication (RFCOMM)is used for the T.2CAP connection if
`dialup networking is used. ‘I'he Dialup Networking (DUN)
`connection is then established (step 905).
`[0045] Data is sent and received over the connection (step
`906), while the stylus continucs to monitor the range of the
`PDA(step 907). If the PDA moves out of range, a new
`connection is established (step 908), and the process returns
`to the beginning. If the PDA remains in range, the stylus
`continues to use the same connection (step 909), while
`monitoring the connection to determine if the service is
`complete (step 910). Once the service is complete,
`the
`connection is ended (step 911).
`[0046] The present invention solves the problem of pro-
`viding additional functionality to the pervasive computing/
`PDAtechnology interface by permitting a stylus to emulate
`functions previously available only with a mouse inpul
`device.
`
`[0047]
`It is important to note that while the present inven-
`tion has been described in the context of a fully functioning
`[0040] The stylus then looks upalist of Bluetooth devices
`data processing system, those of ordinaryskill in the art will
`to which it can connect(step 703), and passesthis list to the
`appreciate that the processes of the present invention are
`application which invoked Bluetooth (step 704). Naturally,
`
`Apple Inc.
`Exhibit 1009
`Page 013
`
`Apple Inc.
`Exhibit 1009
`Page 013
`
`

`

`US 2003/0128195 Al
`
`Jul. 10, 2003
`
`capable of being distributed in the form of a computer
`rcadable medium ofinstructions and a varicty of forms and
`that the present invention applies equally regardless of the
`particular type of signal bearing media actually used to carry
`out the distribution. Examples of computer readable media
`include recordable-type media, such as a floppy disk, a hard
`disk drive, a RAM, CD-ROMs, DVD-ROMs,andtransmis-
`sion-type media, such as digital and analog communications
`links, wired or wireless communications links using trans-
`mission forms, such as, for example, radio frequency and
`light wave transmissions. The computer readable media may
`take the form of coded formats that are decoded for actual
`usc in a particular data processing system.
`
`[0048] The description of the present invention has been
`presented for purposesof illustration and description, and is
`not intended to be exhaustive or limited to the invention in
`the form disclosed. Many modifications and variations will
`be apparent
`to thosc of ordinary skill
`in the art. The
`embodiment was chosen and described in order to best
`explain the principles of the invention, the practical appli-
`cation, and to enable others of ordinary skill in the art to
`understand the invention for various embodiments with
`various modifications as are suited to the particular use
`contemplated.
`
`Whatis claimed is:
`1. A method for enabling alternate input commands by
`meansof a stylus associated with a personal digital assistant
`(PDA), the method comprising:
`
`detecting activation of a pressure sensor on the stylus; and
`
`in response to the activation of the pressure sensor,
`iovoking an application on the PDA, wherein the
`application, in responseto the stylus touching an object
`displayed by the PDA, opens a menuassociated with
`that object, wherein the menu allows a user toinitiate
`specified object functions and to change specified
`object properties.
`2. The method according to claim 1, further comprising:
`
`in response to the stylus drawing a perimeter around a
`plurality of objects displayed by the PDA, opening a
`menu of object functions and object properties associ-
`ated with all objects in the perimeter.
`3. The method according to claim 1, wherein the step of
`invoking the application on the PDA is accomplished by
`means of a BlueTooth™ signal between the stylus and the
`PDA.
`
`4. A method for enabling input commands by means of a
`stylus associated with a personal digital assistant (PDA), the
`method comprising:
`
`detecting activation of a pressure sensor on the stylus; and
`
`in responseto the activation of the second pressure sensor,
`invoking an application on the PDA, wherein the
`application opensat least one of the following function
`on the PDA:
`
`e-mail, wherein e-mail messages can be hand wrilten
`by means of the stylus; and
`
`calendar, wherein annotations to the calendar maybe
`hand written by meansthe stylus.
`
`5. The method according to claim 4, wherein the step of
`invoking the application on the PDA is accomplished by
`means of a BlueTooth™signal between the stylus and the
`PDA.
`6. A method for enabling input commands by meansof a
`stylus associated with a personal digital assistant (PDA),the
`method comprising:
`detecting activation of a pressure sensor on a Blue-
`tooth™-enabled stylus; and
`in response to the activation of the pressure sensor,
`invoking an application on the PDA via Bluetooth™.
`7. Acomputer program product in a computer readable
`medium for use in a dala processing system, [or enabling
`alternate input commands by means of a stylus associated
`with a personal digital assistant (PDA), the computer pro-
`gram product comprising:
`instructions for detecting activation of a pressure sensor
`on the stylus; and
`instructions for invoking an application on the PDA in
`response to the activation of the pressure scnsor,
`wherein the application, in response to the stylus touch-
`ing an object displayed by the PDA, opens a menu
`associated with that object, wherein the menu allows a
`userto initiate specified object functions and to change
`specified object properties.
`8. The computer program product according to claim 7,
`further comprising:
`instructions for opening a menuof objcct functions and
`object properties associated with a plurality of objects
`displayed by the PDA,in responseto the stylus drawing
`a perimeter around said plurality of objects.
`9. The computer program product according to claim 7,
`wherein the instructions for invoking the application on the
`PDA are executed in Blue'looth™.
`10. A computer program product in a computer readable
`medium for use in a data processing system, for enabling
`input commands by means of a slylus associated wilh a
`personal digital assistant (PDA),
`the computer program
`product comprising:
`instructions for detecting activation of a pressure sensor
`on the stylus; and
`instructions for invoking an application on the PDA in
`responseto the activation of the second pressure scnsor,
`wherein the application opens at
`least one of the
`following function on the PDA:
`e-mail, wherein e-mail messages can be hand written
`by means of the stylus; and
`calendar, wherein annotations to the calendar may be
`hand written by means the stylus.
`11. The computer program product according to claim 10,
`wherein the instructions for invoking the application on the
`PDAare executed in BlueTooth™.
`12. A computer program product in a computer rcadable
`medium for use in a dala processing system, [or enabling
`input commands by means of a stylus associated with a
`personal digital assistant (PDA),
`the computer program
`product comprising:
`instructions for detecting activation of a pressure sensor
`on a Bluetooth™-enabled stylus; and
`instructions for invoking an application on the PDA via
`Bluetooth™in response to the activation of the pres-
`sure sensor.
`
`Apple Inc.
`Exhibit 1009
`Page 014
`
`Apple Inc.
`Exhibit 1009
`Page 014
`
`

`

`US 2003/0128195 Al
`
`Jul. 10, 2003
`
`13. A system for enabling alternate input commands by
`meansof a stylus associated with a personal digital assistant
`(PDA), the system comprising:
`a pressure sensor on the stylus;
`a module on the stylus which invokes an application on
`the PDA in response to activation of the pressure
`sensor, wherein the application,
`in response to the
`stylus touching an object displayed by the PDA, opens
`a menu associated with that object, wherein the menu
`allows a user lo iniliale specified object functions and
`to change specified object properties.
`14. The system according to claim 13, whercin the module
`that invokes the application on the PDA is a BlueTooth™
`module.
`15. A system for enabling input commands by means of
`a stylus associated with a personal digital assistant (PDA),
`the system comprising:
`
`a pressure sensor on the stylus; and
`a module on the stylus which invokes an application on
`the PDA in response to activation of the pressure
`
`sensor, wherein the application opensat least one of the
`following function on the PDA:
`
`e-mail, wherein e-mail messages can be hand written
`by means ofthe stylus; and
`
`calendar, wherein annotations to the calendar may be
`hand written by means the stylus.
`16. The system according to claim 14,