=a
`
`2 =o
`o=>=
`
`i ~
`
`~ —
`— TV
`—_—— =
`== Cc
`
`BRUSSELS OFFICE:
`AVENUE LOUISE 326, BOX 37
`[O50 BRUSSELS, BELGIUM
`TELEPHONE 0O!1*322*646+0353
`FACSIMILE 011¢322*646¢2135
`
`FINNEGAN, HENDERSON, FARABOW, GARRETT ®& DUNNER,L.L.P.
`{300 I STREET, N.W.
`WASHINGTON, DC 20005-3315
`
`i
`
`202+408+4000
`FACSIMILE 202*408+4400
`
`WRITER'S DIRECT DIAL NUMBER
`
`(202) 408-4039
`
`2
`December 4 1997
`
`TOKYO OFFICE:
`TORANOMON NO. 45 MORI BUILDING
`
`I-S, TORANOMON 5-CHOME
`MINATO-KU, TOKYO IOS, JAPAN
`TELEPHONE 011+°813°3431 +6943
`
`FACSIMILE O11¢813*3431+¢6945
`
`ATTORNEY DOCKETNO. 3384.0115-00
`
`
`
`Box PATENT APPLICATION
`Assistant Commissioner for Patents
`
`Washington, D.C. 20231
`
`Re:
`
`New USS. Patent Application
`Title: NAVIGATION TOOL FOR GRAPHICAL USER INTERFACE
`Inventors: Brian Finlay BEATON,Colin Donald SMITH,
`and Bruce Dale STALKIE
`
`Sir:
`
`Weenclose the following papersforfiling in the United States Patent and Trademark
`Office in connection with the above patent application.
`
`a.
`
`b.
`
`c.
`
`d.
`
`e.
`
`f.
`
`Application - 18 pages, including 2 independent claims and 22 claimstotal.
`
`Drawings - 14 sheets of informal drawings, containing 22 figures.
`
`Declaration and Powerof Attorney.
`
`PTO Form 1595 - Recordation Cover Sheet.
`
`Assignmentto Bell-Northern Research Ltd.
`
`A check for $874.00 representing a $790.00 filing fee, $44.00 for additional
`claims, and $40.00 for recording the Assignment.
`
`Please accord this application a serial numberandfiling date and record and return the
`Assignment to the undersigned.
`
`

`

`FINNEGAN, HENDERSON, FARABOW, GARRETT & DUNNER,L.L.P.
`
`Box PATENT APPLICATION
`December4, 1997
`Page 2
`
`The Commissioneris hereby authorized to charge any additionalfiling fees due and any
`other fees due under 37 C.F.R. § 1.16 or § 1.17 during the pendencyof this application to our
`Deposit Account No. 06-0916.
`
`Respectfully submitted,
`
`FINNEGAN, HENDERSON, FARABOW,
`GARRETT & DUNNER,L.L.P.
`
`By: ¢
`
`E. Robert Yoches
`Reg. No. 30,120
`
`
`
`

`

`sa
`
`
`
`-l-
`
`NAVIGATION TOOL FOR
`GRAPHICAL USER INTERFACE
`
`RELATED APPLICATIONS
`
`This application is related to U.S. patent application, Serial No.
`08/_,_~—s (Atty. Docket No. 3884.0116-00), entitled INTELLIGENT TOUCH
`DISPLAY;and U.S. patent application, Serial No.08/___,_~—s (Atty. Docket No.
`
`3884.0117-00), entitled CONTEXTUAL GESTURE INTERFACE,both of which
`
`are filed concurrently herewith, and both of which are hereby incorporated by
`
`10
`
`reference.
`
`BACKGROUND OF THE INVENTION
`
`The present invention relates generally to graphical user interfaces (GUI),
`
`and more particularly to a navigation tool for graphical user interfaces.
`
`Until relatively recently, software-based documents have been primarily
`
`15
`
`viewed and manipulated on desktop or laptop computers with relatively large
`
`displays, typically 640 x 480 pixels or larger. These displays are often large
`
`enoughto display a full page of standard size pageorat least a significant portion
`
`of the page. Hence, on-screen graphical menus and controls displayed in window
`
`of an application did not greatly reduce the display area for the underlying
`
`20
`
`document. Computers also have peripheral devices such as a keyboard or a mouse
`
`to control the display of content information. Thus, viewing and navigating
`
`around a single-page or multi-page documenthave not posed muchdifficulty.
`
`Due to increasing focus on compactnessof electronic devices, however,
`
`the displays especially in portable electronic devices are becoming smaller and
`
`25
`
`smaller. Popular electronic devices with smaller display area include electronic
`
`organizers, PDA’s (personaldigital assistants), and graphical display-based
`
`telephones. Also available today are communicatorsthat facilitate various types
`
`of communication such as voice, faxes, SMS (Short Messaging Services)
`
`messages, e-mail, and Internet-related applications. These products can likewise
`
`30
`
`only contain a small display area.
`
`

`

`
`
`-2-
`
`To enable users to navigate around a full page of content information,
`
`these devices typically provide hard-keys for arrows as shown in Fig. 1. The hard-
`
`keys, however, not only increase the size but also add to the cost of the devices.
`
`Also, hard-keys generally provide limited options for direction of movement,e.g.,
`
`vertical or horizontal. They generally do not provide the freedom to move in any
`
`direction.
`
`Somedisplays of these devices also require a separate stylus having
`
`peripheral technologythat requires transmission of electromagnetic pulses or light
`
`to the display. These devices often require additional controllers such as buttons
`
`10
`
`on the bodyorthe tip of the stylus for activation. Furthermore, these styli require
`
`a powersource, either through wire or battery, and their compatibility is generally
`
`limited to a specific device.
`
`As shownin Fig. 2, other devices substitute hard-keys with graphical on-
`
`screen arrowsor scroll bars that are typically used in full-size computer displays.
`
`15
`
`The on-screen scroll bars, however, occupy valuable screen real estate and
`
`compoundthe limitations of small displays. Similar to the hard-keys, the on-
`
`screen arrowsalso generally restrict the navigational movement to horizontal or
`
`vertical direction.
`
`In other forms of on-screen GUIs, e.g., pop-up menus, also take up
`
`20
`
`valuable screen space, further reducing the available display area for content
`
`information. Additionally, on-screen pop-up menustypically provide available
`
`functions in multiple layers, thus requiring a user to movedeeply into the
`
`hierarchy before reaching the desired function. This is time consuming and
`
`renders the GUI cumbersomeandineffective.
`
`25
`
`Therefore,it is desirable to provide navigation tools that allow small-size
`
`devices while maximizing the use of available screen real estate.
`
`It is also desirable to provide tools to navigate within a document at any
`
`direction at varying speeds.
`
`

`

`-3-
`
`It is further desirable to provide navigation tools that can be activated
`
`without requiring specific electronic devices.
`
`In addition, it is further desirable to provide an improved GUIthat
`
`simplifies GUI by recognizing various characteristics of the touch input.
`
`
`
`SUMMARYOFTHEINVENTION
`
`
`
`
`
`Systems and methods consistent with the present invention provide
`
`graphical control tools for efficient navigation in display devices.
`
`Specifically, a method consistent with this invention of controlling display
`
`of content information in a physical viewing area comprises several steps.
`
`10
`
`Initially, the system displays the content information in the physical viewing area.
`
`The system also displays a representation of a control tool over the display of
`
`content information. Thereafter, the system receives a user input selecting the
`
`control tool, and controls the display of content information according to the user
`
`input.
`
`15
`
`A system consistent for this invention for controlling display of content
`
`information in a physical viewing area includes displaying means,receiving
`
`means, and controlling means. The displaying meansdisplays the content
`
`information in the physical viewing area, and displays a representation of a control
`
`tool over the display of content information. The receiving meansreceives a user
`
`20
`
`input selecting the control tool. Thereafter, the controlling means controls the
`display of the content information according to the user input.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The accompanying drawings, which are incorporated in and constitute a
`
`part of this specification, illustrate the invention and together with the description,
`
`25
`
`serve to explain the principles of the invention.
`
`

`

`
`
`In the drawings,
`
`Fig. 1 shows conventional hard-key arrowsfor navigation control;
`
`Fig. 2 shows conventional on-screen graphical navigation tool;
`
`Figs. 3A-3B are diagrams of an exemplary mobile telephone consistent
`
`with the principles of the present invention;
`
`Fig. 4 is a block diagram showing the elements of the mobile telephone of
`
`Fig. 3.A;
`
`Fig. 5 is a block diagram showing the components of the memory ofFig.
`
`4;
`
`10
`
`Fig. 6 is a block diagram of touch screen functionalities;
`
`Figs. 7A-7B show an exemplary inactive and active graphical navigation
`
`tool, respectively;
`
`Fig. 8 is a sample screen showing an active navigation tool;
`
`Figs. 9A-9C show exemplary features of the navigation tool;
`
`15
`
`Figs. 10A-10C are sample screens showing the navigation tool performing
`
`various navigation functions;
`
`Figs. 11A-11B show exemplary features of the navigation tool relating to
`
`speed of navigation;
`
`20
`
`Fig. 12 is a diagram illustrating a touch pointdistribution; and
`Fig. 13 is a flowchart illustrating the process of determining the size of the
`object making contact with the viewing area.
`
`DESCRIPTION OF THE PREFERRED EMBODIMENT
`
`Reference will now be made in detail to the present preferred embodiment
`
`of the invention, an example of whichis illustrated in the accompanying drawings.
`
`25
`
`Where appropriate, the same reference numerals refer to the same or similar
`
`elements. The appended claims define the scope of the invention; the following
`description does not limit that scope.
`
`The graphical navigation tool of the present invention may be
`
`implementedin a wide rangeof electronic devices mentioned above such as
`
`

`

`
`
`
`-5-
`
`electronic organizers, PDA’s, and graphical display-based telephones. Although
`
`the need to maximize the use of screen real estate is mostcritical in portable
`
`electronic devices with small displays, the present invention can also be
`
`implemented in full-size computers or electronic devices. For purposes of
`
`illustration, however, the present invention will be explained in detail in a mobile
`
`.
`telephone environment.
`Specifically, Fig. 3A shows a mobile telephone 310 and Fig. 3B shows an
`
`exemplary wireline telephone preferably having the graphical navigation tool
`
`consistent with the present invention. Mobile telephone 310 includes main
`
`10
`
`housing 310, antenna 320, keypad 330, and display 340. Fig. 4 showsthe
`
`hardware elements in mobile telephone 310 including antenna 410,
`
`communications module 420, feature processor 430, memory 440, sliding keypad
`
`A450, analog controller 460, display module 470, battery pack 480, and switching
`
`powersupply 490.
`
`15
`
`Antenna 410 transmits and receives radio frequency information for
`
`mobile telephone 210. Antenna 410 preferably comprises a planar inverted F
`
`antenna (PIFA)-type or a short stub (2 to 4.cm) custom helix antenna. Antenna
`
`410 communicates over a GSM (Global System for Mobile Communications)
`
`switching fabric using a conventional voice B-channel, data B-channel, or GSM
`
`20
`
`signaling channel connection.
`
`Communications module 420 connects to antenna 410 and provides the
`
`GSMradio, baseband, and audio functionality for mobile telephone 310.
`
`Communications module 420 includes GSM radio 421, VEGA 423, BOCK 425,
`
`and audio transducers 427.
`
`25
`
`GSMradio 421 converts the radio frequency information to/from the
`
`antenna into analog baseband information for presentation to VEGA 423. VEGA
`
`423 is preferably a Texas Instruments VEGA device, containing analog-to-digital
`
`(A/D)/digital-to-analog (D/A) conversion units 424. VEGA 423 converts the
`
`

`

`
`
`REE
`
`-6-
`
`analog baseband information from GSM radio 421 to digital information for
`
`presentation to BOCK 425.
`
`BOCK425is preferably a Texas Instruments BOCK device containing a
`
`conventional ARM microprocessor and a conventional LEAD DSP device.
`
`BOCK 425 performs GSM baseband processing for generating digital audio
`
`signals and supporting GSM protocols. BOCK 425 supplies the digital audio
`
`signals to VEGA 423for digital-to-analog conversion. VEGA 423 applies the
`
`analog audio signals to audio transducers 427. Audio transducers 427 include
`
`speaker 428 and microphone 429 to facilitate audio communication by the user.
`
`10
`
`Feature processor 430 provides GUI features and a Java Virtual Machine
`
`(JVM). Feature processor 430 communicates with BOCK 425 using high level
`
`messaging over an asynchronous (UART)data link. Feature processor 430
`
`contains additional system circuitry, such as a liquid crystal display (LCD)
`
`controller, timers, UART and businterfaces, and real time clock and system clock
`
`15
`
`generators (not shown).
`
`Memory 440 stores data and program code used by feature processor 430.
`
`Memory 440 includes static RAM 442 and flash ROM 444. Static RAM 442 is a
`
`volatile memory that stores data and other information used by feature processor
`
`430. Flash ROM 444, on the other hand, is a non-volatile memory that stores the
`
`20
`
`program code executed by feature processor 430.
`
`Sliding keypad 450 enables the user to dial a telephone number, access
`
`remote databases, and manipulate the GUI features. Sliding keypad 450
`
`preferably includes a mylar resistive key matrix that generates analog resistive
`
`voltage in responseto actions by the user. Sliding keypad 450 preferably connects
`
`25
`
`to main housing 310 (Fig. 4) of mobile telephone 210 through two mechanical
`
`"push pin"-type contacts.
`
`Analog controller 460 is preferably a Phillips UCB1100 devicethat acts as
`
`an interface between feature processor 430 and sliding keypad 450. Analog
`
`

`

`
`
`
`
`-7-
`
`controller 460 converts the analog resistive voltage from sliding keypad 450 to
`
`digital signals for presentation to feature processor 430.
`
`Display module 470 preferably includes a 160 x 320 pixel LCD 472 with
`
`an analog touch screen panel 474 and an electroluminescent backlight. LCD 472
`
`operates in conjunction with feature processor 430 to display the GUI features.
`
`Analog controller 460 scans touch screen overlay 474 while feature processor 430
`
`refreshes LCD 472.
`
`Battery pack 480 is preferably a single lithium-ion battery with active
`
`protection circuitry. Switching power supply 490 ensures highly efficient use of
`
`10
`
`the lithium-ion battery power by converting the voltage of the lithium-ion battery
`
`into stable voltages used by the other hardware elements of mobile telephone 210.
`
`Fig. 5 is a block diagram illustrating the components of memory 440.
`
`Static RAM 442 stores data and other information used by feature processor 430.
`
`Flash ROM 444 contains various programs including a program 510, a touch
`
`15
`
`screen program 520, a navigation program 530, and a drawing program 540.
`
`Program 520, preferably written in languages such as Java, C, or C++ for
`
`Macintosh, is a main program overseeing the operation of mobile telephone 310.
`
`Touch screen program 520 facilitates processing of touch input on touch
`
`screen panel 474 using a typical touch input algorithm. Navigation program 530
`
`20
`
`handles navigation of the content information display. Drawing program 540is a
`
`graphical drawing package. Programs 520, 530, and 540 may be one of any
`
`commercially available packages or a user-defined feature program or macro.
`
`The present invention provides various features through tactile GUI.
`
`Initially, LCD 472 displays various GUI features. Referring to Fig. 6, a user
`
`25
`
`touches touch screen panel 474 to provide user input, for example, to navigate
`
`around a document or invoke a desired function. Analog controller 460 scans
`
`touch screen panel 474 and reads the corresponding analog voltage of touch screen
`
`panel 474. Analog controller 460 then converts the analog values into
`
`corresponding digital values representing the Cartesian coordinates, which are
`
`

`

`
`
`-8-
`
`transmitted to feature processor 430 for processing. The resolution of the touch
`
`input dependsonthe ability of analog controller 460 to discern among multiple
`
`levels of analog values, generally defined inbits.
`
`Figs. 7A-7B show an exemplary graphical navigation tool preferably used
`
`to navigate around documents that are too large to view within a single screen of a
`
`physical display (hereinafter referred as "viewing area"). The navigation tool may
`
`be used to view any kind of document including faxes, Web pages, or e-mail. In
`
`one embodimentconsistent with the present invention, an inactive navigation tool
`
`is displayed and accessible to the user at all times (Fig. 7A). The user may
`
`10
`
`activate the navigation tool by touching and holding the center of the navigation
`
`tool for a predetermined time period, for example, one to two seconds (Fig. 7B).
`
`An activated navigation tool is preferably transparent to avoid hindering the
`
`display of content information in the viewing area as shown inFig.8.
`
`Alternatively, the navigation star may changecolors or other features of its
`
`15
`
`appearanceto indicate its active status. A solid line image, for example, may be
`
`used in greyscale displays that do not support transparency.
`
`The present invention may be designed such that feature processor 430
`
`ignores any touch input on the navigation tool unless the navigation tool has been
`
`activated. Instead, the touch input may beinterpreted as input to access control
`
`20
`
`buttons in the underlying document, write on the underlying document, or invoke
`
`other functions related to the underlying document. This will prevent against
`
`unintentional navigation in the viewing window in case the user mnadvertently
`
`touches touch screen panel 474. In an alternative embodiment, the present
`
`invention may accept stylus input to access the underlying document while a
`
`25
`
`finger or non-electromagnetic touch on any part of the navigation tool invokes the
`
`navigation function.
`
`Referring to Figs. 9A-9C, once the navigation toolis activated, the user
`
`may navigate through the documentby selecting the graphical arrows,e.g., up,
`
`right, left, and down arrows (Fig. 9A), or graphical page icons,e.g., previous or
`
`

`

`
`
`-9-
`
`next page (Fig. 9B). One skilled in the art may vary the type and numberof
`
`graphical tools significantly. For example, the navigation tool may provide
`
`graphical representations for forward, next document, back, or home functions
`
`(Fig. 9C).
`
`Figs. 10A-10C show exemplary screen displays while the useris touching
`the navigation tool. Upon touching the right arrow of the navigation tool, for
`
`example,the right arrow is highlighted and navigation program 530 movesthe
`
`display to the right (Fig. 10A). Similarly, touching the down arrow movesthe
`
`display down (Fig. 10B). Although the four arrowsare presented to guide the
`
`10
`
`users, navigation program 530 supports navigational movementat any direction.
`
`If the user touches an area of the navigation tool equidistant between the up and
`
`right arrows, for example, navigation program 530 will move the display towards
`
`the upper-right portion of the underlying document at a 45-degree angle.
`
`Touching the arrowsor any area in between, movesthe display in the selected
`
`15
`
`direction until navigation program 530 reaches the edgeof the page.
`
`Touching the next page icon movesthe viewing window to the next page
`
`of the underlying document(Fig. 10C). Ifa particular document does not have a
`
`page corresponding to a previous or next page icon, navigation program 530 will
`
`not display the respective previous or next page icons. This would apply to one-
`
`20
`
`page documents, or when the useris at the beginning or end of a multi-page
`
`document. In one embodiment consistent with the present invention, a
`
`momentary touch of the next page icon causes navigation program 530 to jump to
`
`the next page while a continuous touch on the next page icon causes navigation
`
`program 530 to continue scrolling through succeeding pages of the underlying
`
`25
`
`document. The previous page icon may embody similar characteristics.
`
`The user mayalso control the speed of the navigation. As shown in Fig.
`
`11A,the speed of the navigation accelerates as the user touch moves from the
`
`center of the circle toward the circumference ofthe circle, i.e., tip of the arrow.
`
`Hence, the viewing window moves slowly whenthe user touchesthe blunt end of
`
`

`

`
`
`
`-10-
`
`the arrow located at the center of the circle while the speed accelerates as the user
`
`movesthe finger towards the tip of the arrow. The speed of navigation, therefore,
`
`is determined by the distance of the touch relative to the center ofthe circle.
`
`Likewise, similar principles apply to previous or next page/document icons where
`
`a touch closer to the outer edge of the previous or next page/documenticons
`
`accelerates navigation through the document as shown in Fig. 11B.
`
`Although the exemplary transparent tool discussed aboveis for navigation,
`
`transparent control tools may be implemented for a variety of functions. A
`
`transparent tool may, for example, be used for a Web browser application where
`
`10
`
`the controls may be used for appropriate functions such as moving forwards or
`
`backwards through different Web pagesor returning to home page. Oneskilled in
`
`the art may easily vary the design or the functionality of the graphical navigation
`
`tools described above without departing from the scope of the present invention.
`
`In an exemplary embodimentof a navigation tool described above,a finger
`
`15
`
`touch invokes navigational functions based on the feature selected and the
`
`location of the user touch. Alternatively, other objects making contact with touch
`
`screen panel 474 may invokeother tools or functions. A pointy stylus touch, for
`
`example, may invoke a menu with cardinal points representing multiple line
`
`widths, colors, or patterns.
`
`20
`
`In another embodimentconsistent with the present invention, tools or
`
`application programs maybe stored in flash ROM 444to provide related
`
`interfaces to the user. The use of a finger may, for example, invoke tools or
`
`dialoguesthat are finger-touchable and large whereas the use of a sharp stylus may
`
`invoke a modified GUI with smaller touch targets. In a yet another embodiment,
`
`25
`
`in a document viewing application normally navigable by a finger touch, use of a
`
`sharp stylus may automatically invoke a document annotation application for
`
`marking up the underlying document.
`
`Asdescribed above, the touch-responsive GUI ofthe present invention are
`facilitated though various components including touch screen panel 474, analog
`
`

`

`
`
`
`
`
`-l1-
`
`controller 460, and feature processor 430. Specifically, analog controller 460
`
`scans touch screen panel 474 to read the corresponding analog voltage of touch
`
`screen panel 474 activated by a user touch. Analog controller 460 then converts
`
`the analog valuesinto a digital value representing the Cartesian coordinates,
`
`which is transmitted to feature processor 430 for processing according to the
`
`functionalities of the present invention.
`
`Whena user touches touch screen panel 474, program 510 initiates touch
`
`screen program 520 to determine the pointer size of the object making contact
`
`with touch screen panel 474 based on a touch point distribution or pointer size of
`
`10
`
`the touch input. As shown in Fig. 12, touch screen program 520 can, for example,
`
`determine whetherthe pointer size of the object is a finger or a sharp object.
`
`Fig. 13 is a flowchart illustrating the process of determining the size of the
`
`object making contact with the viewing area. Touch point program 520 first
`
`determinesthe individual points of contact made by the object (step 1310). It
`
`15
`
`computesa centroid, or other average point, of the determined points of contact
`
`(step 1320). Touch program 520 then computes a standard deviation of the
`
`centroid as well as the variance (step 1330), and determines the pointer size based
`
`on the centroid and the standard deviation (step 1340). These computations are
`
`20
`
`preferably performed ona real-time basis to provide immediate system response
`to the touch input. In order to achieve optimum results and accuracy, analog touch
`controller 460 preferably generates 150 points per second or more. Touch
`
`program 520 mayalso use the amountof pressure imposed on touch screen panel
`
`474 as a function of time to determinethe size of object. As shown in Fig. 14A,
`for example, if the amount ofpressure increases or decreases sharply at a
`
`25
`
`particular instant in time, touch point program 520 may determinethat the touch
`
`corresponds to a pen. A finger touch, on the other hand, results in a gradual
`
`increase and decrease in pressure as illustrated by a smoothercurvein Fig. 14B.
`
`

`

`
`
`-12-
`
`Program 510 can also be programmedto correlate certain pointer size to
`
`certain objects and invoke corresponding functionsor tools. Such GUI provides a
`
`richer, yet simplified interaction between the user and mobile telephone 310. If
`
`program 510 determines that the pointer size of the object correspondsto the size
`
`of a finger, program 510 mayinitiate a navigation tool. If the pointer size
`
`correspondsto the size of several fingers, program 510 may invoke a drag
`
`function of the navigation tool. On the other hand, if program 510 determinesthat
`the pointer size of the object correspondsto size of a sharp point or pen, program
`
`510 mayinitiate a drawing tool supported by drawing program 540. Similarly, if
`
`10
`
`program 510 determines that the pointer size of the object correspondsto size of a
`
`pencil eraser, program 510 mayinitiate an erase function of the drawing tool. One
`
`skilled in the art may easily vary the functions or tools initiated by program 510.
`
`Additionally, the functions or tools may be commercial software packages,
`
`predetermined functions, or user-defined macros.
`
`15
`
`In addition to using the pointer size to determine the desired GUI, program
`
`510 can also incorporate other characteristics of the user touch, e.g., gestures or
`
`movements, to simplify GUI and maximizescreen real estate. A gesture
`
`recognizing interface extendsthe ability of the present invention to distinguish
`
`between different sized pointers to track gestures and movement of user input
`
`20
`
`based on vector direction and magnitude,all in the context of active user
`
`application. This type of contextual gesture interface can infer by context, the
`
`implement, and the gesture chosen by the user what functions the user wishes to
`
`invoke. Accordingly,all these functions are available without menusorscroll
`
`bars and do not require additional screen areas to display the functions.
`
`25
`
`Program 510 recognizes other characteristics of the touch input including
`
`the context of the input, namely the task or sub-task applications running when the
`
`GUI is invoked. Ifa user is in a document navigation application, for example,
`
`program 510 interprets a quick drag to the right as a next page function. If the
`
`underlying task is an editing application, program 510 may interpret the same
`
`

`

`-13-
`
`gesture as a highlight function and highlight a portion of the document touched by
`
`the user. Similarly, in graphics application, a quick drag to the right may invoke a
`
`drawing tool to draw from the starting point to the ending point of the touch
`
`points. In a document viewing application, the same touch may invoke a
`
`navigation tool to move the view of the document in the direction of the finger
`
`drag.
`
`All of the above functions and features described above focuses on
`
`providing intuitive GUIs and minimize the need for users to memorize
`
`complicated, hierarchical menus or procedures. Additionally, the present
`
`10
`
`invention maximize available screen real estate while providing a widearray of
`
`GUI andtools.
`
`It will be apparent to those skilled in the art that various modifications and
`
`variations can be made in the system of the present invention and in construction
`
`of this system without departing from the scope or spirit of the invention. Other
`
`15
`
`embodiments of the invention will be apparent to those skilled in the art from
`
`consideration of the specification and practice of the invention disclosed herein.
`
`The specification and examples should be considered as exemplary only, with the
`
`true scope and spirit of the invention indicated by the following claims.
`
`
`
`

`

`
`
`
`-14-
`
`WHAT IS CLAIMEDIS:
`
`1.
`
`A method of controlling display of content information in a physical
`
`viewing area comprisingthe stepsof:
`
`displaying the content information in the physical viewing area;
`
`displaying a representation of a control tool over the display of content
`
`information;
`
`receiving a user input selecting the control tool; and
`
`controlling the display of content information according to the user input.
`
`2.
`
`The method ofclaim 1, further including the steps of
`
`receiving a user input selecting a predetermined portion of the control tool,
`
`and
`
`activating the control tool in response to the user input, and
`
`wherein the controlling step includes the substep of
`
`changing the display to a different portion of the content
`
`information.
`
`The method of claim 1, wherein the controlling step includes the substep
`
`3.
`
`of
`
`shifting the content information in the physical viewing area.
`
`4.
`
`The method of claim 3, wherein the shifting step includes the substep of
`
`scrolling to a different portion of the content information.
`
`5.
`
`The method of claim 3, wherein the shifting step includes the substep of
`
`jumpingto a different portion of the content information.
`
`

`

`
`
`-15-
`
`The method of claim 1, wherein the controlling step includes the substep
`
`6.
`
`of
`
`shifting the display of content information at a speed determined by to the
`
`user input.
`
`7.
`
`The method of claim 1, wherein the control information includes a
`
`plurality of pages, and wherein the controlling step includes the substep of
`
`displaying a different one of the pages of the content information.
`
`8.
`
`The method of claim 1, wherein the step of displaying the control tool
`
`includes the substep of
`
`displaying the control tool containing arrowsindicating direction.
`
`9,
`
`The method of claim 1, wherein the control information includes a
`
`document and
`
`wherein the step of displaying the control tool includes the substep of
`
`displaying the control tool indicating various functions related to the
`
`document.
`
`10.
`
`The method of claim 1, wherein the step of displaying the control tool
`
`includes the substep of
`
`displaying a transparent controltool.
`
`11.
`
`The method of claim 1, wherein the step of displaying the control tool
`
`includes the substep of
`
`displaying an opaque controltool.
`
`

`

`
`
`
`-16-
`
`12.
`
`An apparatusfor controlling display of content information in a physical
`
`viewing area comprising:
`
`meansfor displaying the content information in the physical viewing area;
`
`meansfor displaying a representation of a control tool over the display of
`
`content information;
`
`meansfor receiving a user input selecting the control tool; and
`
`meansfor controlling the display of the content information according to
`
`the user input.
`
`13.
`
`The apparatus of claim 12, further including
`
`meansfor receiving a user input selecting a predetermined portion of the
`
`control tool, and
`
`meansfor activating the control tool in response to the user input, and
`
`wherein the controlling means includes
`
`means for changing the display to a different portion of the content
`
`information.
`
`14.
`
`The apparatus of claim 12, wherein the controlling means includes
`
`meansfor shifting the content information in the physical viewing area.
`
`15.
`
`The apparatus of claim 14, wherein the shifting means includes
`
`meansfor scrolling to a different portion of the content information.
`
`16.
`
`The apparatus of claim 14, wherein the shifting means includes
`
`meansfor jumping to a different portion of the content information.
`
`17.
`
`The apparatus of clatm 12, wherein the controlling means includes
`
`meansfor shifting the display of content information at a speed determined
`
`by the user input.
`
`

`

`-17-
`
`18.
`
`The apparatus of claim 12, wherein the content information includes a
`
`plurality of pages, and
`
`wherein the controlling means includes
`
`meansfor displaying a different ones of the pages of the content
`
`information.
`
`19.
`
`The apparatus of claim 12, wherein the means for displaying the control
`
`tool includes
`
`meansfor displaying the control tool containing arrowsindicating
`
`direction.
`
`20.
`
`The apparatus of claim 12, wherein the content information includes a
`
`document, and
`
`wherein the means for displaying the control tool includes
`
`means for displaying the control tool indicating various functions related
`
`to the document.
`
`21.
`
`The apparatus of claim 12, wherein the meansfor displaying the control
`
`tool includes
`
`means for displaying a transparent control tool.
`
`22.
`
`The apparatus of claim 12, wherein the meansfor displaying the control
`
`tool includes
`
`meansfor displaying an opaque control tool.
`
`
`
`

`

`-18-
`
`ABSTRACT
`
`The system and method consistent with the present invention provides
`
`improved graphical navigation tool for electronic devices. The graphical
`navigation tools may be used to navigate through documentsat any direction at
`
`varying speeds. The navigation tool is preferably transparent to prevent obscuring
`the text of the underlying document. Accordingly, the navigational tool does not
`take up additional screen real estate. The GUI of the