Ex. GOOG 1006
`
`EX. GOOG 1006
`
`
`
`
`
`
`
`
`
`
`
`

`

`- 1 -
`
`NAVIGATION TOOL FOR
`GRAPHICAL USER INTERFACE
`
`RELATED APPLICA IIONS
`
`5
`
`This application is related to U.S. patent application, Serial No.
`
`08/mM (Atty. Docket No. 3884.0116-00), entitled INTELLIGENT TOUCH
`
`DISPLAY; and U.S. patent application, Serial No.08/~~I..j(Atty. Docket No.
`
`3884.0117-00), entitled CONTEXTUAL GESTURE INTERFACE, both of which
`
`are filed concurrently herewith, and both of which are hereby incorporated by
`
`10
`
`reference.
`
`BACKGROUND OF THE INVENTION
`The present invention relates generally to graphical user interfaces (GUl),
`
`and more particularly to a navigation tcsl for graphical user interfaces.
`
`Until relatively recently, software-based documents have been primarily
`
`15
`
`viewed and manipulated on desktop or laptop computers with relatively large
`
`displays, typically 640 x 480 pixels or larger. These displays are often large
`
`enough to display a full page of standard size page or at least a significant portion
`
`of the page. Hence, on-screen graphical menus and controls displayed in window
`
`of an application did not greatly reduce the display area for the underlying
`
`20
`
`document. Computers also have peripheral devices such as a keyboard or a mouse
`
`to control the display of content information. Thus, viewing and navigating
`
`around a single-page or multi-page document have not posed much difficulty.
`
`Due to increasing focus on compactness of electronic devices, however,
`
`25
`
`the displays especially in portable electronic devices are becoming smaller and
`GU
`smaller. Popular electronic devices with smaller display area include electronic
`"
`organizers, PDA's (personal digital assistants), and graphical display-based
`telephones. Also available today are communicators that facilitate various types ·
`
`of communication such as voice, faxes, SMS (Short Messaging Services)
`
`messages, e-mail, and Internet-related applications. These products can likewise
`
`30
`
`only contain a small display area.
`
`Ex. GOOG 1006
`
`

`

`-2-
`
`To enable users to navigate around a full page of content information,
`
`these devices typically provide hard-keys for arrows as shown in Fig. 1. The hard(cid:173)
`
`keys, however, not only increase the size but also add to the cost of the devices.
`
`Also, hard-keys generally provide limited options for direction of movement, e.g.,
`
`5
`
`vertical or horizontal. They generally do not provide the freedom to move in any
`
`direction.
`
`Some displays of these devices also require a separate stylus having
`
`peripheral technology that requires transmission of electromagnetic pulses or light
`
`to the display. These devices often require additional controllers such as buttons
`
`10
`
`on the body or the tip of the stylus for activation. Furthermore, these styli require
`
`a power source, either through wire or battery, and their compatibility is generally
`
`limited to a specific device.
`As shown in Fig. 2, other d~ces substitute hard-keys with graphical on(cid:173)
`screen arrows or scroll bars. that are .typically used in full-size computer displays.
`
`15
`
`The on-screen scroll bars, however, occupy valuable screen real estate and
`
`compound the limitations of small displays. Similar to the hard-keys, the on(cid:173)
`
`screen arrows also generally restrict the navigational movement to horizontal or
`
`vertical direction.
`
`In other forms of on-screen GUis, e.g., pop-up menus, also take up
`
`20
`
`valuable screen space, further reducing the available display area for content
`
`information. Additionally, on-screen pop-up menus typically provide available
`
`functions in multiple layers, thus requiring a user to move deeply into the
`
`hierarchy before reaching the desired function. This is time consuming and
`
`renders the GUI cumbersome and ineffective.
`
`25
`
`Therefore, it is desirable to provide navigation tools that allow small-size
`
`devices while maximizing the use of available screen real estate.
`
`It is also desirable to provide tools to navigate within a document at any
`
`direction at varying speeds.
`
`Ex. GOOG 1006
`
`

`

`- 3-
`
`It is further desirable to provide navigation tools that can be activated
`
`without requiring specific electronic devices.
`
`In addition, it is further desirable to provide an improved GUI that
`
`simplifies GUI by recognizing various characteristics of the touch input.
`SUMMARY OF THE INVENTION
`
`5
`
`Systems and methods consistent with the present invention provide
`
`graphical control tools for efficient navigation in display devices.
`
`Specifically, a method consistent with this invention of controlling display
`
`of content information in a physical viewing area comprises several steps.
`
`10
`
`Initially, the system displays the content information in the physical viewing area.
`
`The system also displays a representation of a control tool over the display of
`
`content information. Thereafter, the system receives a user input selecting the
`
`control tool, and controls the display of content information according to the user
`-~
`
`input.
`
`15
`
`A system consistent for this invention for controlling display of content
`
`information in a physical viewing area includes displaying means, receiving
`
`means, and controlling means. The displaying means displays the content
`
`information in the physical viewing area, and displays a representation of a control
`
`tool over the display of content information. The receiving means receives a user
`
`20
`
`input selecting the control tool. Thereafter, the controlling means controls the
`
`display of the content information according to the user input.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The accompanying drawings, which are incorporated in and constitute a
`
`part of this specification, illustrate the invention and together with the description,
`
`25
`
`serve to explain the principles of the invention.
`
`Ex. GOOG 1006
`
`

`

`- 4-
`
`In the drawings,
`
`Fig. 1 shows conventional hard-key arrows for navigation control;
`
`Fig. 2 shows conventional on-screen graphical navigation tool;
`
`Figs. 3A-3B are diagrams of an exemplary mobile telephone consistent
`
`5
`
`with the principles of the present invention;
`
`Fig. 4 is a block diagram showing the elements of the mobile telephone of
`
`Fig. 3A;
`
`Fig. 5 is a block diagram showing the components of the memory of Fig.
`
`4;
`
`10
`
`Fig. 6 is a biock diagram of touch screen functionalities;
`
`Figs. 7 A-7B show an exemplary inactive and active graphical navigation
`
`tool, respectively;
`
`Fig. 8 is a sample screen showing an active navigation tool;
`'~
`Figs. 9A-9C show exemplary features of the navigation tool;
`
`15
`
`Figs. 10A-10C are sample screens showing the navigation tool performing
`
`various navigation functions;
`
`Figs. 11A-11B show exemplary features of the navigation tool relating to
`
`speed of navigation;
`
`Fig. 12 is a diagram illustrating a touch point distribution; .w.d.
`
`20
`
`Fig. 13 is a flowchart illustrating the process of determining the size of the
`objectm;;cing contact with the viewing area;~
`DESCRIPTION OF THE PREFERRED EMBODIMENT
`
`Reference will now be made in detail to the present preferred embodiment
`
`of the invention, an example ofwhich is illustrated in the accompanying drawings.
`
`25 Where appropriate, the same reference numerals refer to the same or similar
`
`elements. The appended claims define the scope of the invention; the following
`
`description does not limit that scope.
`
`The graphical navigation tool of the present invention may be
`
`implemented in a wide range of electronic devices mentioned above such as
`
`Ex. GOOG 1006
`
`

`

`- 5 -
`
`electronic organizers, PDA's, and graphical display-based telephones. Although
`
`the need to maximize the use of screen real estate is most critical in portable
`
`electronic devices with small displays, the present invention can also be
`
`implemented in full-size computers or electronic devices. For purposes of
`
`5
`
`illustration, however, the present invention will be explained in detail in a mobile
`
`telephone envir-onment.
`
`10
`
`15
`
`Specifically, Fig. 3A shows a mobile telephone 310 and Fig. 3B shows an
`
`exemplary wireline telephone preferably having the graphical navigation tool
`
`consistent with the present invention .. Mobile telephone 310 includes main
`2Jt>
`,..
`housing~ antenna 320, keypad 330, and display 340. Fig. 4 shows the
`hardware elements in mobile telephone 310 including antenna 410,
`
`communications module 420, feature processor 430, memory 440, sliding keypad
`
`450, analog controller 460, display module 470, battery pack 480, and switching
`
`power supply 490.
`
`Antenna 410 transmits and receives radio frequency information for
`3lC)
`mobile telephone .:Mit Antenna 410 preferably comprises a planar inverted F
`#>-
`antenna (PIFA)-type or a short stub (2 to 4 em) custom helix antenna. Antenna
`
`410 communicates over a GSM (Global System for Mobile Communications)
`
`switching fabric using a conventional voice B-channel, data B-channel, or GSM
`
`20
`
`signaling channel connection.
`
`Communications module 420 connects to antenna 410 and provides the
`
`GSM radio, baseband, and audio functionality for mobile telephone 310.
`
`Communications module 420 includes GSM radio 421, VEGA 423, BOCK 425,
`
`and audio transducers 427.
`
`25
`
`GSM radio 421 converts the radio frequency information to/from the
`
`antenna into analog baseband information for presentation to VEGA 423. VEGA
`
`423 is preferably a Texas Instruments VEGA device, containing analog-to-digital
`
`(A/D)/digital-to-analog (D/A) conversion units 424. VEGA 423 converts the
`
`Ex. GOOG 1006
`
`

`

`-6-
`
`analog baseband information from GSM radio 421 to digital information for
`
`presentation to BOCK 425.
`
`BOCK 425 is preferably a Texas Instruments BOCK device containing a
`
`conventional ARM microprocessor and a conventional LEAD DSP device.
`
`5
`
`BOCK 425 performs GSM baseband processing for generating digital audio
`
`signals and supporting GSM protocols. BOCK 425 supplies the digital audio
`
`signals to VEGA 423 for digital-to-analog conversion. VEGA 423 applies the
`
`analog audio signals to audio transducers 427. Audio transducers 427 include
`
`speaker 428 and microphone 429 to facilitate audio communication by the user.
`
`10
`
`Feature processor 430 provides GUI features and a Java Virtual Machine
`
`(NM). Feature processor 430 communicates with BOCK 425 using high level
`
`messaging over an asynchronous (tiART) data link. Feature processor 430
`
`contains additional system circuitry, such as a liquid crystal display (LCD)
`
`controller, timers, UART and bus interfaces, and real time clock and system clock
`
`15
`
`generators (not shown).
`
`Memory 440 stores data and program code used by feature processor 430.
`
`Memory 440 includes static RAM 442 and flash ROM 444. Static RAM 442 is a
`
`volatile memory that stores data and other information used by feature processor
`
`430. Flash ROM 444, on the other hand, is a non-volatile memory that stores the
`
`20
`
`program code executed by feature processor 430.
`
`Sliding keypad 450 enables the user to dial a telephone number, access
`
`remote databases, and manipulate the GUI features. Sliding keypad 450
`
`preferably includes a mylar resistive key matrix that generates analog resistive
`
`25
`
`voltage in response to actions by the user. Sliding keypad 450 preferably connects
`:uo (. 'F~ '!.A)
`~tl>
`to main housing ~ 1 Q {l'ig:4) of mobile telephone ~through two mechanical
`Jo.. c~ .n
`,..
`"push pin"-type contact~~·v
`1\
`Analog controller 460 is preferably a Phillips UCB 1100 device that acts as
`
`an interface between feature processor 430 and sliding keypad 450. Analog
`
`Ex. GOOG 1006
`
`

`

`- 7-
`
`controller 460 converts the analog resistive voltage from sliding keypad 450 to
`
`digital signals for presentation to feature processor 430.
`
`Display module 470 preferably includes a 160 x 320 pixel LCD 472 with
`
`an analog touch screen panel474 and an electroluminescent backlight. LCD 472
`
`5
`
`operates in conjunction with feature processor 430 to display the GUI features.
`
`Analog controller 460 scans touch screen overlay 474 while feature processor 430
`
`refreshes LCD 472.
`
`Battery pack 480 is preferably a single lithium-ion battery with active
`
`protection circuitry. Switching power supply 490 ensures highly efficient use of
`
`10
`
`the lithium-ion battery power by converting the voltage of the lithium-ion battery
`310
`into stable voltages used by the other hardware elements of mobile telephone ~ ,..
`Fig. 5 is a block diagram illustrating the components of memory 440.
`
`Static RAM 442 stores data and other information used by feature processor 430.
`
`Flash ROM 444 contains various programs including a program 510, a touch
`
`15
`
`screen program 520, a navigatioyrogram 530, and a drawing program 540.
`
`Program 520, preferably written in languages such as Java, C, or C++ for
`
`Macintosh, is a main program overseeing the operation of mobile telephone 310.
`
`Touch screen program 520 facilitates processing of touch input on touch
`
`screen panel474 using a typical touch input algorithm. Navigation program 530
`
`20
`
`handles navigation of the content infom1ation display. Drawing program 540 is a
`
`graphical drawing package. Programs 520, 530, and 540 may be one of any
`
`commercially available packages or a user-defined feature program or macro.
`
`The present invention provides various features through tactile GUI.
`
`Initially, LCD 472 displays various GUI features. Referring to Fig. 6, a user
`
`25
`
`touches touch screen panel474 to provide user input, for example, to navigate
`
`around a document or invoke a desired function. Analog controller 460 scans
`
`touch screen panel474 and reads the corresponding analog voltage of touch screen
`
`panel474. Analog controller 460 then converts the analog values into
`
`corresponding digital values representing the Cartesian coordinates, which are
`
`Ex. GOOG 1006
`
`

`

`- 8-
`
`transmitted to feature processor 430 for processing. The resolution of the touch
`
`input depends on the ability of analog controller 460 to discern among multiple
`
`levels of analog values, generally defined in bits.
`
`Figs. 7 A-7B show an exemplary graphical navigation tool preferably used
`
`5
`
`to navigate around documents that are too large to view within a single screen of a
`
`physical display (hereinafter referred as "viewing area"). The navigation tool may
`
`be used to view any kind of document including faxes, Web pages, or e-mail. In
`
`one embodiment consistent with the present invention, an inactive navigation tool
`
`10
`
`15
`
`is displayed and accessible to the user at all times (Fig. 7 A). The user may
`
`activate the navigation tool by touching and holding the center of the navigation
`
`tool for a predetennined time period, for example, one to two seconds (Fig. 7B).
`
`An activated navigation tool is preferably transparent to avoid hindering the
`
`display of content information in the viewing area as shown in Fig. 8.
`
`Alternatively, the navigation star may change colors or other features of its
`
`appearance to indicate its active status. A solid line image, for example, may be
`"
`used in greyscale displays that do not support transparency.
`The present invention may be designed such that feature processor 430
`
`ignores any touch input on the navigation tool unless the navigation tool has been
`
`activated. Instead, the touch input may be interpreted as input to access control
`
`20
`
`buttons in the underlying document, write on the underlying document, or invoke
`
`other functions related to the underlying document. This will prevent against
`
`unintentional navigation in the viewing window in case the user inadvertently
`
`touches touch screen panel474. In an alternative embodiment, the present
`
`invention may accept stylus input to access the underlying document while a
`
`25
`
`finger or non-electromagnetic touch on any part of the navigation tool invokes the
`
`navigation function.
`Referring to Figs. 9A-9C, once the navigation tool is activated, the user
`
`may navigate through the document by selecting the graphical arrows, e.g., up,
`
`right, left, and down arrows (Fig. 9A), or graphical page icons, e.g., previous or
`
`Ex. GOOG 1006
`
`

`

`- 9-
`
`next page (Fig. 9B). One skilled in the art may vary the type and number of
`
`graphical tools significantly. For example, the navigation tool may provide
`
`graphical representations for forward, next document, back, or home functions
`
`(Fig. 9C).
`Figs. I OA-1 OC show exemplary screen displays while the user is touching
`
`5
`
`the navigation tool. Upon touching the right arrow ofthe navigation tool, for
`
`example, the right arrow is highlighted and navigation program 530 moves the
`
`display to the right (Fig. 1 OA). Similarly, touching the down arrow moves the
`
`display down (Fig. lOB). Although the four arrows are presented to guide the
`
`10
`
`users, navigation program 530 supports navigational movement at any direction.
`
`If the user touches an area of the navigation tool equidistant between the up and
`
`right arrows, for example, navigation program 530 will move the display towards
`
`the upper-right portion of the underlying document at a 45-degree angle.
`
`Touching the arrows or any area in between, moves the display in the selected
`
`15
`
`direction until navigation program 530 reaches the edge of the page.
`
`Touching the next page ,icon moves the viewing window to the next page
`.r,;..
`of the underlying document (Fig. 1 OC). If a particular document does not have a
`
`page corresponding to a previous or next page icon, navigation program 530 will
`
`not display the respective previous or next page icons. This would apply to one-
`
`20
`
`page documents, or when the user is at the beginning or end of a multi-page
`
`document. In one embodiment consistent with the present invention, a
`
`momentary touch of the next page icon causes navigation program 530 to jump to
`
`the next page while a continuous touch on the next page icon causes navigation
`
`program 530 to continue scrolling through succeeding pages of the underlying
`
`25
`
`document. The previous page icon may embody similar characteristics.
`
`The user may also control the speed of the navigation. As shown in Fig.
`
`llA, the speed of the navigation accelerates as the user touch moves from the
`
`center of the circle toward the circumference of the circle, i.e., tip of the arrow.
`
`Hence, the viewing window moves slowly when the user touches the blunt end of
`
`Ex. GOOG 1006
`
`

`

`- 10-
`
`the arrow located at the center of the circle while the speed accelerates as the user
`
`moves the finger towards the tip of the arrow. The speed of navigation, therefore,
`
`is determined by the distance of the touch relative to the center of the circle.
`
`Likewise, similar principles apply to previous or next page/document icons where
`
`5
`
`a touch closer to the outer edge of the previous or next page/document icons
`
`accelerates navigation through the document as shown in Fig. liB.
`
`Although the exemplary transparent tool discussed above is for navigation,
`
`transparent control tools may be implemented for a variety of functions. A
`
`transparent tool may, for example, be used for a Web browser application where
`
`the controls may be used for appropriate functions such as moving forwards or
`
`backwards through different Web pages or returning to home page. One skilled in
`
`the art may easily vary the design or the functionality of the graphical navigation
`
`tools described above without departing from the scope of the present invention.
`
`In an exemplary embodiment of a navigation tool described above, a finger
`
`touch invokes navigational functions based on the feature selected and the
`
`location of the user touch.t>Altematively, other objects making contact with touch
`
`screen panel474 may invoke other tools or functions. A pointy stylus touch, for
`
`example, may invoke a menu with cardinal points representing multiple line
`
`widths, colors, or patterns.
`In another embodiment consistent with the present invention, tools or
`
`application programs may be stored in flash ROM 444 to provide related
`
`interfaces to the user. The use of a finger may, for example, invoke tools or
`
`10
`
`15
`
`20
`
`dialogues that are finger-touchable and large whereas the use of a sharp stylus may
`
`invoke a modified GUI with smaller touch targets. In a yet another embodiment,
`
`25
`
`in a document viewing application normally navigable by a finger touch, use of a
`
`sharp stylus may automatically invoke a document annotation application for
`
`marking up the underlying document.
`
`As described above, the touch-responsive GUI of the present invention are
`
`facilitated though various components including touch screen panel 4 7 4, analog
`
`Ex. GOOG 1006
`
`

`

`- 11 -
`
`controller 460, and feature processor 430. Specifically, analog controller 460
`
`scans touch screen panel474 to read the corresponding analog voltage of touch
`
`screen panel474 activated by a user touch. Analog controller 460 then converts
`
`5
`
`the analog values into a digital value representing the Cartesian coordinates,
`which is transmitted to feature processor 430 for processing according to the
`functionalities of the present invention.
`
`When a user touches touch screen panel474, program 510 initiates touch
`
`screen program 520 to determine the pointer size of the object making contact
`
`with touch screen pane1474 based on a touch point distribution or pointer size of
`
`10
`
`the touch input. As shown in Fig. 12, touch screen program 520 can, for example,
`
`determine whether the pointer size of the object is a finger or a sharp object.
`
`Fig. 13 is a flowchart illustrating the process of determining the size of the
`
`object making contact with the viewing area. Touch point program 520 first
`
`determines the individual points of contact made by the object (step 131 0). It
`
`15
`
`computes a centroid, or other average point, of the determined points of contact
`
`(step 1320). Touch progratd 520 then computes a standard deviation of the
`
`centroid as well as the variance (step 1330), and determines the pointer size based
`
`on the centroid and the standard deviation {step 1340). These computations are
`
`preferably performed on a real-time basis to provide immediate system response
`
`20
`
`to the touch input. In order to achieve optimum results and accuracy, analog touch
`
`controller 460 preferably generates 150 points per second or more. Touch
`
`program 520 may also use the amount of pressure imposed on touch screen panel
`
`474 as a function oftime to determine the size of object. As shown in Fig. 14A,
`for example, if the amount of pressure increases or decreases sharply at a
`particular instant in time, touch point program 520 may determine that the touch
`
`25
`
`corresponds to a pen. A finger touch, on the other hand, results in a gradual
`
`increase and decrease in pressure as illustrated by a smoother curve in Fig. 14B.
`
`Ex. GOOG 1006
`
`

`

`- 12 -
`
`Program 510 can also be programmed to correlate certain pointer size to
`
`certain objects and invoke corresponding functions or tools. Such GUI provides a
`
`richer, yet simplified interaction between the user and mobile telephone 310. If
`
`program 510 determines that the pointer size of the object corresponds to the size
`
`5
`
`of a finger, program 510 may initiate a navigation tool. If the pointer size
`
`corresponds to the size of several fingers, program 510 may invoke a drag
`
`function of the navigation tool. On the other hand, if program 510 determines that
`
`the pointer size of the object corresponds to size of a sharp point or pen, program
`
`510 may initiate a drawing tool supported by drawing program 540. Similarly, if
`
`10
`
`program 510 determines that the pointer size of the object corresponds to size of a
`
`pencil eraser, program 510 may initiate an erase function of the drawing tool. One
`
`skilled in the art may easily vary the functions or tools initiated by program 510.
`
`Additionally, the functions or tools may be commercial software packages,
`
`predetermined functions, or user-defined macros.
`
`15
`
`In addition to using the pointer size to determine the desired GUI, program
`
`510 can also incorporate other characteristics of the user touch, e.g., gestures or
`
`movements, to simplify GUI and maximize screen real estate. A gesture
`
`recognizing interface extends the ability of the present invention to distinguish
`
`between different sized pointers to track gestures and movement of user input
`
`20
`
`based on vector direction and magnitude, all in the context of active user
`
`application. This type of contextual gesture interface can infer by context, the
`
`implement, and the gesture chosen by the user what functions the user wishes to
`
`invoke. Accordingly, all these functions are available without menus or scroll
`
`bars and do not require additional screen areas to display the functions.
`
`25
`
`Program 510 recognizes other characteristics of the touch input including
`
`the context of the input, namely the task or sub-task applications running when the
`
`GUI is invoked. If a user is in a document navigation application, for example,
`
`program 510 interprets a quick drag to the right as a next page function. If the
`
`underlying task is an editing application, program 510 may interpret the same
`
`Ex. GOOG 1006
`
`

`

`- 13 -
`
`gesture as a highlight function and highlight a portion of the document touched by
`
`the user. Similarly, in graphics application, a quick drag to the right may invoke a
`
`drawing tool to draw from the starting point to the ending point of the touch
`
`points. In a document viewing application, the same touch may invoke a
`
`5
`
`navigation tool to move the view of the document in the direction of the finger
`
`drag.
`
`All of the above functions and features described above focuses on
`
`providing intuitive GUis and minimize the need for users to memorize
`
`complicated, hierarchical menus or procedures. Additionally, the present
`
`10
`
`invention maximize available screen real estate while providing a wide array of
`
`GUI and tools.
`It will be apparent to those skilled in the art that various modifications and
`
`variations can be made in the system of the present invention and in construction
`
`of this system without departing from the scope or spirit of the invention. Other
`
`15
`
`embodiments of the invention will be apparent to those skilled in the art from
`
`consideration of the specification and practice of the invention disclosed herein.
`
`The specification and examples should be considered as exemplary only, with the
`
`true scope and spirit of the invention indicated by the following claims.
`
`Ex. GOOG 1006
`
`

`

`- 14-
`
`A method of controlling display of content information in a physical
`
`g area comprising the steps of:
`
`· playing the content information in the physical viewing area;
`
`disp ying a representation of a control tool over the display of content
`
`5
`
`information;
`
`receiving
`
`ser input selecting the control tool; and
`
`controlling th display of content information according to the user input.
`
`2.
`
`The method of clai
`
`lecting a predetermined portion of the control tool,
`
`and
`
`5
`
`activating the control tool in esponse to the user input, and
`
`changing the display to a "fferent portion of the content
`
`information.
`
`The method of claim 1, wherein the con olling step includes the sub step
`
`3.
`
`of
`
`shifting the content information in the physic
`
`4.
`
`The method of claim 3, wherein the shifting step 1 eludes the substep of
`
`scrolling to a different portion of the content inform tion.
`
`5.
`
`The method of claim 3, wherein the shifting step includ
`
`the sub step of
`
`jumping to a different portion of the content information.
`
`Ex. GOOG 1006
`
`

`

`- 15-
`
`The method of claim 1, wherein the controlling step includes the substep
`
`6.
`
`of
`
`ing the display of content information at a speed determined by to the
`
`7.
`
`The met od of claim l, wherein the control information includes a
`
`d wherein the controlling step includes the substep of
`
`ifferent one of the pages of the content information.
`
`8.
`
`· m 1, wherein the step of displaying the control tool
`
`includes the substep of
`
`displaying the contr 1 tool containing arrows indicating direction.
`
`9.
`
`The method of claim 1, herein the control information includes a
`
`document and
`
`wherein the step of displaying the ontrol tool includes the substep of
`displaying the control tool in icating various functions related to the
`
`5
`
`document.
`
`10.
`
`The method of claim 1, wherein t e step of displaying the control tool
`
`includes the substep of
`
`displaying a transparent control tool.
`
`11.
`
`The method of claim 1, wherein the ste of displaying the control tool
`
`includes the substep of
`
`displaying an opaque control tool.
`
`Ex. GOOG 1006
`
`

`

`12.
`
`n apparatus for controlling display of content information in a physical
`
`- 16-
`
`me s for displaying the content information in the physical viewing area;
`
`mean for displaying a representation of a control tool over the display of
`
`means fo receiving a user input selecting the control tool; and
`
`ontrolling the display of the content information according to
`
`the user input.
`
`13.
`
`claim 12, further including
`
`g a user input selecting a predetermined portion of the
`
`control tool, and
`
`means for activating the control tool in response to the user input, and
`
`means for chan ·ng the display to a different portion of the content
`
`information.
`
`14.
`
`The apparatus of claim 12, herein the controlling means includes
`
`means for shifting the conten information in the physical viewing area.
`
`5
`
`5
`
`15.
`
`The apparatus of claim 14, wher in the shifting means includes
`
`means for scrolling to a different ortion of the content information.
`
`16.
`
`The apparatus of claim 14, wherein e shifting means includes
`
`means for jumping to a different port! n of the content information.
`
`17.
`
`The apparatus of claim 12, wherein the c ntrolling means includes
`
`means for shifting the display of content i
`
`by the user input.
`
`Ex. GOOG 1006
`
`

`

`18.
`
`The apparatus of claim 12, wherein the content infonnation includes a
`
`- 17-
`
`s for displaying a different ones of the pages of the content
`
`5
`
`19.
`
`tool includes
`
`direction.
`
`20.
`
`document, and
`
`atus of claim 12, wherein the means for displaying the control
`
`·splaying the control tool containing arrows indicating
`
`claim 12, wherein the content infonnation includes a
`
`wherein the means for dis laying the control tool includes
`the control tool indicating various functions related
`
`5
`
`to the document.
`
`21.
`
`The apparatus of claim 2, wherein the means for displaying the control
`
`tool includes
`
`means for displaying a tr
`
`22.
`
`The apparatus of claim 12,
`
`erein the means for displaying the control
`
`tool includes
`
`Ex. GOOG 1006
`
`

`

`- 18-
`
`ABSTRACT
`
`The system and method consistent with the present invention provides
`
`improved graphical navigation tool for electronic devices. The graphical
`
`navigation tools may be used to navigate through documents at any direction at
`
`5
`
`varying speeds. The navigation tool is preferably transparent to prevent obscuring
`
`the text of the underlying document. Accordingly, the navigational tool does not
`
`take up additional screen real estate. The GUI of the present invention may be
`
`especially useful in portable electronic devices with small displays.
`
`Ex. GOOG 1006
`
`

`

`
`
`EX. GOOG 1006
`
`
`
`@]) (§) <§>
`<§~<§9
`
`Fig.1
`Fig.1
`
`EEEEEif}:3E}!353!
`
`
`
`
`
`”21:“géhfii:I'gtg‘i
`
`
`
` .{"IE?"‘
`
`gmill-=5MI:13!
`
`Ex. GOOG 1006
`
`

`

`
`
`
`
`5:55:"annag!ff‘éiii2921::[iii-u111%:121;“
`
`
`
`
`
`
`
`
`
`
`
`(l
`
`
`
`5:iiIJiiiz'i'?"EL“#1
`
`!:.'::t
`
`
`
`s
`
`'o
`. 1¢
`
`1----
`0
`
`I~
`
`l¢1
`
`Fig. 2
`Fig. 2
`
`EX. GOOG 1006
`
`Ex. GOOG 1006
`
`

`

`Antenna
`
`410
`
`420
`
`/
`
`Communications Module
`
`_,~~)23
`
`424
`
`VEGA
`
`/421
`
`1 - - AJD 1 -
`
`GSM
`Radio
`
`f - -
`
`BOCK
`
`1 - - D/A 1 -
`
`'------
`
`424
`
`0/A
`I--
`AJD
`
`L__
`
`,____
`
`1---
`
`/')27
`
`Audio
`Transducers
`
`Speaker
`428
`
`~icrophone
`
`,-
`
`429
`
`-~
`
`-......,..,.__ 425
`
`Async Communication
`(UART)
`
`/430
`
`/460
`
`1 - -
`
`Analog
`Controller
`
`/450
`
`Sliding
`Keypad
`
`-
`
`Memory
`
`v-440
`
`Flash ROM
`
`........... 444
`
`Static RAM "r--. 442
`
`Feature
`Processor
`
`/490
`
`Switching
`Power
`Supply
`
`n_l Touch Screen Panel } ~474
`t ~472
`
`.L4so
`
`Battery
`Pack
`
`I
`
`LCD
`
`~
`470
`
`Fig. 4
`
`Ex. GOOG 1006
`
`

`

`s:
`0 g
`en
`-i co en
`
`"0
`;;;-
`0
`::I co
`~
`0
`
`
`
`goczmAlmgozm3o
`
`
`
`.., -· (Q
`Em.w>
`
`w
`)>
`
`., -· (0
`3m.um
`
`w
`OJ
`
`~r
`•r
`
`"" "" 0
`umo,
`
`"' .....
`
`0
`
`"' N
`
`0
`
`EX. GOOG 1006
`
`Ex. GOOG 1006
`
`
`
`

`

`-----·- -·--·---·--- - - -- - -- - -- - - - - - - - - - - - - - - - - - - - ,
`
`MEMORY 440
`
`STATIC RAM 442
`
`FLASH ROM 444
`
`Program
`510
`
`Touch Screen
`Program
`520
`
`Navigati