(12) United States Patent
`Burg et al.
`
`USOO636284OB1
`(10) Patent No.:
`US 6,362,840 B1
`(45) Date of Patent:
`Mar. 26, 2002
`
`OTHER PUBLICATIONS
`RFC 1738, Dec. 1994, InterNic.
`Turning a Cursor Into an Ad But Mainly Just for Laughs,
`The New York Times, p. G3, Aug. 20, 1998.
`Ken Magel, “Is It Too Late to Put the User Back into
`HTML?”, Internet Watch, p. 131-132, Dec. 1997.*
`Walsum et al., “Feature Extraction and Iconic Visualiza
`tion", IEEE, vol. 2, p. 111-119, Dec. 1997.*
`* cited b
`cited by examiner
`Primary Examiner Raymond J. Bayerl
`ASSistant Examiner X. L. Bautista
`(57)
`ABSTRACT
`
`(54) METHOD AND SYSTEM FOR GRAPHIC
`DISPLAY OF LINK ACTIONS
`(75) Inventors: Frederick Murray Burg, West Long
`Branch; Max S. Schoeffler, Old Bridge,
`both of NJ (US)
`
`(73) Assignee: AT&T Corp., New York, NY (US)
`
`(*) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`21) Appl. No.: 09/166,802
`(21) Appl. No.: 09/166,
`(22) Filed:
`Oct. 6, 1998
`(51) Int. Cl................................................... G06F 3/00
`(52) U.S. Cl. ....................... 345/835; 345/708; 34.5/808;
`345/854; 34.5/862
`(58) Field of Search ................................. 345/145,326,
`345/336,339, 347, 348, 349,357, 978,
`705, 708, 709, 764, 808, 812, 822, 835,
`839, 854, 856, 859, 861; 707/501, 501.1
`
`(56)
`
`A method and System for presenting an icon on a computer
`graphic display, the icon being responsive to the type of link
`area on the computer graphic display. The link area on the
`computer graphic display is described by link instructions
`embedded in display format instructions, such as HTML
`format documents. The Visually representative icon is dis
`played when a cursor, Such as that controlled by a mouse, is
`positioned over the link area. The link instructions Support
`Services types Such as telephone Services, facsimile Services,
`financial Services, Video Services, help Services and game
`References Cited
`Services. The link instructions for the new Services are
`described in new URL types or through Scripting tools Such
`U.S. PATENT DOCUMENTS
`as Active-X or JAVA scripts. The icons provide a visual
`5,655,093 A * 8/1997 Frid-Nielsen ............... 345/326
`representation of the Service Such as a telephone for tele
`5,784,056 A
`7/1998 Nielsen
`... 345/332
`phone Services, a dollar Sign for financial Services, or a Video
`5,877,765 A * 3/1999 Dickman et al. ........... 345/349
`5,926,179 A * 7/1999 Matsuda et al. ........ 345/145 X Screen for Video Services. Text and Sounds are also provided
`5.987,482 A * 11/1999 Bates et al. ................. 707/513
`with the visually representative icon to further illustrate the
`5,995,102 A * 11/1999 Rosen et al...
`... 345/339
`Service type.
`6,018,345 A
`1/2000 Berstis ....................... 345/357
`6,065,057 A * 5/2000 Rosen et al...
`... 345/339 X
`6,088,707 A * 7/2000 Bates et al. .............. 707/501.1
`
`26 Claims, 10 Drawing Sheets
`
`100
`
`N)
`
`
`
`106
`
`
`
`108
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 1 of 19
`
`

`

`U.S. Patent
`
`Mar. 26, 2002.
`
`Sheet 1 of 10
`
`US 6,362,840 B1
`
`FIG. 1
`1
`
`2A
`
`13
`
`4
`
`11A
`
`s
`
`FINANCIAL
`TRANSACTION
`
`(YY
`
`--
`
`E
`
`5A
`
`O
`
`LOCAL AREA NETWORK
`Local ARA NER
`
`INTERNET
`SERVICE
`PROVIDER
`
`INTERNET
`
`10
`
`Y 2B
`Y-2
`E.
`
`
`
`
`
`7
`
`
`
`B
`
`LOCAL AREA NETWORK
`
`2D
`
`2E
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 2 of 19
`
`

`

`U.S. Patent
`
`Mar. 26, 2002.
`
`Sheet 2 of 10
`
`US 6,362,840 B1
`
`FIC. 2
`14
`
`DISPLAY
`
`18
`
`EXTERNAL
`1941 SERVICE
`
`19B E.
`#.
`
`19C
`
`EXTERNAL
`SERVICE #3
`
`EXTERNAL
`
`1901 SERVEF".
`
`15
`
`MEMORY
`NON-WOLATTLE us 17B
`(DISK STORAGE)
`
`MEMORY
`WOLATILE
`(RAM)
`
`17A
`
`PROCESSOR
`
`INPUT/OUT
`DEVICE
`(MOUSE)
`
`INPUT/OUT
`DEVICE
`(KEYBOARD)
`
`16A
`
`16B
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 3 of 19
`
`

`

`U.S. Patent
`
`Mar. 26, 2002.
`
`Sheet 3 of 10
`
`US 6,362,840 B1
`
`FIC. 3
`
`USER STARTS BROWSERU
`SOFTWARE ON COMPUTER
`
`BROWSER LOADS
`HOMEPAGE
`
`BROWSER INTERPRETS
`CURSOR LOCATION AND
`ACTIONS
`
`21
`
`22
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 4 of 19
`
`

`

`U.S. Patent
`
`Mar. 26, 2002.
`
`Sheet 4 of 10
`
`US 6,362,840 B1
`
`FIG. 4
`22
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`IS THE CURSOR
`OVER BACKGROUND
`AREA 2
`
`YES DISPLAY CURSOR AS AN
`F.E.E.
`ARROW r AREA
`
`27
`
`IS THE CURSOR
`OWER TEXT AREA
`
`YES DISPLAY CURSOR AS AN
`"p
`
`27
`
`IS THE CURSOR
`OWER LINK AREA
`
`DISPLAY CURSOR AS A
`FIST
`
`HAS CURSOR MOVED WES
`TEXT AREA
`NO
`
`31
`
`HAS CURSOR MOVED WES
`FROM LINK AREA 2
`NO
`
`HAS USER SELECTED
`THE LINK ?
`YES
`
`33
`
`
`
`EXECUTE LINK
`INSTRUCTIONS
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 5 of 19
`
`

`

`U.S. Patent
`
`Mar. 26, 2002.
`
`Sheet 5 of 10
`
`US 6,362,840 B1
`
`FIG. 6
`22
`
`
`
`
`
`
`
`IS THE CURSOR
`OWER BACKGROUND
`AREA 2
`
`F.G. E
`YES DISPLAY CURSOR AS AN
`ARROW r AREA 2
`
`38
`
`
`
`IS THE CURSOR
`OVERTEXT AREA
`NO
`
`IS THE CURSOR
`OWER LINK AREA
`NO
`
`
`
`
`
`YES DISPLAY CURSOR AS AN
`r
`
`
`
`EVALUATE TYPE OF
`LINK FOR DISPLAY
`
`HAS CURSOR MOVED WES
`FROM TEXT AREA 2
`NO
`
`42
`
`
`
`HASCURSOR NOWED
`FROM LINK AREA 2
`NO
`
`HAS USER SELECTED
`THE LINK ?
`YES
`
`
`
`44
`
`
`
`EXECUTE LINK
`INSTRUCTIONS BASED
`ON TYPE OF LINK
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 6 of 19
`
`

`

`U.S. Patent
`
`Mar. 26, 2002.
`
`Sheet 6 of 10
`
`US 6,362,840 B1
`
`FIG. 6
`41
`
`45
`
`47
`
`49
`
`51
`
`46
`
`IS LINK AN HTTP WES DISPLAY CURSOR AS A
`LINK ?
`FIST
`NO
`
`48
`
`IS LINK A
`TELEPHONE LINK ?
`NO
`
`YES DISPLAY CURSOR AS A
`TELEPHONE
`
`50
`
`IS LINK A
`FACSIMILE LINK ?
`NO
`
`IS LINK A
`FINANCIAL LINK ?
`NO
`
`YES DISPLAY CURSOR AS A
`FAX MACHINE
`
`52
`
`YES DISPLAY CURSOR AS A
`DOLLAR SIGN
`
`53
`
`OTHER LINK TYPES
`AND CURSOR DISPLAYS
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 7 of 19
`
`

`

`U.S. Patent
`
`Mar. 26, 2002.
`
`Sheet 7 of 10
`
`US 6,362,840 B1
`
`FIC. 7
`44
`
`START
`
`55
`
`54-( is us," ).E. "Socioli
`
`PERFORM INSTRUCTIONS
`
`TO HTTP URL
`
`56
`
`IS LINK A
`TELEPHONE SERVICE 2
`
`PERFORM INSTRUCTIONS
`AND LINK ACCORDING
`TO PHONE SERVICE
`
`58
`
`
`
`
`
`IS LINK A
`FACSMILE SERVICE 2
`
`PERFORM INSTRUCTIONS
`AND LINK ACCORDING
`TO FAX SERVICE
`
`60
`
`IS LINK A
`FINANCIAL SERVICE 2
`
`
`
`
`
`PERFORM INSTRUCTIONS
`AND LINK ACCORDING
`TO FINANCE SERVICE
`
`62
`
`OTHER LINK TYPES
`AND INSTRUCTIONS
`
`
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 8 of 19
`
`

`

`U.S. Patent
`
`Mar. 26, 2002.
`
`Sheet 8 of 10
`
`US 6,362,840 B1
`
`106
`
`
`
`108
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 9 of 19
`
`

`

`U.S. Patent
`
`Mar. 26, 2002.
`
`Sheet 9 of 10
`
`US 6,362,840 B1
`
`FIC. 9
`
`SERVICE PROVIDER CREATES
`WEB PAGE WITH AN EMBEDDED
`SCRIPT, ASSIGNS A URL TO
`THE WEB PAGE AND SAVES
`THE WEB PAGE ON A SERVER
`
`USER POINTS SYSTEM TO THE
`WEB PAGE URL
`
`SYSTEM DOWNLOADS WEB PAGE
`WITH EMBEDDED SCRIPT
`
`SYSTEM RENDERS THE WEB PAGE
`AND LOADS INSTRUCTIONS FOR
`EMBEDDED SCRIPT
`
`70
`
`71
`
`72
`
`73
`
`SYSTEM DETECTS MOUSE, EVENT uls 74
`
`
`
`
`
`
`
`
`
`
`
`IS MOUSE, EVENT
`UNIQUELY DEFINED FOR
`EMBEDDED SCRIPT
`
`YES
`
`75
`
`SYSTEM EXECUTES MOUSE EVENTu
`NORMALLY
`
`
`
`77
`
`GO TO
`SCRIPT EXECUTE
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 10 of 19
`
`

`

`U.S. Patent
`
`Mar. 26, 2002
`
`Sheet 10 of 10
`
`US 6,362,840 B1
`
`FIG. 1 O
`
`SCRIPT EXECUTE)
`
`78-(s MOUSE EVENT ANVYES PERFORM MOUSE ENTER
`ENTER LINK AREA 2
`INSTRUCTIONS
`
`79
`
`81
`
`IS MOUSE EVENT ANVYES PERFORM MOUSE EXIT
`INSTRUCTIONS
`
`82
`
`80
`
`84-( IS MOUSE EVENT VES PERFORM MOUSE CLICK
`A CLICK ?
`INSTRUCTIONS
`
`
`
`85
`
`83
`
`86
`
`
`
`87
`
`CHECK FOR ALL OTHER
`MOUSE, EVENTS
`
`88
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 11 of 19
`
`

`

`1
`METHOD AND SYSTEM FOR GRAPHIC
`DISPLAY OF LINK ACTIONS
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`This invention relates to the field of document and infor
`mation display and more particularly to documents and
`information display such as Web Pages that are based on
`HTML format documents with the interactive display of
`those documents.
`2. Description of Related Art
`Hypertext Markup Language (HTML) documents,
`eXchanged on the Internet, include embedded link instruc
`tions that rely on Uniform Resource Locators (URLs) to
`locate and identify resources on the Internet. Typically,
`HTML documents are located, loaded and displayed using
`browser applications that also provide Internet navigation
`support. When the browser displays the HTML document,
`the embedded URL link instructions define active areas on
`a computer graphic display. A user can Select or activate
`those areas.
`Browser applications recognize multiple existing URL
`types in HTML format documents with each URL type
`performing a different function. Existing UTRL types
`include http, ftp, mailto and others. AS the Internet develops,
`new Service types are being offered, Such as telephony, and
`Video entertainment. These new types of Services are fun
`damentally different from existing types of URL services,
`and many of those new services will be implemented by
`using new URL types. However, regardless of the URL type,
`operating Systems and browser applications typically iden
`tify all URL links on a Web page with blue colored text and
`display the cursor as a fist with an extended index finger.
`Scripting tools are frequently used with HTML docu
`ments to enhance the display options for Web pages. These
`Scripting tools are also used to enable new internet Services
`Such as telephony. However, even with new internet
`Services, the Scripting tools rely on the operating System and
`browser application to identify the services with blue col
`ored text and display the cursor as a fist with an extended
`index finger.
`Thus, there is a need to provide enhanced Visual infor
`mation for internet Services.
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`SUMMARY OF THE INVENTION
`The invention is directed to a computer method compris
`ing the Steps of creating a computer graphic display with a
`link area corresponding to link instruction by interpreting
`display format information, and responsive to a cursor
`entering the link area, presenting an icon on the computer
`graphic display, the icon Visually representing a Service that
`results from Selecting the link area. In this manner, if
`telephone Service results from Selecting the link area, an icon
`Such as a telephone is presented.
`The invention is also directed to an article of manufacture,
`comprising a computer uSable medium having computer
`readable program code means embodied therein for creating
`a computer graphic display, the computer readable program
`code means in the article of manufacture comprising pro
`gram readable program code means for causing a computer
`to create the computer graphic display with a link area
`corresponding to link instruction by interpreting display
`format information. The article of manufacture also com
`65
`prising program readable program code means for causing
`the computer to communicate with an operating System and
`
`60
`
`US 6,362,840 B1
`
`2
`a browser application to determine when a cursor enters the
`link area. The article of manufacture also comprising pro
`gram readable program code means for causing the com
`puter to communicate with the operating System and the
`browser application to present an icon on the computer
`graphic display, the icon Visually representing a Service that
`results from Selecting the link area.
`The invention is also directed to a computer System,
`comprising a server, which is connected to an individual
`computer by a communication network. The System per
`forms the Steps of the individual computer reading display
`format information, the display format information being
`Stored on the Server and having at least one link instruction;
`the individual computer creating a computer graphic display
`with a link area corresponding to the link instruction by
`interpreting the display format information; and responsive
`to a cursor entering the link area, the individual computer
`presenting an icon on the computer graphic display, the icon
`Visually representing a Service that results from Selecting the
`link area.
`The invention is also directed to a memory for Storing data
`for access by an application program being executed on a
`data processing System, comprising a data Structure Stored in
`the memory, the data Structure including information resi
`dent in a database used by the application program and
`including a plurality of data objects, each of the data objects
`containing display format information; link instructions, the
`link instructions comprising part of the display format
`information; and a plurality of visually representative icon
`objects, one icon object being related to each link instruction
`and Visually representing the related link instruction.
`The visually representative icons of the invention may
`represent telephone Service; facsimile Service; Video Service;
`game Service, financial Service and help Service. Sounds or
`text that are descriptive of the Service may also be presented.
`Display format information may be in the form of hypertext
`mark-up language documents.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`FIG. 1 illustrates one embodiment with the system com
`prising individual computers linked to each other via net
`Works,
`FIG. 2 illustrates another embodiment with the system
`comprising an individual computer;
`FIG. 3 illustrates a top level flow chart of browser
`application Steps;
`FIG. 4 illustrates a flow chart of browser application
`display Steps;
`FIG. 5 illustrates a flow chart of browser application
`display Steps in one embodiment;
`FIG. 6 illustrates a flow chart of browser application
`display Steps in one embodiment;
`FIG. 7 illustrates a flow chart of browser application
`actions in one embodiment;
`FIG. 8 illustrates generic and visually representative
`icons,
`FIG. 9 illustrates a flow chart of one embodiment; and
`FIG. 10 illustrates a flow chart of one embodiment.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`System 1 is illustrated at FIG. 1. Elements of system 1
`include personal computerS 2A, 2B, 2C, 2D, 2E.; a mini
`computer 3; a mainframe computer 4, local area networks
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 12 of 19
`
`

`

`US 6,362,840 B1
`
`15
`
`3
`5A, 5B; a modem 6, an Internet service provider 7; tele
`communication networkS 8A, 8B; a telecommunication link
`9; and the Internet 10. The system of the present invention
`also includes uniform resource locations (URLs) for tele
`communication Services 11A, 11B, facsimile Services 12,
`and financial transaction Services 13.
`Personal computer 2A with associated modem 6, is linked
`to the Internet Service provider 7, using a dial-up acceSS
`protocol over telecommunication link 9.
`Internet service provider 7 is linked to the Internet 10 and
`thereby provides personal computer 2A with electronic
`access to the Internet 10.
`Local area network 5A is an Ethernet and is connected to
`personal computer 2B, mainframe 4, and the Internet 10.
`Local area network 5A is also connected to telecommuni
`cation Services URL 11A and financial transaction Services
`URL 13. Telecommunication services URL 11A is linked to
`telecommunication network 8B.
`Local area network 5B is also an Ethernet and is con
`nected to personal computers 2C, 2D, 2E, minicomputer 3,
`and the Internet 10. Local area network 5B is also connected
`to telecommunication services URL 11B, and facsimile
`Services URL12. Telecommunication services URL11B and
`facsimile services URL 12 are both linked to telecommuni
`cation network 8A.
`With the various local area networks, communication
`links and the Internet, personal computer 2A can electroni
`cally acceSS any of the devices or Services that are connected
`to local area networks 5A and 5B. Similarly, any of the
`personal computers 2C, 2D, 2E that are connected to local
`area network 5B can electronically access any of the devices
`or Services that are connected to local area network 5A. In
`this manner, any of the devices or Services that comprise
`System 1 are able to communicate or electronically acceSS
`any of the other devices or Services of System 1.
`To enable the interconnections thus described, personal
`computerS 2A, 2B, 2C, 2D, 2E each have central processors,
`memory, input/output devices, and computer graphic display
`devices. In a conventional manner, the personal computers
`load application programs from non-volatile memory, Such
`as disk Storage, into volatile memory Such as Random
`Access Memory (RAM), where the instructions are executed
`by the central processor according to input/output instruc
`tions that operate on data contained in memory. Application
`programs for the personal computers include browser appli
`cations which load files from the memory of other devices
`in System 1. Browser applications interact with Services
`11A, 11B, 12, 13 in system 1.
`FIG. 2 illustrates another embodiment. In this
`embodiment, System 14 is a personal computer or other type
`of Smaller computer System, but System 14 does not require
`access to external networks or the Internet. System 14
`comprises a central processor 15 connected to input and
`output devices Such as a keyboard 16B and a mouse or
`pointing device 16A.
`System 14 also comprises memory, that is connected to
`and addressable by CPU 15, such as non-volatile disk
`storage memory 17B and volatile RAM 17A. Application
`programs, application data and reference material are Stored
`in disk storage 17B. CPU 15 loads application programs into
`RAM 17A where the application runs and operates on data
`in RAM 17A and disk storage 17B.
`System 14 also comprises a computer graphic display
`device 18 that is used by CPU 15 as a graphical user
`65
`interface (GUI) to the application program loaded in RAM
`17A.
`
`35
`
`40
`
`45
`
`4
`System 14 further comprises links between CPU 15 and
`external services 19A, 19B, 19C and 19D. External services
`provide enhanced capabilities Such as telephone Services
`19A, financial services 19B, facsimile services 19C, and
`entertainment services 19D.
`In the embodiment of FIG. 2, the browser application
`links to documents and Services that are connected to or
`controlled by CPU 15. For example, the browser loads
`display format information in the form of an HTML file
`from memory 177B. The HTML format file includes link
`instructions to other HTML files in memory 177B. In this
`manner, the browser application of System 14 uses docu
`ments and files in the same manner that the browser of
`System 1 uses document and files. However, in System 14,
`the documents and files are resident within memory 17A and
`17B. Similarly, CPU 15 links to external services 19A, 19B,
`19C, 19D just as personal computer 2A, 2B, 2C, 2D or 2E
`in system 1 links to services 11A, 11B, 12, and 13. However,
`services 19A, 19B, 19C, 19D of system 14 are directly
`accessible, whereas in System 1, the Services are accessible
`through networks 5A, 5B and 10.
`Having thus described systems 1 and 14, the method used
`by systems 1 and 14 has a foundation in the World Wide Web
`(WWW, or the Web). The ability to easily communicate
`between computing devices that are connected to the Inter
`net is one basis of the World Wide Web. The Web was
`conceived as a way for computer users to gain access to text
`or other information resources on the Internet, regardless of
`the type of hardware being used.
`One problem associated with exchange of text documents
`over the Internet is the number of different text file formats
`produced by word processors. Most documents of interest
`are created and Saved in a proprietary word processor
`format. These multiple formats result in Significant infor
`mation eXchange incompatibilities. This lack of interoper
`ability between text document formats is greatly alleviated
`by the adoption of HTML as the textual information
`eXchange Standard on the Internet.
`HTML is a subset of SGML and provides platform and
`processor independent rendering of documents. One advan
`tage of a standardized graphic markup language, Such as
`HTML, is that text and graphic information is rendered
`Virtually identically on any platform or operating System.
`Thus, a Standardized graphic markup language, and HTML
`in particular, provides an excellent Standard for exchange of
`text and graphic information. However, few word processors
`are HTML compliant and HTML text files, with embedded
`links and other formatting codes, are cumberSome and
`difficult to read or understand without experience.
`Though Some word processor packages are able to render
`HTML format files, word processors are generally unable to
`provide Internet navigation Support. Browser applications
`fill this gap in capability by simultaneously rendering HTML
`format files and Supporting Internet navigation. Browser
`applications are hardware and operating System specific and
`provide a graphical user interface to the Internet, in addition
`to providing other capabilities like book-marking Internet
`Sites, and printing Support. Browser applications are rapidly
`evolving and there are multiple browser applications that
`Support many hardware and operating Systems.
`FIG. 3 illustrates the steps commonly performed by a
`browser application. In Steps not illustrated for convenience,
`a user boots a computer Such as personal computer 2A in
`system 1 of FIG. 1, and accesses the Internet via an Internet
`Service Provider 7. Though the following description uses
`System 1, System 14 performs similar StepS.
`
`25
`
`50
`
`55
`
`60
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 13 of 19
`
`

`

`S
`At Step 20, the user loads and Starts the browser applica
`tion on personal computer 2A of FIG. 1.
`At Step 21, the browser application locates, loads and
`interprets a file with display format information. This file is
`usually a document in HTML format and the display format
`information is encoded in the HTML formatting. For most
`browser applications, one particular HTML document is
`identified as the homepage. That HTML format document
`resides on the user computer, or it resides on another
`computer that is accessible to the user via the Internet.
`At Step 22, the browser application monitors and inter
`prets the location of the cursor for the computer on the
`computer graphic display Screen. The cursor is a moveable
`graphic indicator on the computer graphic display that is
`usually controlled by a mouse or trackball. AS the user
`moves the mouse, the cursor moves on the computer graphic
`display and traverses different areas of the displayed docu
`ment. Depending on the underlying area of the displayed
`document, at Step 22, the browser application modifies the
`Visual representation of the cursor.
`There are at least three distinct area types on the display
`Screen. One area type is background area, one area type is
`text area, and one area type is link area. Interpreting the
`cursor location and actions at Step 22 includes a number of
`additional steps, some of which are illustrated in FIG. 4. The
`actions at Step 22 are performed by the operating System and
`browser application in cooperation with each other.
`At step 23 in FIG. 4, the browser determines whether the
`cursor is over a background area. The background area is
`usually formed without textual material. Typical background
`areas are colored panels and images. The background area
`can include an image of text, but the browser recognizes an
`image of text as a background area. If the cursor is not over
`a background area, the browser performs Step 26.
`At Step 24, if the browser application determines the
`cursor is over a background area, the browser application
`displays the cursor as an arrow, such as 100 in FIG. 8.
`At Step 25, the browser application loops until it deter
`mines that the cursor has moved off the background area.
`After step 25, when the cursor moves off the background
`area, the browser application performs Step 23.
`At Step 26, the browser application determines whether
`the cursor is over a text area. Text areas on the graphic
`display contain text material and retain the characteristics of
`text. For example, most browser applications can Search text
`areas, and most browser applications will also allow a user
`to block Sections of text and copy a Section from the text area
`to a clip-board. If the cursor is not over a text area, the
`browser performs step 29.
`At step 27, if the browser application determines the
`cursor is over a text area, the browser application displayS
`the cursor as an “I Such as 101 in FIG. 8.
`At Step 28, the browser application loops until it deter
`mines that the cursor has moved off the text area.
`After step 28, when the cursor moves off the text area, the
`browser application performs Step 23.
`At step 29, the browser application determines whether
`the cursor is over a link area. Link areas are the areas of the
`display Screen that contain link instructions. The link area
`can be a Section of text that is presented in a different color
`to identify it as a link area. The link area can also be an
`image, or part of an image. The link area can also be part of
`the display area that is visibly unremarkable from other
`areas of the computer graphics display. If the cursor is not
`over a link area, the browser returns to Step 23.
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 6,362,840 B1
`
`6
`At step 30, if the browser application determines the
`cursor is over a link area, the browser application displayS
`the cursor as a closed fist with the index finger extended,
`Such as 102 in FIG. 8.
`At Step 31, the browser application loopS until it deter
`mines that the cursor has moved off the link area or the user
`has Selected the link.
`After step 31, when the cursor moves off the link area, the
`browser application performs Step 23.
`Of the three described areas on the display Screen: back
`ground; text; and link areas, the link area is the only active
`area of the display. An active area means that user actions
`when the cursor is over the active area will cause the
`browser application to perform an action according to link
`instructions. A common user action is Selecting the link area
`by clicking a mouse button.
`At Step 32, the browser application loops to determine
`whether the user has selected the link area.
`At step 33, if the user selects the link area, the browser
`application performs the link instructions associated with the
`link area.
`A common link instruction is to locate and load an HTML
`format document that is Stored Somewhere on the System.
`The protocol for this is called Hypertext Transfer Protocol
`(http).
`The http protocol is one of several Uniform Resource
`Locators (URLs). The URL conventions encompass several
`Standardized location names that are uniformly adopted
`within the Internet community. The present URL convention
`includes Hypertext Transport Protocol (http); File Transfer
`Protocol (ftp); Gopher (gopher); Wide Area Information
`Service (wais); Mail (mailto); and Net News Transfer Pro
`tocol (nntp). Each URL type provides a different type of
`action or Service, and each URL type may constitute a link
`within an HTML format document.
`Link areas in documents are usually associated with text.
`The text often describes the link area and resulting link
`action and most browser applications render link area text in
`a different color. Image objects and predefined areas on a
`display Screen can also be link areas. For example an image
`on the computer graphic display can also be a link area.
`There does not need to be any associated text with the image
`to identify the image as a link area, or the resulting link
`action. A link area may also be a pre-defined geometric area
`on the display Screen that is not visually distinct from any
`other area on the display.
`Browser applications identify link areas in images by
`changing the depiction of the cursor when the cursor is over
`a link area to that of a fist with extended finger, such as 102
`in FIG.8. This browser action was described with reference
`to the flow charts in FIGS. 3 and 4.
`When the HTML format document on the computer
`graphics display contains a link area with link instructions
`Such as: <a href="mailto-johndoe(Glanywhere.com'>, the
`browser application will launch an e-mail application and
`allow the user to complete a pre-addressed message to the
`designated e-mail address. Most web pages will identify a
`mailto URL link area with a suitable text label Such as
`“e-mail to us.” However, it is possible to create URL link
`areas without any text description. For example, an image of
`a flower on a computer graphic display can be a URL link
`area that launches the Same e-mail instructions above. Thus,
`the browser application will alert the user that the flower is
`a URL link area by changing the cursor to a fist with
`extended finger when the cursor is over the flower. However,
`
`APPL-1038 / IPR2018-00361
`Apple v. Uniloc / Page 14 of 19
`
`

`

`7
`until the user actually Selects the link area, they are unable
`to determine that the link area is of the mailto URL type.
`It is envisioned that new types of services will be avail
`able through browser applications using HTML format
`documents. Examples of new types of Services using the
`Internet are voice telephony, facsimile Services, financial
`transactions, game Services and Video or television Services.
`AS these new types of Services are available, additional
`information on the type of Service is advantageous. One
`method to provide this additional information is through the
`use of Visually representative icons that represent the type of
`Service provided by activating or Selecting the link area.
`AS used herein and in the claims an icon is a moveable
`graphic depiction on the computer display that moves in
`correspondence to the mouse or pointing device. A hand
`with extended finger such as 102 in FIG. 8 is an icon.
`However, the hand 102 in FIG. 8 is a generic icon because
`it does not provide a visual representation of the type of
`Service. An icon is visually representative of the type of
`Service when the icon itself brings to mind the Service
`without the need for a text description. In this manner,
`because a telephone instrument brings to mind telephone
`Service, a telephone instrument icon is visually representa
`tive of telephone service. Similarly, a television icon which
`brings to mind television Service based on the icon alone is
`Visually representative of television Service.
`AS a further example, where link instructions in a link
`area will provide telephony Services, the System displays an
`icon that Visually represents telephone Services when the
`cursor is over that link area. This icon is a telephone or
`handset or other visual representation that brings to mind
`telephone Services. An example of a telephone icon which
`brings to mind telephone services is 103 in FIG. 8.
`In another example, where the link instructions provide
`e-mail Service, the cursor changes to an envelope icon, 104
`in FIG. 8, when the cursor is over the link area. In this
`manner, before Selecting the link, the user can visually
`determine that the cursor is over a link area and because the
`cursor changes to an icon of an envelope, the user is
`reminded of e-mail and thus knows that the type of link area
`is e-mail. Because the envelope icon is visually representa
`tive of e-mail Service, the user does not need to rely on text
`to describe the link area as e-mail.
`In another example, where the link instructions provide
`facsimile Service, the cursor changes to a visually represen
`tative icon of a facsimile machine, 105 in FIG. 8, when the
`cursor is over the link area. In this manner, before Selecting
`the link, the user can visually determine that the cursor is
`over a link area and because the cursor changes to an icon
`of a facsimile machine, the user is reminded of facsimile
`Services and thus knows that the type of link area is facsimile
`Service. Because the facsimile machine icon is visually
`representative of facsimile Service, the user does not need to
`rely on text to describe the link area as facsimile Services.
`In another example, where the link instructions provide
`financial Services, Such as on-line payment, the cursor
`changes to a visually representative icon Such as a S, 106 in
`FIG. 8, or a cash register when the cursor is over the link
`area. In this manner, before Selecting the link area, the user
`can visually determine that the cursor is over a link area and
`because the cursor changes to an icon of a S or a cash
`register, the user is reminded of financial Services and thus
`knows that the type of link