United States Patent [191
`Douglas et al.
`
`I
`
`USO05448695A
`
`[11] Patent Number:
`[45] Date of Patent:
`
`5,448,695
`Sep. s, 1995
`
`[54] METHOD AND APPARATUS FOR
`DYNAMIC VISUAL FEEDBACK
`MESSAGING IN A GRAPHICAL USER
`INTERFACE OF A DATA PROCESSING
`SYSTEM
`[75] Inventors: Thomas B. Douglas, Dallas; Robert J.
`Torres, Colleyville, both of Tex.
`[73] Assignee: International Business Machines
`Corporation, Armonk, NY.
`[21] Appl. No.: 999,237
`[22] Filed:
`Dec. 31, 1992
`
`[51] Int. Cl.6 .............................................. .. G06F 3/14
`[52] US. Cl. .................................. .. 395/155; 395/157;
`395/159; 395/161
`[58] Field of Search ............. .. 395/ 157, 155, 158, 159,
`‘
`395/161, 550
`
`[56]
`
`References Cited
`PUBLICATIONS
`Microsoft Windows User’s Guide (Microsoft Corpora
`tion) pp. 6, 35, 126-128, 117, 136.
`Microsoft Windows User’s Guide (Trademark of Mi
`crosoft Corporation), 1990, pp. 17, 41-42, 139 & 199 and
`attached sheets #1, 2, 3,.
`Primary Examiner-Heather R. Herndon
`Assistant Examiner-—Cliff Vo
`Attorney, Agent, or Firm-Jonathan E. J obe; Melvin A.
`Hunn; Andrew J. Dillon
`[57]
`ABSTRACT
`A method and apparatus is provided for visually repre
`senting data processing operations in a data processing
`system. An action feedback message is provided for a
`
`particular data processing operation. It includes a non
`textual message component. Communication between
`an operator and the data processing system is monitored
`for requests for performance of the particular data pro
`cessing operation. For each time a particular data pro
`cessing operation is performed by the data processing
`system, the action feedback message is automatically
`displayed on a display of the data processing system,
`preferably for a predetermined time interval during the
`performance of the particular data processing opera
`tion. The action feedback message may be moved along
`a predetermined display path on the display of the data
`processing system during automatic display. Preferably
`the action feedback message and/ or the predetermined
`display path is located in a region of the display of likely
`operator focus, as determined from automatic monitor
`ing of operator input to the data processing system. If it
`is impossible to determine the region of likely operator
`focus, the display of the action feedback message is
`delayed until such determination can be made. Addi
`tionally, an operation completion message, which in
`cludes a non-textual graphical message component, and
`which differs from the action feedback message, is pro
`vided for display upon completion of the particular data
`processing operation. If operator input activities indi
`cate that the operator is not likely to be focused on the
`display screen, the operation completion messages are
`queued for display at a later time, preferably a time
`during which operator input indicates that the operator
`is focused on the display screen of the data processing
`system.
`
`28 Claims, 12 Drawing Sheets
`
`IDENTIFY PARTICULAR
`DATA PROCESSING
`OPERATIONS (1: INTEREST
`
`M132
`
`i
`
`l?SIGN ACTIVITY FEEDBACK
`MESSAGE FOR EACH DATA
`PROCESSING OPERATION
`
`134
`
`i
`
`[ESIGN OPERATION COWLETION
`FESSAGE FOR EACH DATA
`PROCESSING OPERATIM
`
`DEFIIE MAPPING RELATIU‘SHIP
`BETWEEN ACTIVITY FEEEBACK
`PESSAOES AND DISPLAY
`(DYNAMIC OR STATIC)
`
`i
`
`DEFINE MAPPING RELATION
`BETWEEN CPERATlON COM’LETION
`PESSAGES AND DISPLAY
`
`143
`
`i
`
`EFIIE OUEUING AID REPLAY
`RELATI
`F
`ACTIVITY FEEEBACK PESSAGES
`
`i
`
`REPLAY M14‘
`OlEUlNG AND
`RELATIGTSHIPS FOR
`OPERATION COFFLET ION PESSAOES
`
`IPR2017-01828
`Ubisoft EX1003 Page 1
`
`

`

`US. Patent
`
`Sep. s, 1995
`
`Sheet 1 of 12
`
`5,448,695
`
`I ,5
`
`o
`I
`I
`
`14
`
`FIGURE 1
`
`IPR2017-01828
`Ubisoft EX1003 Page 2
`
`

`

`US. Patent
`
`Sep. 5, 1995
`
`Sheet 2 of 12
`
`5,448,695
`
`mm mEDoE
`
`g)\
`
`E5
`
`mm\/\ 2 L025
`
`ow W
`vv
`
`H Eoesooo
`
`00
`
`IPR2017-01828
`Ubisoft EX1003 Page 3
`
`

`

`US. Patent
`
`Sep. 5, 1995
`
`Sheet 3 of 12
`
`5,448,695
`
`ammeoHn.
`
`llxulll
`
`9.th 4II
`
`329:-
`
`IPR2017-01828
`
`Ubisoft EX1003 Page 4
`
`IPR2017-01828
`Ubisoft EX1003 Page 4
`
`

`

`US. Patent
`
`Sep. 5, 1995
`
`Sheet 4 of 12
`
`5,448,695
`
`0NmEDOHu
`
`{aE(52:;
`
`285000
`
`co@5275
`
`|PR2017-O1828
`
`Ubisoft EX1003 Page 5
`
`IPR2017-01828
`Ubisoft EX1003 Page 5
`
`

`

`US. Patent
`
`Sep. 5, 1995
`
`Sheet 5 0f 12
`
`5,448,695
`
`UN mEDoE
`
`33
`
`2 322m
`
`FHL
`
`m:
`
`IIIHIIII
`
`#COEDOOD
`
`IPR2017-01828
`Ubisoft EX1003 Page 6
`
`

`

`US. Patent
`
`Sep. s, 1995
`
`Sheet 6 of 12
`
`5,448,695
`
`Q H.
`
`NI,
`
`mm
`
`mmDoE
`
`o:
`
`mi
`
`29580
`
`cc 0253
`
`2 $25
`
`N:
`
`
`
`| I I II. III. II III I] I.
`
`IIIIHITI
`
`225000
`
`\ ms“
`
`IPR2017-01828
`Ubisoft EX1003 Page 7
`
`

`

`US. Patent
`
`Sep. s, 1995
`
`Sheet 7 of 12
`
`5,448,695
`
`138
`
`M132
`
`IDENTIFY PARTICULAR
`DATA PROCESSING
`OPERATIONS OF INTEREST
`
`DESIGN ACTIVITY FEEDBACK
`MESSAGE FOR EACH DATA
`PROCESSING OPERATION
`
`T
`
`DESIGN OPERATION COMPLETION
`MESSAGE FOR EACH DATA
`PROCESSING OPERATION
`
`T
`
`DEFINE MAPPING RELATIONSHIP
`BETWEEN ACTIVITY FEEDBACK
`MESSAGES AND DISPLAY‘
`(DYNAMIC OR STATIC)
`
`DEFINE MAPPING RELATION
`BETWEEN OPERATION COMPLETION
`MESSAGES AND DISPLAY
`
`140 /f
`
`T
`
`DEFINE OUEUING AND REPLAY
`RELATIONSHIPS FOR
`ACTIVITY FEEDBACK MESSAGES
`
`T
`
`M144
`DEFINE QUEUING AND REPLAY
`RELATIONSHIPS FOR
`OPERATION COMPLETION MESSAGES
`
`@146 FIGURE 3
`
`IPR2017-01828
`Ubisoft EX1003 Page 8
`
`

`

`US. Patent
`
`Sep. 5, 1995
`
`Sheet 8 of 12
`
`5,448,695
`
`148
`
`/ 158
`
`INITIALIZE SYSTEM
`
`T
`
`DISPLAY DEFAULT WINDOWS,
`POINTER AND ICONS
`
`T
`
`MONITOR USER INPUT
`
`M 152
`
`156
`
`169
`
`DYNAMIC
`VISUAL
`MEs§AeE
`
`STATIC
`VISUAL
`MES§AGE
`
`158
`
`YES W
`
`162
`
`YES @
`
`164
`
`166
`
`168
`
`.
`
`17@
`
`YES m
`
`PERFORM OTHER ACTION
`
`/172
`
`FIGURE 4:
`
`IPR2017-01828
`Ubisoft EX1003 Page 9
`
`

`

`US. Patent
`
`Sep. 5, 1995
`
`Sheet 9 of 12
`
`5,448,695
`
`@174.
`I
`
`DETERMINE USER FOCAL POINT
`
`FETCH COMPONENTS OF MESSAGE
`
`/\/ 178
`
`FETCH MESSAGE FRAME
`
`FETCH MESSAGE LOCATION
`
`i
`I
`I
`
`PLACE MESSAGE COMPONENTS
`IN MESSAGE FRAME
`
`186
`
`188
`
`WAIT
`
`NO}
`
`PLACE MESSAGE FRAME IN
`DISPLAY BUFFER AT FOCAL POINT
`
`I
`
`UPDATE DISPLAY
`
`194
`
`YES
`
`196
`
`/
`
`REMOVE MESSAGE
`
`WAIT
`
`FIGURE 5
`
`IPR2017-01828
`Ubisoft EX1003 Page 10
`
`

`

`US. Patent
`
`Sep. s, 1995
`
`Sheet 10 of 12
`
`5,448,695
`
`288
`
`FETCH MESSAGE COMPONENTS
`
`FETCH MESSAGE FRAME
`
`FETCH STATIC MESSAGE LOCATION
`
`PLACE MESSAGE COMPONENTS
`IN MESSAGE FRAME
`
`T
`T
`T
`T
`
`PLACE MESSAGE FRAME AT
`STATIC MESSAGE LOCATION
`IN DISPLAY BUFFER
`
`l
`
`UPDATE DISPLAY UNTIL
`EXPIRATION OF TIME INTERVAL
`
`212 /
`
`FIGURE 6
`
`IPR2017-01828
`Ubisoft EX1003 Page 11
`
`

`

`US. Patent
`
`Sep. s, 1995
`
`Sheet 11 of 12
`
`5,448,695
`
`FETCH POINTER TO THE INITIAL
`MESSAGE LOCATION & STACK
`
`p216
`
`I
`
`218
`FETCH MESSAGE DURATION r‘
`
`'_”_——>
`
`MOVE MESSAGE
`
`<———-————‘
`
`A
`
`/\/ 228
`
`I
`
`222
`
`224 /
`
`DETERMINE NEXT MESSAGE LOCATION
`
`FIGURE 7
`
`IPR2017-01828
`Ubisoft EX1003 Page 12
`
`

`

`US. Patent
`
`Sep. s, 1995
`
`Sheet 12 of 12
`
`5,448,695
`
`228
`
`DISPLAY FEATURES WINDOW
`
`MONITOR INPUT
`
`T
`I
`
`UPDATE WINDOW
`' STATIC MESSAGE LOCATION
`' MESSAGE DURATION
`' MESSAGES ON/ OFF
`
`FIGURE 8
`
`IPR2017-01828
`Ubisoft EX1003 Page 13
`
`

`

`1
`
`5,448,695
`2
`wise hindered by inef?ciencies in providing information
`to the operator.
`
`METHOD AND APPARATUS FOR DYNAMIC
`VISUAL FEEDBACK MESSAGING IN A
`GRAPHICAL USER INTERFACE OF A DATA
`PROCESSING SYSTEM
`
`5
`
`15
`
`30
`
`35
`
`BACKGROUND OF THE INVENTION
`1. Technical Field
`The present invention relates in general to graphical
`user interfaces for data processing systems, and in par
`ticular to techniques for improving the display of infor
`mation relating to data processing operations in a graph
`ical user interface of a data processing system.
`2. Description of the Related Art
`In recent years, the data processing industry has
`made a substantial move away from keyboard-driven
`user interfaces toward graphical user interfaces. A vari
`ety of menus and operator buttons are provided in most
`graphical user interface systems. Simultaneously, the
`industry has moved toward the use of multiple work
`spaces, or “windows”, in order to facilitate multi-task
`ing activities, and to otherwise allow the coordinated
`utilization of data processing resources, such as soft
`ware objects, hardware devices, and application pro
`grams. The principal advantages obtained by utilizing
`both graphical user interfaces and multiple workspace
`environments are an enhanced operating efficiency, as
`well as an advantageous utilization of operator intuition
`insofar as the data processing objects and resources can
`be handled like real world objects, which facilitates
`learning and retention of new application programs.
`Despite these signi?cant advantages, the utilization of
`graphical user interfaces and/or multiple workspace
`operating environments tends to overload the inexperi
`enced operator with more information than he or she
`can handle ef?ciently and without error. Inexperienced
`operators frequently have difficulty in developing a
`functional understanding of the hierarchical relation
`ships which are inherent in the utilization of data pro
`cessing resources.
`In order to maintain their apparently dominant and
`increasing role in data processing systems, graphical
`user interfaces will need continuing “streamlining” in
`order to allow inexperienced users to come to a quick,
`45
`and preferably intuitive, understanding of the use of
`data processing resources, and in particular data pro
`cessing operations which involve particular data pro
`cessing resources such as software objects and hard
`ware devices. Such improvements should continue the
`trend in reducing unnecessary or useless user requests
`which strain data processing resources, such as data
`processing end devices, in networked and group-work
`environments. For example, much needs to be done to
`minimize the opportunity for unnecessary or erroneous
`uses of end devices, such as printing devices. An inexpe
`rienced operator, or an experienced operator perform
`ing dif?cult tasks, may inadvertently print lengthy doc
`uments more often than necessary due to temporary
`memory lapses or confusion. Conventional graphical
`user interfaces are not effective in providing the opera
`tor with information relating to either on-going print
`operations or previously-completed print operations.
`Even if information is provided to the operator, con
`ventional graphical user interfaces are de?cient in that
`messages provided to the operator may be provided
`during brief periods of inattention to the data processing
`display screen. Operations other than printing are like
`
`40
`
`55
`
`65
`
`SUMMARY OF THE INVENTION
`It is one objective of the present invention to provide
`a method and apparatus for use in a data processing
`system which provides for the visual representation of
`data processing operations, wherein an action feedback
`message, which includes a non-textual graphical mes
`sage component, is identi?ed to a particular data pro
`cessing operation and automatically displayed for a
`predetermined time interval during the performance of
`the particular data processing operation by the data
`processing system.
`It is another objective of the present invention to
`provide a method and apparatus for use in a data pro
`cessing system to visually represent data processing
`operations, wherein an action feedback message is iden
`ti?ed to a particular data processing operation and auto
`matically displayed and moved along a predetermined
`display path upon detection of an operator request for
`performance of the particular data processing opera
`tron.
`It is yet another objective of the present invention to
`provide a method and apparatus for providing an action
`feedback message which is identi?ed to a particular data
`processing operation, which is displayed for a predeter
`mined duration in a location on a display screen which
`is identified by the data processing system as being the
`likely operator focal point within the data processing
`display screen.
`It is yet another objective of the present invention to
`provide an action feedback message which moves
`across a selected workspace on or about the initiation of
`a particular data processing operation which is identi
`?ed with it, as well as an operation completion message
`which is provided at a selected location upon comple
`tion of the particular data processing operation, and
`which differs from the action feedback message.
`It is still another objective of the present invention to
`provide an action feedback message which moves
`across a selected workspace on or about the initiation of
`a particular data processing operation which is identi
`?ed with it, as well as an operation completion message
`which is provided at a selected location upon comple
`tion of the particular data processing operation, and
`which differs from the action feedback message,
`wherein operator interaction with the data processing
`system is monitored to determine whether the operator
`is focused on the display screen of the data processing
`system, and wherein automatic display of the action
`feedback message is delayed, or suspended, until it can
`be determined that the operator is attentive to the dis
`play, and wherein the operation completion messages
`are prolonged, or queued, if it is evident that the opera
`tor is inattentive to the display screen until it can be
`determined that the operator’s attention has shifted
`back to the display screen.
`These and other objectives are achieved as is now
`described. When considered broadly as a method, the
`present invention comprises a method of visually repre
`senting data processing operations in a data processing
`system, and is composed of a number of method steps.
`An action feedback message is provided for a particular
`data processing operation. The action feedback message
`includes a non-textual graphical message component. In
`the preferred embodiment, the action feedback message
`includes both a non-textual graphical message compo
`
`IPR2017-01828
`Ubisoft EX1003 Page 14
`
`

`

`5,448,695
`
`4
`The above as well as additional objectives, features,
`and advantages of the present invention will become
`apparent in the following detailed written description.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`The novel features believed characteristic of the in
`vention are set forth in the appended claims. The inven
`tion itself, however, as well as a preferred mode of use,
`further objectives and advantages thereof, will best be
`understood by reference to the following detailed de
`scription of an illustrative embodiment when read in
`conjunction with the accompanying drawings, wherein:
`FIG. 1 is a perspective view of a data processing
`system which can be utilized to implement the method
`and apparatus of the present invention;
`FIGS. 2a, 2b, 2c, 2d, and 2e graphically depict exam
`ples of utilization of the method and apparatus of the
`present invention in providing visual feedback messag
`ing in a graphical user interface;
`FIG. 3 provides a ?owchart representation of the
`broad method steps which are required to implement
`the dynamic visual messaging system of the present
`invention;
`FIG. 4 provides a ?owchart representation of a broad
`overview of the normal operating steps of one preferred
`embodiment of the visual messaging system of the pres
`ent invention; and
`FIGS. 5, 6, 7, and 8 provide detail views of routines
`identi?ed in the ?owchart of FIG. 4, which relate gen
`erally (and respectively) to the operation of an action
`feedback message, the operation of an operation com
`pletion message, the operation of a routine for the re
`play from queuing of operation completion messages,
`and a routine for receipt of operator input relating to the
`visual messaging system of the present invention.
`
`35
`
`3
`nent and a textual message component. The data pro
`cessing system monitors for communication between an
`operator and the data processing system, and in particu
`lar monitors for requests for performance of the particu
`lar data processing operation. In the preferred embodi
`ment, detection of the request for the particular data
`processing operation causes the automatic display of the
`action feedback message for a predetermined time inter
`val on the display of the data processing system, each
`time the particular data processing operation is per
`formed by the data processing system. Preferably, while
`the action feedback message is being displayed on the
`display, it is automatically moved along a predeter
`mined display path which intersects, or is adjacent to, a
`region on the display of likely operator focus. The re
`gion of likely operator focus is determined empirically
`by automatic monitoring of communication between
`the operator and the data processing system.
`If it is determined that the operator is not focusing on
`a particular portion of the display of the data processing
`system, the step of automatically displaying the action
`feedback message is delayed until it is possible to deter
`mine the region of likely operator focus. Once the re
`gion of likely operator focus is identi?ed, the action
`feedback message is automatically displayed, preferably
`along the display path which coincides with or adjoins
`the region of likely operator focus.
`a‘,
`A plurality of different action feedback messages may
`be provided, one for each of a plurality of data process
`30
`ing operations. During detected periods of inattention
`to the display of the data processing system, the differ
`ent action feedback messages may be queued in memory
`in a ?rst-in, ?rst-out manner at least until it is possible to
`determine the region of likely operator focus.
`In the preferred embodiment, at least one graphical
`user interface button is provided to allow at least one of
`(a) suspension, and (b) abortion of any particular data
`processing operation either prior to the initiation of the
`operation or during execution of the operation. Also,
`preferably, at least one user interface command is pro
`vided which allows the operator to set the predeter
`mined time interval for the automatic display of action
`feedback messages. For those operators that find the
`action feedback messages of the present invention to be
`a distraction, at least one user interface command is
`provided which allows for the disabling of the auto
`matic display of action feedback messages.
`Also, in the preferred embodiment, an operation
`completion message is provided in addition to the ac
`tion feedback message. Preferably, the operation com
`pletion message includes a non-textual graphical mes
`sage component and differs from the action feedback
`message. An operation completion message is identi?ed
`to each particular data processing operation for which
`an action feedback message exists. Upon completion of
`a particular data processing operation, the operation
`completion message is provided in a selected location,
`and preferably for a selected duration. If it is deter
`mined from monitoring of operator interaction with the
`data processing system that the operator may be inatten~
`tive to activity on the display of the data processing
`system, the various completion operation messages are
`queued on a first-in, ?rst-out basis for later display,
`preferably during a period during which operator activ
`ity indicates that the operator’s attention is focused on
`the display of the data processing system.
`
`65
`
`40
`
`45
`
`DETAILED DESCRIPTION OF PREFERRED
`EMBODIMENT
`With reference now to the ?gures and in particular
`with reference to FIG. 1, there is depicted a pictorial
`representation of data processing system 10 which may
`be programmed in accordance with the present inven
`tion. As may be seen, data processing system 10 includes
`processor 12 which preferably includes a graphics pro
`cessor, memory device and central processor (not
`shown). Coupled to processor 12 is video display 14
`which may be implemented utilizing either a color or
`monochromatic monitor, in a manner well known in the
`art. Also coupled to processor 12 is keyboard 16. Key
`board 16 preferably comprises a standard computer
`keyboard which is coupled to the processor by means of
`cable 18.
`Also coupled to processor 12 is a graphical pointing
`device, such as mouse 20. Mouse 20 is coupled to pro
`cessor 12, in a manner well known in the art, via cable
`22. As is shown, mouse 20 may include left button 24,
`and right button 26,- each of which may be depressed, or
`“clicked”, to provide command and control signals to
`data processing system 10. While the disclosed embodi
`ment of the present invention utilizes a mouse, those
`skilled in the art will appreciate that any graphical
`pointing device such as a light pen or touch sensitive
`screen may be utilized to implement the method and
`apparatus of the present invention. Upon reference to
`the foregoing, those skilled in the art will appreciate
`that data processing system 10 may be implemented
`utilizing a so-called personal computer, such as the
`Model 80 PS/2 computer manufactured by Interna
`
`IPR2017-01828
`Ubisoft EX1003 Page 15
`
`

`

`10
`
`5,448,695
`5
`6
`tional Business Machines Corporation of Armonk, New
`document type. In workspace 32, the relationship be
`York.
`tween iconographic representation 34 of a printer and
`In the present invention, two types of messages are
`iconographic representation 40 of a software object is
`provided, including: (1) an action feedback message,
`indicated by arrow 46 which represents a drag-and
`and (2) an operation completion message. In accordance
`drop operation. Workspace 32 includes user-actuable
`with the preferred embodiment of the present inven
`graphical user control devices, such as print button 48,
`tion, particular data processing operations are identi?ed
`cancel button 50, and help button 52. An operator may
`for visual representation in a graphical user interface
`utilize mouse 20 (and the associated graphical pointing
`and/ or multiple workspace environment. A unique
`device) to select one or more of these buttons to call
`action feedback message and a unique operation com
`prede?ned data processing functions. The selection of
`pletion message are identi?ed to each particular identi
`print button 48 will result in printing of the document
`?ed data processing operation. The primary function of
`represented by iconographic representation 40 of a
`the action feedback message is to provide a message
`software object on a printer represented by icono
`which includes some non-textual graphical message
`graphic representation 34 of a printer. Selection of the
`components which provides a visual indication of the
`cancel button 50 will result in suspension or cancella
`particular data processing operation; this allows the
`tion of any on-going printing operation. Selection of
`operator to be visually alerted by a message, which
`help button 52 will result in the display of textual mate
`includes non-textual graphical components, that the
`rials, typically in the form of a pull-down menu, which
`particular requested data processing operation is about
`provides pre-packaged user assistance.
`to be, or is being, performed. This action feedback mes
`20
`In the preferred embodiment of the present invention,
`sage thus serves two purposes, including: (1) to provide
`communication between the operator and data process
`the operator with an opportunity to suspend or abort
`ing system 10 is monitored to determine when requests
`the activity prior to initiation and/or completion, and
`for performance of the particular data processing opera
`(2) to generally orient the operator to the fact that a
`tions occurs. In the example of FIGS. 2a through 2e, the
`particular resource-consuming data processing activity
`particular data processing operation which is discussed
`has been requested, which inherently may preclude the
`is that of printing a document on a particular printer.
`simultaneous or concurrent performance of data pro
`Accordingly, again with reference to FIG. 2a, data
`cessing operations which include either the software
`processing system 10 monitors the position of graphical
`objects or the data processing resources which are in
`pointing. device 100 (and/or a cursor, or other indica
`volved in the requested data processing operation. The
`tors of the portion of display 14 which has the opera
`operation completion message serves the predominant
`tor’s attention). When a request for performance of the
`function of providing a visual con?rmation to the oper
`particular data processing operation is detected, in ac
`ator that the speci?c data processing operation has been
`cordance with the present invention, the action feed
`completed. As will be set forth more clearly herebelow,
`back message is automatically displayed on the display
`when the operator appears to be inattentive to the dis
`in close proximity to the region of the display which is
`play of the data processing system, the operation com
`the likely current operator focus of attention. Place
`pletion message provides a visual and chronological
`ment of the action feedback message in a position proxi
`record of the completion of selected ones of the particu
`mate the latest indication of the operator’s point of
`lar data processing operations, which will be presented
`focus provides the greatest likelihood that the operator
`automatically for review when the operator’s attention
`will see and understand the action feedback message. In
`returns to the display of the data processing system.
`the preferred embodiment of the present invention the
`FIGS. 2a through 2e provide examples of utilization
`action feedback message is displayed only for a prede
`of both the action feedback message type and the opera
`termined time interval.
`tion completion message type. FIG. 2a provides an
`Additionally, in the preferred embodiment, the action
`example of one type of screen prior to generation of
`45
`feedback message is automatically moved across at least
`either the action feedback message or the operation
`a portion of display 14. With reference again to FIG. 20,
`completion message. FIGS. 2b and 2c provide examples
`display path 66 is indicated by the phantom line, and
`of alternative embodiments of the action feedback mes
`extends from the left-most boundary of window 30 to
`sage system of the present invention. FIGS. 2d and 2e
`the right-most boundary of window 30. Furthermore, as
`provide examples of the utilization of the operation
`stated above, in the present invention, the action feed
`completion message, and associated queuing protocol,
`back message is initially provided at a location proxi
`respectively.
`_
`mate a region on the display which is identi?ed by data
`With reference ?rst to FIG. 2a , there is depicted
`processing system 10 as a region of likely operator fo
`workspace 32 which is de?ned by window 30, which
`cus. With reference again to FIG. 2a, graphical pointing
`includes iconographic representation 34 of a printer, as
`55
`device 100 may be utilized to select print button 48,
`well as the iconographic representation 40 of a software
`which will cause the document represented by icono
`object. Iconographic representation 34 of a printer in
`graphic representation 40 of a software object to be
`cludes non-textual message component 36, and textual
`printed on a printer represented by iconographic repre
`message component 38. Preferably, the non-textual
`sentation 34 of a printer. Use of graphical pointing de
`message component 36 resembles a printing device,
`vice 100 and print button 48 also identi?es the current
`while the textual message component 38 provides some
`likely region of operator focus. Accordingly, display
`identi?cation of the particular printer represented by
`path 66 is de?ned, in accordance with a preestablished
`the icon. Iconographic representation 40 of a software
`mapping relationship, with respect to the position of
`object also includes non-textual message component 42
`print button 48. The action feedback message is dis
`as well as a textual message component 44. Preferably,
`65
`played at the left-most region of display path 66 for a
`the non-textual message component includes an image
`?xed (and small) time interval, but will be automatically
`which resembles a document, while the textual message
`component 44 identi?es the particular document or
`moved from the left-most portion of display path 66 to
`
`40
`
`25
`
`35
`
`IPR2017-01828
`Ubisoft EX1003 Page 16
`
`

`

`20
`
`25
`
`35
`
`5,448,695
`8
`7
`the rightmost portion of display path 66 before it is
`back message 82 is that of a print operation. The opera
`removed from display 14.
`tor may utilize graphical pointing device 100 to select
`FIG. 2b graphically depicts these functions. In this
`print button 76 to initiate the print operation. The oper
`ator’s utilization of graphical pointing device 100 in the
`particular embodiment, action feedback message 54
`region of print button 76 will be utilized to identify the
`includes a non-textual message component 56 and a
`region of the most likely operator focus. Activity feed
`textual message component 58. The non-textual mes
`sage component 56 includes the iconographic represen
`back message 82 is located with respect to display 14,
`window 68, and print button 76 in a predefined manner
`tation 60 of a document, as well as the iconographic
`in accordance with a mapping relationship. As stated
`representation 62 of a printer. Arrow 64 identi?es the
`above, action feedback message 82 will be automati
`control ?ow in a print operation. As was discussed
`cally removed from view in display 14 at the termina
`above, action feedback message 54 is automatically
`tion of a predetermined time interval. As is shown,
`moved for the duration of a preestablished time interval
`from the eft-most portion of window 32 to the right
`action feedback message 82 includes the iconographic
`most portion of window 32. Phantom representations of
`representation 84 of a document (including non-textual
`portion 88 and textual portion 90) as well as the icono
`action feedback message 54 provide a visual representa
`graphic representation 86 of a printer (which also in
`tion of the movement of action feedback message 54
`across workspace 32 in a stop-action format, with the
`cludes non-textual message component 92 as well as
`phantom representations corresponding to the future
`textual message component 94). The words “printing
`on” de?ne the control ?ow relationship between the
`locations of the action feedback messages. In the pres
`document represented by iconographic representation
`ent invention, display path 66 may be de?ned by the
`84 and the printer represented by iconographic repre
`programmer to be con?ned to a single workspace, such
`sentation 86.
`as workspace 32, or to traverse the entire length of
`display 14 of data processing system 10. The restriction
`The basic difference between the embodiment of
`FIGS. 2a and 2b and the embodiment of FIG. 20 is that
`of the movement of action feedback message ,54 to
`workspace 32 may be most appropriate in an exten
`one version includes the automatic movement of the
`sively overlapped windows environment, while travers
`action feedback message, while the other version de
`ing of the entire display 14 may be appropriate when
`?nes a static action feedback message. Both action feed
`back message types are adequate to apprise the operator
`one or only a few workspaces are designated in display
`of the on-going activities of data processing system 10.
`14. As is also shown in FIG. 2, the print operation may
`be depicted by a conventional technique, such as the
`Both provide the opportunity for the operator to sus
`30
`imposition of iconographic representation 40 of a soft
`pend or terminate the requested data processing opera
`ware object upon iconographic representation 34 of a
`tion through use of cancel (or suspension) buttons in a
`printer. A variety of other conventional visual represen
`graphical user interface.
`tations of a data processing operation may be presented
`FIGS. 2a’ and 2e graphically depict the utilization of
`concurrently with the presentation of action feedback
`the operation completion message. As is shown, win
`message 54. Also, in the preferred embodiment of the
`dow 104 de?nes a desk-top type workspace which in
`cludes iconographic representations of an address book
`present invention, action feedback message 54 should be
`provided within the operator’s ?eld of view prior to
`106, a software document 108, a printing device 110, a
`actual initiation of the particular data processing opera
`trash can 112, and out-box 114, and an in-box 116.