`Case 1:13-cv-00919—LPS Document 307-10 Filed 03/10/21 Page 1 of 49 PageID #: 26883
`
`EXHIBIT 29
`
`EXHIBIT 29
`
`
`
`Case 1:13-cv-00919-LPS Document 307-10 Filed 03/10/21 Page 2 of 49 PageID #: 26884
`
`Exhibit C-ll
`
`Claim Chart Applying CyberDesk Against the '843 Patent
`
`It therefore constitutes prior
`CyberDesk was known and/or publicly used in the United States at least by 1997.
`art under at least pre-AlA 35 U.S.C. § 102(a). As shown below, CyberDesk anticipates and/or renders obvious
`claims 1, 8, 13, 15, 17, 18, 19,23, and 30 of the '843 patent, at least as CyberDesk was known, used, and
`described in (1) Dey, Anind et aI., CyberDesk: A Frameworkfor Providing Self-Integrating Ubiquitous
`Software Services, Technical Report, GVU Center, Georgia Institute of Technology, GIT -GVU -97 -10, June
`1997 ("CyberDesk Technical Report"); (2) Dey, Anind et aI., CyberDesk: A Framework for Providing
`Self-Integrating Ubiquitous Software Services, UIST 97, ACM 0-89791-881-9/97110 ("CyberDesk Summary");
`and (3) Wood, Andrew et aI., CyberDesk: Automated Integration of Desktop and Network Services, CHI 97,
`If the Judge or
`Atlanta GA, Mar. 22-27, 1997, ACM 0-89791-802-9/97/03 ("CyberDesk Technical Note").
`Jury finds that CyberDesk does not anticipate a particular claim, then CyberDesk still renders the claim obvious
`for the reasons discussed in Exhibit F.
`
`, 843 Patent Claims
`Claim 1
`A computer-implemented method
`for finding data related to the
`contents of a document using a first
`computer program running on a
`computer, the method comprising:
`
`Disclosure
`
`CyberDesk discloses a computer-implemented method for finding data
`related to the contents of a document using a first computer program
`running on a computer.
`
`See, e.g., CyberDesk Technical Report at 1, col. 1:
`"Current software
`suites suffer from problems due to poor integration of their individual
`tools. They require the designer to think of all possible integrating
`behaviours and leave little flexibility to the user.
`In this paper, we
`discuss CyberDesk, a component software framework that automatically
`integrates desktop and network services, requiring no integrating
`decisions to be made by the tool designers and giving total control to the
`user."
`
`"In response,
`See, e.g., CyberDesk Technical Report at 1, col. 1:
`software companies have been adopting the notion of component
`software: using small software modules as building blocks for a larger
`application. While there are many competing standards (OLE [11],
`Active X [10], Java Beans [6], OpenDoc [1]), the prevailing view is to
`provide a framework which programmers and sophisticated users can
`build upon to create desired application suites."
`
`"In this paper, we
`See, e.g., CyberDesk Technical Report at 1, col. 2:
`present CyberDesk system, a component software framework that
`relieves most of the burden of integrating services from both the designer
`of individual services and the end user, provides greater flexibility to the
`user, and automatically suggests how independent services can be
`integrated in interesting ways."
`
`1
`
`
`
`Case 1:13-cv-00919-LPS Document 307-10 Filed 03/10/21 Page 3 of 49 PageID #: 26885
`
`'843 Patent Claims
`
`Disclosure
`
`Exhibit C-ll
`
`"CyberDesk is a
`See, e.g., CyberDesk Technical Report at 1, col. 2:
`component-based framework written in Java, that supports automatic
`integration of desktop and network services [16]. The framework is
`flexible, and can be easily customized and extended."
`
`See, e.g., CyberDesk Technical Report at 1, col. 2-2, col. 1 (including
`"The user walks to a grocery store, and the system asks if he
`figures):
`wants to see his shopping list, get more information about the grocery
`store, or get directions to his house. The user chooses the grocery list
`and goes shopping. He walks to a friend's house but nobody is home.
`The system asks if he wants to check his friend's calendar, contact him
`via e-mail or phone, or get directions to go home. The user chooses the
`first option and the system tells him that his friend is at work. So, he
`chooses the second option, sends his friend an email saying that he
`stopped by, and starts walking home. On the way home, the system
`notifies him that he has received an e-mail from his friend. The user
`reads the e-mail (see Figure 1 below) which has information on a new
`book written by his favourite author. The e-mail contains a Web site
`address and an e-mail address for the author. The user highlights the
`e-mail address ( a) and the system gives him some suggestions (b) on
`what he can do: search for more information on the author, put the
`author's contact information in the contact manager, call the author, or
`send an e-mail to the author."
`
`"The user
`See, e.g., CyberDesk Summary at 75 (including fig. 1):
`receives an e-mail message (see Figure 1) with the name Andy Wood in
`it. She highlights the name with her mouse (a) and is shown a list of
`suggested actions she can perform (b). This list includes searching for
`the selected text using the AltaVista web search service, looking up a
`phone number for the selected name using the Switchboard web service,
`or looking up the selected name in the desktop contact manager. The
`user chooses the second option and retrieves Andy's phone number and
`mailing address from the web ( c). She wants to update her contact
`information for Andy, so she chooses the last option which loads Andy
`Wood's contact information in the contact manager (d)."
`
`"All of the
`See, e.g., CyberDesk Technical Report at 4, cols. 1-2:
`desktop applets currently being used in CyberDesk (2 e-mail browsers,
`contact manager, 2 calendar managers/schedulers, scratchpad) were
`previously written by other Georgia Tech students."
`
`See, e.g., CyberDesk Technical Report at 5, col. 2-6, col. 1 (including
`fig. 3):
`"The example below is the wrapper for the Contact Manager
`(see Figure 3), and it extends the ContactApplet class (the original
`... Lookup an entry for the name in the
`application class).
`
`2
`
`
`
`Case 1:13-cv-00919-LPS Document 307-10 Filed 03/10/21 Page 4 of 49 PageID #: 26886
`
`'843 Patent Claims
`
`Disclosure
`ContactManager. "
`
`Exhibit C-ll
`
`displaying the document
`electronically using the first
`computer program;
`
`See, e.g., CyberDesk Technical Report at 6, col. 1 (figure 3):
`"Screenshot of contact manager being used with CyberDesk. The user
`selects the string' Andy Wood' in the-mail tool (a). CyberDesk offers
`some suggestions (b): search using AltaVista, look up a phone number
`using Switchboard (c), and look up the name in the contact manager (d)."
`
`"The user
`See, e.g., CyberDesk Summary at 75 (including fig. 1):
`receives an e-mail message (see Figure 1) with the name Andy Wood in
`it. She highlights the name with her mouse (a) and is shown a list of
`suggested actions she can perform (b). This list includes searching for
`the selected text using the AltaVista web search service, looking up a
`phone number for the selected name using the Switchboard web service,
`or looking up the selected name in the desktop contact manager. The
`user chooses the second option and retrieves Andy's phone number and
`mailing address from the web ( c). She wants to update her contact
`information for Andy, so she chooses the last option which loads Andy
`Wood's contact information in the contact manager (d)."
`CyberDesk discloses displaying the document electronically using the
`first computer program.
`
`See, e.g., CyberDesk Technical Report at 1, col. 2-2, col. 1 (including
`"The user walks to a grocery store, and the system asks if he
`figures):
`wants to see his shopping list, get more information about the grocery
`store, or get directions to his house. The user chooses the grocery list
`and goes shopping. He walks to a friend's house but nobody is home.
`The system asks if he wants to check his friend's calendar, contact him
`via e-mail or phone, or get directions to go home. The user chooses the
`first option and the system tells him that his friend is at work. So, he
`chooses the second option, sends his friend an email saying that he
`stopped by, and starts walking home. On the way home, the system
`notifies him that he has received an e-mail from his friend. The user
`reads the e-mail (see Figure 1 below) which has information on a new
`book written by his favourite author. The e-mail contains a Web site
`address and an e-mail address for the author. The user highlights the
`e-mail address ( a) and the system gives him some suggestions (b) on
`what he can do: search for more information on the author, put the
`author's contact information in the contact manager, call the author, or
`send an e-mail to the author."
`
`"The user
`See, e.g., CyberDesk Summary at 75 (including fig. 1):
`receives an e-mail message (see Figure 1) with the name Andy Wood in
`it. She highlights the name with her mouse (a) and is shown a list of
`suggested actions she can perform (b). This list includes searching for
`the selected text using the AltaVista web search service, looking up a
`
`3
`
`
`
`Case 1:13-cv-00919-LPS Document 307-10 Filed 03/10/21 Page 5 of 49 PageID #: 26887
`
`'843 Patent Claims
`
`Exhibit C-ll
`
`Disclosure
`phone number for the selected name using the Switchboard web service,
`or looking up the selected name in the desktop contact manager. The
`user chooses the second option and retrieves Andy's phone number and
`mailing address from the web ( c). She wants to update her contact
`information for Andy, so she chooses the last option which loads Andy
`Wood's contact information in the contact manager (d)."
`
`See, e.g., CyberDesk Technical Note at 552, col. 2-553, col. 1
`(including figs. 1, 2):
`"The user highlights some text in the window of
`one service, and CyberDesk determines the type of the text to suggest
`how the user can invoke behavior in other services using that text. The
`suggestions made by CyberDesk appear as a dynamic button bar in a
`separate 'ActOn' window. For example, at the top left in Figure 1, is an
`e-mail message informing Anind about the great work going on in the
`Future Computing Environments group at Georgia Tech. Anind is
`intrigued and decides to investigate further. Highlight 'Gregory
`Abowd' causes the ActOn button bar to suggest some actions (a). One
`suggestion is to look up the name in an available contact manager (b).
`Anind discovers that he doesn't have Gregory's phone number, so he
`decides to follow another suggestion and initiates a search using the
`Switchboard Web service (c). Figure 2 continues the scenario. After
`speaking with Gregory, Anind wants to visit Georgia Tech, but first he
`will do some research. He selects the first part of the URL given in the
`message, and the ActOn buttons change (d). Anind decides to view the
`URL (e) and use AltaVista to retrieve a list of Web pages that reference
`URL (f)."
`
`See, e.g., CyberDesk Technical Report at 2, cols. 1-2 (including figures):
`"The CyberDesk system has a simple but innovative architecture.
`It is
`based on an event-driven model, where components act as even sources
`and/or event sinks. Events, in this current version, are generated from
`explicit user interaction with the system. The system consists of five
`core components: the Locator, the IntelliButton, the ActOn Button Bar,
`the desktop and network services, and the type converters. The Locator
`maintains the registry of event sources and sinks. This allows the
`IntelliButton to automatically find matches between event sources and
`even sinks based on a given input event, a task normally required of the
`system or service designer. The IntelliButton displays the matches in
`It is
`the form of suggestions to the user, via the ActOn Button Bar.
`through the ActOn Button Bar that the user accesses the integrating
`functionality of CyberDesk. The services are the even sources and
`sinks themselves, and are the tools the user ultimately wants to use.
`The type converters provide more powerful integrating behavior by
`converting given events into other events, allowing for a greater number
`of matches. The five components are discussed in greater detail
`below."
`
`4
`
`
`
`Case 1:13-cv-00919-LPS Document 307-10 Filed 03/10/21 Page 6 of 49 PageID #: 26888
`
`'843 Patent Claims
`
`Disclosure
`
`Exhibit C-ll
`
`while the document is being
`displayed, analyzing, in a computer
`process, first information from the
`document to determine if the first
`information is at least one of a
`plurality of types of information
`that can be searched for in order to
`find second information related to
`the first information;
`
`See, e.g., CyberDesk Technical Report at 6, col. 1 (figure 3):
`"Screenshot of contact manager being used with CyberDesk. The user
`selects the string' Andy Wood' in the-mail tool (a). CyberDesk offers
`some suggestions (b): search using AltaVista, look up a phone number
`using Switchboard (c), and look up the name in the contact manager (d)."
`CyberDesk discloses, while the document is being displayed, analyzing,
`in a computer process, first information from the document to determine
`if the first information is at least one of a plurality of types of
`information that can be searched for in order to find second information
`related to the first information.
`
`See, e.g., CyberDesk Tehnical Note at 553, cols. 1-2:
`"Finally, the
`user's selection, plus any extra type information generated by the
`conversion process, is observed by the ActOn integrating applet and a set
`of potential actions for that data is suggested. For example, a name is
`accepted as input by the Switchboard service, and so ActOn creates a
`button that suggests that integrating behaviour. Clicking on the button
`invokes the Switchboard service, completing the integration without
`requiring any change to the functionality of either service and without an
`programming effort from the user."
`
`"Data typing is used
`See, e.g., CyberDesk Technical Report at 4, col. 2:
`extensively in the interface declarations of the event sources and sinks
`that applications provide. The property field that corresponds to each
`interface declares the datatype/event that a component is interested in or
`can provide. The CyberDesk system takes advantage of the Java type
`system to do the data typing."
`
`"Initially, we
`See, e.g., CyberDesk Technical Report at 4, col. 2:
`hardcoded applications to generate events for different data types. For
`example, the e-mail browser declares that it can generate String selection
`events when text is highlighted, but also EmailAddress selection events
`when the 'To:' or 'From:' field in an e-mail message is selected. When
`EmailAddress selection events were generated, they were passed through
`the CYberDesk system, as described before, to the ActOn Button Bar,
`which displayed services that could consume EmailAddress selection
`events (e.g., Send an E-mail to this E-mail Address using
`Netscape).
`... Consequently, we chose to use type converters.
`U sing simple heuristics, it is possible to identify potential text strings
`that might be e-mail addresses.
`It would have been desirable to
`augment our e-mail browser with this capability, so that any time text
`was selected in it, it would try to convert the text to an EmailAddress
`object and create an EmailAddress selection event rather than just a
`String selection event. But, rather than just giving this type conversion
`capability to the e-mail browser, we wanted to add that ability to the
`
`5
`
`
`
`Case 1:13-cv-00919-LPS Document 307-10 Filed 03/10/21 Page 7 of 49 PageID #: 26889
`
`'843 Patent Claims
`
`Exhibit C-ll
`
`Disclosure
`system once, and all it to be used in every application where e-mail
`addresses might appear. We took the type detection ability out of the
`individual applications and created type converters, an independent and
`extensible layer in the architecture."
`
`"So, when any
`See, e.g., CyberDesk Technical Report at 5, col. 1:
`component generates a String selection even, the StringToEmailAddress
`converter (and any other observers) are notified, and the converter
`attempts to conver the given String object to an EmailAddress object
`(while other converters attempt to convert the object to another
`CyberDesk type).
`In the above scenario, this conversion was done
`when the user selected the e-mail address. The system initially saw the
`selected data as a String but with this converter, it also saw it as an
`EmailAddress.This results in two related data selection events to arrive
`at the IntelliButton: one containing a string and one containing an
`EmailAddress. The IntelliButton will therefore seek integrating
`behaviour for both these types, allowing the user to access
`EmailAddress-relevant services where originally they wouldn't have had
`the option."
`
`"Currently the list
`See, e.g., CyberDesk Technical Report at 5, col. 1:
`of CyberDesk types include: Date PhoneNumber, Mailing Address,
`Name, URL, and EmailAddress.
`If any of the conversions can be made,
`then the converter generates a second, but related, selection event
`containing the newly typed data and sends it to observing entities."
`
`"The CyberDesk
`See, e.g., CyberDesk Technical Report at 5, cols. 1-2:
`framework was designed to be easily extensible. Simple extensions to
`CyberDesk include adding additional types, type converters, desktop
`services and network services. The real advantages with CyberDesk
`can be seen with more complex extensions that include adapting the
`behaviour of CyberDesk to individual use and creating more interesting
`integrating behaviour."
`
`"An example
`See, e.g., CyberDesk Technical Report at 5, col. 2:
`converter is the StringToEmailAddress converter, which is a subclass of
`the ConversionApplet class. The code for this component and all
`components described in the paper can be viewed at
`http://www.cc.gatech.edu/fce/cyberdeskisamples.This converter looks
`at traditional ways of writing an e-mail address, and tries to map selected
`data to one of these ways.
`If it is successful, it returns an EmailAddress
`object. The ConversionApplet object is responsible for handling the
`ties to the CyberDesk framework."
`
`See, e.g., CyberDesk Technical Report at 6, col. 1 (figure 3):
`"Screenshot of contact manager being used with CyberDesk. The user
`
`6
`
`
`
`Case 1:13-cv-00919-LPS Document 307-10 Filed 03/10/21 Page 8 of 49 PageID #: 26890
`
`'843 Patent Claims
`
`Exhibit C-ll
`
`Disclosure
`selects the string' Andy Wood' in the-mail tool (a). CyberDesk offers
`some suggestions (b): search using AltaVista, look up a phone number
`using Switchboard (c), and look up the name in the contact manager (d)."
`
`"The next task
`See, e.g., CyberDesk Technical Report at 7, cols. 1-2:
`involved adding the services that recognized the appropriate types and
`created 'ActOn' buttons for them. We added two services
`(NewtonNames and NewtonNotes) which, respectively, request contact
`information from the Newton about the selected name and request notes
`from the Newton containing the selected text in the body or title.
`Adding these services was quite simple (see Figure 4), requiring only the
`implementation of the ServiceApplet methods described above."
`
`See, e.g., CyberDesk Technical Note at 553, col. 1 (including fig. 3):
`"When the user selects information displayed by one service, say some
`text from the e-mail message, the type converters try recursively to see if
`the data can be converted to other types used in the system (e.g., a name
`In the case of plain text, this could be done by comparing
`in Figure 3).
`the string to common formats for representing the various types; for
`names you might use title firstname lastname, and similar patterns can be
`used for dates, URLs, e-mail and mailing addresses."
`
`"CyberDesk
`See, e.g., CyberDesk Technical Report at 8, cols. 1-2:
`contains some simple notions of context.
`It knows the application a
`user is working with and the data (both type and content) the user is
`interested in (via explicit selection with the mouse). But CyberDesk
`has shown the potential for supporting higher level context. For
`example, if an e-mail message contains information about a meeting, and
`the user selects the message content, a type converter could potentially
`convert the text to a Meeting object to be inserted in the user's Calendar
`Manager. Of course, retrieving context from arbitrary text is a very
`difficult problem being investigated by the AI learning community. But
`the power of CyberDesk supports the ability to use this higher level
`context, if available."
`
`"Related Work.
`See, e.g., CyberDesk Technical Report at 9, col. 2:
`Pandit and Kalbags Selection Recognition Agent [12] attempts to address
`the same issues as CyberDesk. Unlike CyberDesk, it uses a fixed
`datatype-action pair, allowing for only one possible action for each
`datatype recognized.
`... Apple Data Detectors [2] is another
`component architecture that supports automatic integration of tools.
`It
`works at the operating system level, using the selection mechanism that
`most Apple applications support.
`It allows the selection of a large area
`of text and recognizes all user-registered dtatypes in that selection.
`Users view suggested actions by pressing a modifier key and the mouse
`button. Like CyberDesk, it supports an arbitrary number of actions for
`
`7
`
`
`
`Case 1:13-cv-00919-LPS Document 307-10 Filed 03/10/21 Page 9 of 49 PageID #: 26891
`
`Exhibit C-ll
`
`'843 Patent Claims
`
`retrieving the first information;
`
`Disclosure
`each datatype."
`CyberDesk discloses retrieving the first information.
`
`See, e.g., CyberDesk Summary at 75 (including fig. 1):
`"The user
`receives an e-mail message (see Figure 1) with the name Andy Wood in
`it. She highlights the name with her mouse (a) and is shown a list of
`suggested actions she can perform (b). This list includes searching for
`the selected text using the AltaVista web search service, looking up a
`phone number for the selected name using the Switchboard web service,
`or looking up the selected name in the desktop contact manager. The
`user chooses the second option and retrieves Andy's phone number and
`mailing address from the web ( c). She wants to update her contact
`information for Andy, so she chooses the last option which loads Andy
`Wood's contact information in the contact manager (d)."
`
`See, e.g., CyberDesk Technical Note at 552, col. 2-553, col. 1
`(including figs. 1, 2):
`"The user highlights some text in the window of
`one service, and CyberDesk determines the type of the text to suggest
`how the user can invoke behavior in other services using that text. The
`suggestions made by CyberDesk appear as a dynamic button bar in a
`separate 'ActOn' window. For example, at the top left in Figure 1, is an
`e-mail message informing Anind about the great work going on in the
`Future Computing Environments group at Georgia Tech. Anind is
`intrigued and decides to investigate further. Highlight 'Gregory
`Abowd' causes the ActOn button bar to suggest some actions (a). One
`suggestion is to look up the name in an available contact manager (b).
`Anind discovers that he doesn't have Gregory's phone number, so he
`decides to follow another suggestion and initiates a search using the
`Switchboard Web service (c). Figure 2 continues the scenario. After
`speaking with Gregory, Anind wants to visit Georgia Tech, but first he
`will do some research. He selects the first part of the URL given in the
`message, and the ActOn buttons change (d). Anind decides to view the
`URL (e) and use AltaVista to retrieve a list of Web pages that reference
`URL (f)."
`
`"The previous three
`See, e.g., CyberDesk Technical Report at 3, col. 2:
`components discussed provide the core functionality of CyberDesk.
`Regardless of what tools the user wants to use, these three components
`are required. The fourth type of component, desktop and network
`services, are the actual services the user wants to access. Desktop
`services include e-mail browsers, contact managers, and schedulers.
`Network services include web search engines, telephone directories, and
`... One of the services available in CyberDesk is
`map retrieval tools.
`a gateway to the AltaVista search engine available on the web."
`
`See, e.g., CyberDesk Technical Report at 4, col. 1:
`
`"The wrapper must
`
`8
`
`
`
`Case 1:13-cv-00919-LPS Document 307-10 Filed 03/10/21 Page 10 of 49 PageID #: 26892
`
`'843 Patent Claims
`
`providing an input device,
`configured by the first computer
`program, that allows a user to enter
`a user command to initiate an
`operation, the operation comprising
`(i) performing a search using at
`least part of the first information as
`a search term in order to find the
`second information, of a specific
`type or types, associated with the
`search term in an information
`source external to the document,
`wherein the specific type or types
`of second information is dependent
`at least in part on the type or types
`of the first information, and (ii)
`performing an action using at least
`part of the second information;
`
`Exhibit C-ll
`
`Disclosure
`have 'hooks' into the original application code to intercept and broadcast
`the appropriate data selection events (for the 'select' interfaces), and to
`execute a service on data passed to it (for the 'method' interfaces). At
`the time of developments, there were three ways to approach this
`problem for the 'select' interface. First, we could modify the original
`application's event processing loop to broadcast events in the CyberDesk
`fashion. Second, we could modify the original application code to
`make calls to a notification routine in the wrapper when data is selected.
`Third, we could rely on the original application have a suitable API for
`retrieving those events."
`
`See, e.g., CyberDesk Technical Report at 7, col. 1 (including fig. 4):
`"There were two reasons for integrating CyberDesk with LlamaShare.
`First, we wanted to illustrate the platform-neutrality and
`language-neutrality of the LlamaServer, which CyberDesk allows us to
`do. More importantly, however, CyberDesk's vision of ubiquitous
`information access was the deciding factor. While LlamaShare
`provides a concrete, visible object to represent the data on a mobile
`device, CyberDesk takes the approach that information is distributed
`throughout a rather nebulous information space (consisting of Internet,
`desktop, and mobile data) that can be retrieved at any moment depending
`on the context in which the user is currently working. This new
`metaphor of seamless integration between mobile data and Internet
`(remote) data was too good to pass up."
`CyberDesk discloses providing an input device, configured by the first
`computer program, that allows a user to enter a user command to initiate
`an operation, the operation comprising (i) performing a search using at
`least part of the first information as a search term in order to find the
`second information, of a specific type or types, associated with the
`search term in an information source external to the document, wherein
`the specific type or types of second information is dependent at least in
`part on the type or types of the first information, and (ii) performing an
`action using at least part of the second information.
`
`"The components in
`See, e.g., CyberDesk Technical Report at 1, col. 2:
`CyberDesk treat all data uniformly, regardless of whether the data came
`from a locally running application or from a service running on the
`World Wide Web (WWW). The services and applications themselves
`can be running anywhere, meeting CyberDesk's goal of providing
`ubiquitous access to services."
`
`See, e.g., CyberDesk Technical Note at 552, col. 2-553, col. 1
`(including figs. 1, 2):
`"The user highlights some text in the window of
`one service, and CyberDesk determines the tpe of the text to suggest how
`the user can invoke behavior in other services using that text. The
`suggestions made by CyberDesk appear as a dynamic button bar in a
`
`9
`
`
`
`Case 1:13-cv-00919-LPS Document 307-10 Filed 03/10/21 Page 11 of 49 PageID #: 26893
`
`'843 Patent Claims
`
`Exhibit C-ll
`
`Disclosure
`separate 'ActOn' window. For example, at the top left in Figure 1, is an
`e-mail message informing Anind about the great work going on in the
`Future Computing Environments group at Georgia Tech. Anind is
`intrigued and decides to investigate further. Highlight 'Gregory
`Abowd' causes the ActOn button bar to suggest some actions (a). One
`suggestion is to look up the name in an available contact manager (b).
`Anind discovers that he doesn't have Gregory's phone number, so he
`decides to follow another suggestion and initiates a search using the
`Switchboard Web service (c). Figure 2 continues the scenario. After
`speaking with Gregory, Anind wants to visit Georgia Tech, but first he
`will do some research. He selects the first part of the URL given in the
`message, and the ActOn buttons change (d). Anind decides to view the
`URL (e) and use AltaVista to retrieve a list of Web pages that reference
`URL (f)."
`
`See, e.g., CyberDesk Technical Report at 2, cols. 1-2 (including figures):
`"The CyberDesk system has a simple but innovative architecture.
`It is
`based on an event-driven model, where components act as even sources
`and/or event sinks. Events, in this current version, are generated from
`explicit user interaction with the system. The system consists of five
`core components: the Locator, the IntelliButton, the ActOn Button Bar,
`the desktop and network services, and the type converters. The Locator
`maintains the registry of event sources and sinks. This allows the
`IntelliButton to automatically find matches between event sources and
`even sinks based on a given input event, a task normally required of the
`system or service designer. The IntelliButton displays the matches in
`It is
`the form of suggestions to the user, via the ActOn Button Bar.
`through the ActOn Button Bar that the user accesses the integrating
`functionality of CyberDesk. The services are the even sources and
`sinks themselves, and are the tools the user ultimately wants to use.
`The type converters provide more powerful integrating behavior by
`converting given events into other events, allowing for a greater number
`of matches. The five components are discussed in greater detail
`below."
`
`"The
`See, e.g., CyberDesk Technical Report at 3, cols. 1-2:
`IntelliButton component is really the core of the CyberDesk system, as it
`... So when a
`provides the automatic integrating behaviour.
`component generates an event, it notifies the IntelliButton and any other
`... It uses simple type
`components that have expressed interest.
`checking to identify potential services that the user may wish to call upon
`to operate on the data associated with the event. The matches are
`displayed to the user via the ActOn Button Bar, from which the user can
`If the user does
`select any or none of the integrating services suggested.
`choose one of the integrating services, the IntelliButton is notified and it
`access the correct service passing the associated data and event as
`
`10
`
`
`
`Case 1:13-cv-00919-LPS Document 307-10 Filed 03/10/21 Page 12 of 49 PageID #: 26894
`
`'843 Patent Claims
`
`Exhibit C-ll
`
`Disclosure
`In the above scenario, when the user highlighted the e-mail
`parameters.
`address, the IntelliButton used that even information to determine what
`services were available (send an e-mail, save the contact information,
`etc.) and suggested them."
`
`"Finally, the
`See, e.g., CyberDesk Tehnical Note at 553, cols. 1-2:
`user's selection, plus any extra type information generated by the
`conversion process, is observed by the ActOn integrating applet and a set
`of potential actions for that data is suggested. For example, a name is
`accepted as input by the Switchboard service, and so ActOn creates a
`button that suggests that integrating behaviour. Clicking on the button
`invokes the Switchboard service, completing the integration without
`requiring any change to the functionality of either service and without an
`programming effort from the user."
`
`"The ActOn Button
`See, e.g., CyberDesk Technical Report at 3, col. 2:
`Bar, as described before, is simply the user interface for the integrating
`IntelliButton. We chose to keep the interface separate from the actual
`integrating functionality to all easier experimentation with alternative
`interfaces. Currently, the interface is very simplistic.
`It is a
`dynamically generated list of buttons, where each button co