I IIIII IIIIIIII II llllll lllll lllll lllll lllll lllll lllll lllll lllll lllll lllll 111111111111111111
`US 20020186257Al
`
`(19) United States
`(12) Patent Application Publication
`Cadiz et al.
`
`(10) Pub. No.: US 2002/0186257 Al
`Dec. 12, 2002
`( 43) Pub. Date:
`
`(54) SYSTEM AND PROCESS FOR PROVIDING
`DYNAMIC COMMUNICATION ACCESS AND
`INFORMATION AWARENESS IN AN
`INTERACTIVE PERIPHERAL DISPLAY
`
`(76)
`
`Inventors: Jonathan J. Cadiz, Redmond, WA
`(US); Anoop Gupta, Woodinville, WA
`(US); Gavin Jancke, Kirkland, WA
`(US); Gina Venolia, Redmond, WA
`(US)
`
`Correspondence Address:
`LYON & HARR, LLP
`300 ESPLANADE DRIVE, SUITE 800
`OXNARD, CA 93036 (US)
`
`(21) Appl. No.:
`
`10/063,296
`
`(22) Filed:
`
`Jun.8,2001
`
`Publication Classification
`
`(51)
`
`Int. CI.7 ....................................................... G09G 5/00
`
`(52) U.S. Cl. .............................................................. 345/838
`
`(57)
`
`ABSTRACT
`
`The system and method of the present invention provides
`peripheral awareness of information to a user. The informa(cid:173)
`tion to be provided is either determined automatically, or
`specified by the user. Once the information to be provided is
`determined or specified, it is automatically tracked or
`watched via at least one conventional communications inter(cid:173)
`face for accessing one or more conventional communica(cid:173)
`tions sources. Current information is then automatically
`dynamically provided in an interactive peripheral display
`which minimizes any potential distraction to the user. Deter(cid:173)
`mining or specifying, tracking or watching, and providing
`the information is accomplished using at least one customi(cid:173)
`zable dynamic encapsulated object, a "ticket," that when
`paired with a "viewer," provides peripheral awareness of
`information to the user. Further, in one embodiment, the
`tickets are sharable among users, and may be copied, cut,
`pasted, saved, transmitted, dragged and dropped from web
`pages, etc., like any other electronic file using conventional
`techniques.
`
`--------~----------------------~--,
`
`I
`I
`
`330
`
`INFORMATION
`AND
`COMMUNICATION
`MODULE
`
`320
`
`TICKET
`MANAGER
`MODULE
`
`310
`
`USER INTERFACE
`MODULE
`
`I •
`,----"1---,
`
`350
`
`:
`:
`I
`I
`_J
`I
`I ALERT
`I
`: MODULE :
`I
`I
`
`~------·
`
`250
`
`CONTAINER(S)
`
`260
`
`DISPLAY
`DEVICE
`
`Page 1 of 40
`
`GOOGLE EXHIBIT 1005
`
`

`

`Patent Application Publication Dec. 12, 2002 Sheet 1 of 14
`
`US 2002/0186257 Al
`
`REMOVABLE STORAGE
`
`r - - - - - - - - - - - - - ,
`I
`I
`I
`
`MEMORY
`
`[VOLATILE J
`
`~
`
`NON-
`VOLATILE
`
`PROCESSING
`UNIT(S)
`
`NON-REMOVABLE
`STORAGE
`
`OUTPUT DEVICE(S)
`
`INPUT DEVICE(S)
`
`110
`
`114
`
`:
`
`I
`1
`I
`I
`I
`I
`I
`I
`
`106
`
`102
`
`112
`
`FIG. 1
`
`Page 2 of 40
`
`

`

`Patent Application Publication Dec. 12, 2002 Sheet 2 of 14
`
`US 2002/0186257 Al
`
`240
`
`INFORMATION SOURCE(S}
`
`,(cid:173)
`• I
`
`I
`I
`I
`:
`
`230
`
`SERVICE(S)
`
`•
`~--... --~----------
`
`200
`
`ITEMS
`
`220
`
`VIEWER(S)
`
`TICKET(S)
`
`250
`
`CONTAINER(S)
`
`270
`
`DISPLAY DEVICE
`
`FIG. 2
`
`Page 3 of 40
`
`

`

`Patent Application Publication Dec. 12, 2002 Sheet 3 of 14
`
`US 2002/0186257 Al
`
`--~--------------------~---~------, I
`
`I
`
`320
`
`TICKET
`MANAGER
`MODULE
`
`310
`
`USER INTERFACE
`MODULE
`
`I
`I
`
`,---"'1---.
`l
`
`350
`
`I
`I
`I
`
`330
`
`INFORMATION
`AND
`COMMUNICATION
`MODULE
`
`:
`I
`-.J
`I ALERT
`: MODULE l
`1..------~
`
`I
`
`I
`
`260
`
`DISPLAY
`DEVICE
`
`250
`
`CONT AINER(S)
`
`FIG. 3
`
`Page 4 of 40
`
`

`

`Patent Application Publication Dec. 12, 2002 Sheet 4 of 14
`
`US 2002/0186257 Al
`
`-----....
`
`415
`
`.----------------------·
`.,:::.----.. <'l
`a-..,
`'I I
`RETRIEVE TICKET(S)
`l--410
`:
`I
`.. ___ ... 11
`I
`USER
`: t-: - - • ... ,
`FROM USER PROFILE
`I
`I
`I
`I.
`PROFILE •~
`.. ---------- ----------~
`•
`•
`...... ____ ,
`
`00
`
`405
`
`.. --L----.
`-+: TICKET
`.. --------~
`i-s'i"o°ifE,-.
`-+: COPY/EDIT I
`---~----'
`
`420
`
`I
`
`SHARE
`
`:
`
`TICKET
`
`425
`
`I
`I
`
`I
`
`: STORE TICKET IN ;.__
`
`430 ·--~- ------
`a USER PROFILE r
`~------------(cid:173)
`,-------------,
`I DRAG AND DROP I
`t-
`:
`LINK, FILE
`i CONTACT, ETC.
`-----7-------
`
`t
`
`435
`
`440
`
`450
`
`~---·-----
`
`: DRAG AND :..
`
`470
`
`t':!:<:.':.~l~~_:~J
`'-..
`r---rJANA_G_E-ITEMS---~
`I
`
`(AGGREGATE, NEST) r-
`L---------------·'
`
`SPECIFY INFORMATION OF
`INTEREST AUTOMATICALLY
`OR VIA USER INTERFACE
`
`SELECT OR CREATE
`TICKET(S),
`INCLUDE POINTER TO
`APPROPRIATE VIEWER
`
`RETRIEVE INFORMATION AND
`CONTACT DATA FROM
`INFORMATION SOURCE(S}
`VIA SERVICE(S)
`
`UPDATE AND DISPLAY
`ITEMS IN CONTAINERS
`VIA
`PERIPHERAL AWARENESS
`INTERFACE
`
`,-----------------
`: MANAGE CONTAINERS ~-
`(MOVE, LINK, ETC.)
`1
`1
`
`L-;~:_::;r--------'
`
`445
`
`465
`
`:
`: AGE
`- , DISPLAY :
`-----~460
`
`r-----C-
`I
`J TIMED
`- t~l:~=~~J
`r------1/ 455
`-~ ALERTS r
`L------J
`r·------
`,---------.
`
`I
`
`I COMMS
`
`I
`
`, __________ i __ L~:~--.
`
`: PROVIDE COMMS ;..+: PERSON CENTRIC INTERFACE ~-+I HISTORY/ :
`"'----7------
`
`I
`
`PROVIDE
`
`•·------------,
`
`I ACCESS/STATUS I
`
`485
`
`FOR CONTACTITEMS
`
`1
`I
`I
`I
`' - - - - - - - - - - - - - - - - - - - - - - •
`
`FIG. 4A
`
`1 PATTERNS/ I
`I
`I
`1 AVERAGES I
`'"---~----..
`'490
`
`Page 5 of 40
`
`

`

`Patent Application Publication Dec. 12, 2002 Sheet 5 of 14
`
`US 2002/0186257 Al
`
`495
`
`FIG. 48
`
`Page 6 of 40
`
`

`

`Patent Application Publication Dec. 12, 2002 Sheet 6 of 14
`
`US 2002/0186257 Al
`
`260
`
`, - - - - - - - - - . I
`I
`I
`I
`I
`I
`I
`
`:
`I
`
`: : 520
`I
`I
`
`CONTAINER
`
`I
`I
`
`ITTO
`I COMMUNICATION I
`
`I
`I
`I
`
`I
`
`I
`
`I
`I
`I
`
`I
`
`I
`
`I
`
`I
`
`I
`I
`I
`
`.--------..
`-----------~
`t
`I
`, - - - - , I
`I
`i ITEM 11'
`v1
`I
`I
`/i i ITEM I
`:
`I L----· I
`525
`I
`I
`I
`I
`: r----, I
`!+-
`&..--------• I
`I
`I ITEM
`I
`I L----' :
`I
`I
`--;1~-_::;,---·
`/1 NESTED I
`· ~-------J
`530
`: SIDEBAR
`---------.
`____ ,e:_______
`L~ss~~~~f>l.N_TJ~>.i*-:
`:
`I COMMUNICATION :+-..: PERSON :+-
`- - - - - - - - - -~ - - -
`~L ___ ljl~J9~;! ___ .J
`: WINDOW
`I COMMUNICATION :+->t
`580 --------------
`I
`L_!.Yt~~11~--.! L-_:;r---J
`575__./
`565
`,_.t:::_5:~-.
`, ___ .c:.5:~
`I ENHANCED :+-
`: TOOL TIPS t+->; TOOL TIPS !+
`~-------J ~-------J
`,--------------------~
`i+-
`: CUT, PASTE, DELETE, NEW 4
`L--7-------------.----•
`~ ,-------------
`:+-
`/-I
`CONTEXT
`/
`i SENSITIVE MENU ~
`550
`-------------·
`..,.-,f--TICKET-1
`: MANAGER ~
`/
`540
`---------'
`---------,
`/ i TICKET
`!+
`535
`~-------J
`I
`I WIZARD
`
`I NESTED
`
`I
`
`I DRAG AND DROP, COPY,
`
`545
`
`585 --.........
`P------..1..--~
`:
`:
`I
`I
`: PERSISTENT
`:
`TOOL TIP
`I
`t
`:
`:
`I
`I
`
`.. __________ ,,
`
`DISPLAY DEVICE
`
`FIG. 5
`
`ITEM
`
`i-1~;;-iE]
`~ GROUP :
`I
`I
`
`EJEJ
`~------a----.
`EJ ITEM
`G'--~
`EJEJ
`G ITEM E] __ __
`-------E]
`r------
`TIMED I
`ITEM
`:
`I
`L-----•
`
`SIDEBAR
`
`515
`
`505
`
`Page 7 of 40
`
`

`

`Patent Application Publication Dec. 12, 2002 Sheet 7 of 14
`
`US 2002/0186257 Al
`
`CD
`(!)
`
`(9
`LL
`
`<(
`CD
`
`(9
`LL
`
`Page 8 of 40
`
`

`

`Patent Application Publication Dec. 12, 2002 Sheet 8 of 14
`
`US 2002/0186257 Al
`
`FIG. 6C
`
`Page 9 of 40
`
`

`

`as reported a: Centlal Pal<, NY.
`Last updated Th~rsday, dofojer 12. at
`11:55 AM Eas1eiri Sfandar~ Time
`(12:65 PM EDT)
`
`Fair
`Temp: 65°.F
`Wind: From tte West
`at 7 mph
`Dewpoint: 41°F
`Rel. Humidity: 42%
`Visibility: unlimited
`Barometer: 30.24 inches
`and rishg
`·
`Sunrise: 7:04 am
`Sunset: 6:18 pm
`
`700
`
`FIG. 7A
`
`FIG. 78
`
`""C
`~ ......
`~ = ......
`t "Cl -....
`.... 0 =
`
`I")
`
`~ ......
`
`~
`O' =-:
`~ ......
`
`I")
`
`.... 0 =
`
`~
`~
`~
`"""" ~N
`N c c
`
`N
`
`'JJ. =-~
`~ ......
`\C
`0 ......,
`""""
`
`,i;;..
`
`d
`'JJ.
`N c c
`~ c
`"""" 00
`O'I
`N
`Ul
`-..J
`
`>
`""""
`
`Page 10 of 40
`
`

`

`845
`
`Gm.in
`ls eunanUy
`awilablt
`
`4llm
`Pmbly nct w.iilablt1 2m 46s
`Probtbly &Vailable
`Sm
`30
`P9t~!v <IViUliblt
`1 Zro
`Pr<1bably available
`
`825
`
`FIG. 88
`
`'-..._940
`
`~fioi> Oo 1/r:A; ha>te a C®Y ct' the U!Si '~$ pl'l:)Ceedings lb.at l can
`borrow?
`~;,,i.YQ~-I IOlft iton mv ~h.:rir l.orvou.
`:Jm..i. Usabtlfty Lab 1>1:.0n1~\;1/~;~~)
`~"""' 2 Mh, 43 Ssc.
`@¢1·$11> f'W: Ptrvastvec <:vmputlng ZOOO Co11tere1u;ec
`§Ill M> 52 Sec.
`..
`
`~,A,Proj,!ct Mii(J,;ntil 8r<1iml1Jirrino (31122$2)
`
`FIG. BA
`
`FIG. 8C
`
`I")
`
`~ ......
`
`""C
`~ ......
`~ = ......
`~ "Cl -....
`.... 0 =
`~
`O' -....
`.... 0 =
`
`I")
`
`~ ......
`
`~
`~
`ri
`"""" ~N
`N
`8 N
`'JJ. =(cid:173)~
`~ ......
`"""" c
`0 ......,
`""""
`,i;;..
`
`d
`'JJ.
`N c c
`~ c
`"""" 00
`O'I
`N
`Ul
`-..J
`
`>
`""""
`
`Page 11 of 40
`
`

`

`""C
`~
`
`~ = ......
`t "Cl -....
`.... 0 =
`
`Wed 4/1/2001 5 PLSTT94S7007“ZL99uONRONQngUONeIyddyjuD}eg
`
`900
`900
`:
`
`
`
`Tuesday, April 24, 2C0'
`
` oO 910
`
`41000
`
`fea Ravin lannke
`FF- showing status
`Anpop Gupta
`RE: Media Player Tickets
`E43 Ken Smith (PREMI... RE: Sideshow update 3/30/01
`ed Hanna | pellay
`Uutiank Fabtes Viaw hugs
`lished suggestion
`4 Paul Sereiztt (NET)
`ey Etc Kratzer
`Siceshow Bg Regoit
`Adam Berkelhamner
`Friend ames ‘or Weather
`
`‘icksts
`
`Sun 4/22/2001 6:03
`Thu 4/19/2001 6:18
`Wad asTHs7ilitt Tih
`Ved 4/1€/2C01 5.36 Pld
`Ved 471€/2001 3:32 PH’
`
`1020
`
`FIG.10
`
`920
`920
`
`
`
`
`
`I")
`
`~ ......
`
`~
`O' =-:
`~ ......
`
`I")
`
`.... 0 =
`
`~
`~
`~
`"""" ~N
`N
`8 N
`
`'JJ.
`;'
`~ ......
`""""
`"""" 0 ......,
`""""
`
`,i;;..
`
`Tomorrow 's appointments Wednesday, Apuil 25, 2001
`PAi200AM veify ren! arc car payments have bsen mads
`
`AU -M Siceshow “Sidebar
`Jerre
`FIG. 9
`FIG. 9
`
`Page 12 of 40
`
`d
`'JJ.
`N c c
`~ c
`"""" 00
`O'I
`N
`Ul
`-..J
`
`TVLS79810/c2007SA
`
`>
`""""
`
`Page 12 of 40
`
`

`

`Patent Application Publication Dec. 12, 2002 Sheet 12 of 14
`
`US 2002/0186257 Al
`
`FIG. 11A
`
`FIG.118
`
`Page 13 of 40
`
`

`

`1210
`
`1200
`
`High bid
`Payment
`
`Shipping
`
`Cunently
`Qumtity
`Time left
`
`··-· --,.
`
`4 ltom·s. 39.1nn1s +
`
`Started
`E:lds
`
`Sep-12-0018:47:06PDT
`Sep-19-0018:47:06 PDT
`
`4 bid history I with emails
`Smi1t Louis, MO
`Location
`CoWltiy/Region USAiSt. · Louis
`(:21 maiHhi.s auction to a me net
`
`~ Bid! -,.
`B
`ticket
`. Watch thi
`;~
`item
`'th s
`__EL
`e-mail
`Seller assumes. rut responsibility for listing this item. You should contact the seller to resolve any questions
`
`Sellet(Ratingi duis mc69@11otinail.rom (Ql
`yjew C0t11fllents ii) sellers Feedb§~k Profile\ view sellet's otherauctjons I ~·k seller a question
`1navo@
`VisalMastezCard, Money
`Order/Cashiers Checks, COD (collect
`ondeliveiy)
`Buyer pays fu<ed shipping charges,
`Will ship to Unitec!States only
`
`Onlliu: Payments
`
`ill"i••
`
`Get $1 ofil detills
`
`Update item
`
`Seller: If this itemhe.s received no bids, youmay~it.
`
`FIG. 12
`
`I")
`
`""C
`~
`~ = ......
`> "Cl
`"Cl -....
`~ .... 0 =
`§. -....
`~ .... 0 =
`
`""C
`
`I")
`
`~
`
`~
`~
`ri
`"""" N
`N
`8 N
`rF.J. =(cid:173)~
`
`~
`"""" ~
`0 ......,
`""""
`,i;;..
`
`d
`rF.J.
`N c c
`N c
`"""" 00
`O'I
`N
`Ul
`-..J
`
`>
`""""
`
`Page 14 of 40
`
`

`

`""C
`~
`~ = ......
`> "Cl
`"Cl -....
`~ .... 0 =
`§. -....
`~ .... 0 =
`
`""C
`
`I")
`
`I")
`
`Thank. ycu orded Your credit card ha:, beer. verified and you1:
`order has been 1:.orwarded -::.o
`.our "factory;
`'lour order ia in t:'le
`process of being buil.t. You can fol'J.ow the statua of your 01:der
`using tl:e information below.
`
`Thank,ycu again for choo:;i.i.ng Home Systems!
`
`1300
`
`i.Jrder J.ntormation
`
`For or.der Status, pl.ease <::lick below to vist our .Website:
`http:./ /&\.\pport, com/i.:ui/ en/ ,;,rd.stat/ single, asp'<' order n\.Ul\loe.-;
`440876431& val.id a te=4 740546&:ecs
`()rnl'!Y' Ni:rrihl'!T! 440A7fi4'.'11
`Customer Number: 4740546
`
`1310
`
`r-1
`
`,'x'ou may al::so use the Ticket Joel.ow to keep track of your
`order.
`• a
`_.;I
`Order
`Status.ssh
`or,~""~£! -~~C: .. ,Z!;:!;~7,=K==~t!:'.P,:~~,"''~!th~~" .one to two weeks 01: befog
`FIG. 13
`
`~
`
`~
`~
`ri
`"'"" N
`N
`8 N
`'J'J. =(cid:173)~
`~
`"'""
`,i;;..
`0 ......,
`"'""
`,i;;..
`
`d
`'J'J.
`N c c
`N c
`"'"" 00
`O'I
`N
`Ul
`-..J
`
`>
`"'""
`
`Page 15 of 40
`
`

`

`US 2002/0186257 Al
`
`Dec. 12, 2002
`
`1
`
`SYSTEM AND PROCESS FOR PROVIDING
`DYNAMIC COMMUNICATION ACCESS AND
`INFORMATION AWARENESS IN AN
`INTERACTIVE PERIPHERAL DISPLAY
`
`BACKGROUND OF INVENTION
`
`[0001] 1. Technical Field
`
`[0002] The present invention involves a new system and
`process for providing dynamic communication access and
`information awareness in an interactive peripheral display.
`
`[0003] 2. Related Art
`
`[0004] By way of background, m today's information
`saturated environments, such as the Internet, a local or
`remote computer network, or any combination of the Inter(cid:173)
`net and such networks, it is often difficult for a user to keep
`track of the potentially large amounts and variety of com(cid:173)
`munications and information which the user may be inter(cid:173)
`ested in. Such communications and information include, for
`example, email, instant messaging, file transfers, local
`weather, appointments, schedules, personal contacts, statis(cid:173)
`tical information, file status, stock quotes, sports scores,
`local traffic, or any other type of communications or infor(cid:173)
`mation that may be of interest to the user. This problem
`becomes particularly acute where the communications and/
`or information are dynamic, such that rapid, numerous, or
`large changes to the communications status or channels, or
`in the information of interest to the user results in out of date
`communications and/or information that is often relatively
`useless to a user.
`
`In response to this problem, several conventional
`[0005]
`schemes have been developed to assist users in attempting to
`keep track of specific communications or information with(cid:173)
`out requiring a user to manually search out or manually
`check for updates to the communications or information
`each time the user wants to examine the communications or
`information. However, such schemes are typically limited
`by what types of communications or information can be
`tracked or displayed, by the manner in which the commu(cid:173)
`nications or information is accessed or otherwise provided to
`the user, or by the inability to facilitate sharing of the
`communications or information between users. Further, con(cid:173)
`ventional schemes that have attempted to address these
`problems tend to be limited by an inability to provide a
`single interface that allows for concurrent information
`retrieval, display or access in combination with communi(cid:173)
`cations and communication access points in a dynamic
`integrated environment. Consequently, users are often left
`with cluttered displays which provide access or interaction
`with either particular types of communications, or with
`specific information, but not with both communications and
`information access and interaction in an integrated environ(cid:173)
`ment.
`
`[0006] Several conventional messaging type schemes
`have attempted to partially address some of these problems.
`However, such schemes typically provide relatively large
`windows that take up substantial amounts of screen or
`display real estate. Further, such schemes, while providing
`some communications capabilities along with some infor(cid:173)
`mation gathering or display capabilities, tend to separate the
`communications capabilities from the information capabili(cid:173)
`ties via one or more tabs or the like. Consequently, particular
`
`information can not be easily shared or communicated from
`within the applications provided by these schemes. Further,
`such schemes become unwieldy as the amount of informa(cid:173)
`tion being tracked by a user increases, and as the number of
`communications contacts maintained by the user increases.
`In particular, as the amount of contacts and/or information
`increases, the user is forced to scroll through large amounts
`of data or communications channels to find what he or she
`is looking for.
`
`[0007] For example, several conventional messaging type
`schemes provide similar capabilities for keeping track of or
`watching information, such as for example stock quotes,
`weather, news, or other information via the Internet or some
`other local or remote network, or some combination thereof.
`Further these conventional schemes also provide for some
`sort of communications access such as, for example, text
`instant messaging, file transfer, email, etc., via one of a
`number of communications channels for contacts in one or
`more groups of contacts. Consequently, a user is able to keep
`track of particular information of interest, as well as to
`communicate with particular people or entities. Unfortu(cid:173)
`nately, with these schemes, the user can not do both simul(cid:173)
`taneously. He is forced to tab between the different types of
`information and the communications capabilities. Therefore,
`the user is unable to share data observed via the different
`information tabs with contacts in the communications tab
`unless the user manually saves or copies the information,
`switches tabs, then manually creates a message to a particu(cid:173)
`lar contact, and either attaches or pastes the information to
`that message.
`
`[0008] Further, because these conventional schemes tend
`to have a number of tabs, they require a fairly large window
`in order to display the information and associated controls or
`icons. Unfortunately, such windows tend to get buried under
`other application windows when the user is using other
`applications. Consequently, the user is often forced to inter(cid:173)
`rupt his or her flow of work to switch between windows.
`This particular problem has been addressed by some of these
`schemes by providing an option to always keep the window
`on top. Consequently, while solving the problem of burying
`the messaging window, a new problem is created. Specifi(cid:173)
`cally, the messaging window then occludes a potentially
`large part of any other open application window. While it is
`possible to manually resize the different application win(cid:173)
`dows and to move them around the screen in an attempt to
`give each window its own space, such manual user inter(cid:173)
`vention can be both time consuming and aggravating for the
`typical user.
`
`[0009] At least one conventional scheme has attempted to
`address some of the problems of the aforementioned
`schemes. For example, one conventional scheme provides
`an application that allows a user to customize at least one
`icon in a scrollable strip along one edge of a computer
`display device. This scheme provides iconized links to
`particular information sources, and uses conventional tech(cid:173)
`niques to populate each customized icon with information
`retrieved from the information sources. However, this
`scheme has several important limitations.
`
`In particular, while this scheme provides for gath(cid:173)
`[0010]
`ering and providing information to a user, it fails to provide
`the level of communications capabilities offered by the
`aforementioned messaging schemes. For example, this
`
`Page 16 of 40
`
`

`

`US 2002/0186257 Al
`
`Dec. 12, 2002
`
`2
`
`scheme does not provide a means for initiating communi(cid:173)
`cation via an icon, so while an icon may provide a commu(cid:173)
`nication status, such as a number of received messages, it
`does not provide a means for responding to such messages.
`Further, this scheme does not provide for nesting or other(cid:173)
`wise organizing groups of icons in order to aggregate
`multiple icons. In other words, opening the window asso(cid:173)
`ciated with one icon does not provide access to further levels
`of grouped icons. Consequently, it is difficult to organize
`icons where a large number of icons are used. In addition,
`the icons of this scheme are not easily transportable. In other
`words, there is no real mechanism for transferring icons
`between users. Instead, users are required to obtain the icons
`from an application used for managing the icons. Other
`limitations of this scheme include a lack of an ability to
`resize the window containing the scrollable strip used for
`displaying the icons. Further, with this scheme, if a user adds
`too many items, another row or strip is automatically created
`within the window, even if that row has only one icon.
`Consequently, this scheme can potentially cause a large
`waste of valuable display space.
`
`[0011] A related scheme allows a user to customize a
`scrolling ticker type display window to provide continu(cid:173)
`ously updated scrolling information from a predefined set of
`available information. While useful, this scheme is even
`more limited than the prior scheme for several reasons. Most
`important among these limitations is that the set of infor(cid:173)
`mation that is available to this scheme is predefined. Thus,
`if the information type and source is not listed as an option
`with this scheme, it is simply not available. However, users
`are provided with limited control over certain information
`options, such as, for example, specific stock symbols for
`stock quotes, choosing areas or topics of news to generate an
`automatic alert, or choosing particular cities to generate a
`weather report. Another limitation is that users are not able
`to add or edit information sources, such as by modifying the
`icons as described above. Further limitations of this scheme
`include that fact that since the ticker scrolls, there is no
`guarantee that all the information of interest will be visually
`available at any given time. Specifically, if the information
`of interest to a user is not currently visible, the user must
`wait until the information scrolls into view. Consequently,
`such a scheme can become very distracting to the user as the
`user is forced to direct a large amount of attention to the
`display in order to retrieve desired information. Further,
`because the scrolling ticker is in constant motion, it is in
`itself potentially very distracting to a user as it creates a
`persistent motion in the user's peripheral vision. Finally, the
`communications capability of this scheme is virtually non(cid:173)
`existent in comparison to the aforementioned messaging
`schemes.
`
`[0012] Still other schemes for providing custom informa(cid:173)
`tion views or displays involve a technique known as "web
`scraping." In general, such schemes allow a user to specify
`particular portions of unique Internet Web pages, i.e., source
`web pages, to be displayed on a single customized web page.
`Consequently, while such schemes provide for information
`retrieval and display, they do not provide for communica(cid:173)
`tions capability.
`
`[0013] For example, one web scraping scheme allows
`users to "clip" relevant data and content from various
`Internet web sites and pull it all together in one dynamic
`browser page, called a "view." This view is effectively a
`
`composite web page. Thus, as any of the source web pages
`are changed, the composite web page is automatically
`updated. Further, this scheme allows users to edit views in
`a variety of ways, such as by adding, deleting and rearrang(cid:173)
`ing data elements and personalizing the view with the users
`own inputs. In addition, this scheme provides a method for
`transferring views between users. However, this scheme
`suffers from many of the same basic limitations described
`above with respect to the aforementioned schemes. Such
`limitations include an inability to nest or organize views, or
`to arrange for a plurality of views to be displayed simulta(cid:173)
`neously. Also, as mentioned above, such schemes typically
`provide little or no communications or messaging capabili(cid:173)
`ties.
`[0014] Further limitations of web scraping include the fact
`that the views of this scheme must be opened in a window
`that typically takes up a substantial portion of a display
`device, if not the entire display device, and thus, it cannot
`provide an unobtrusive method for providing information to
`the user. In addition, typical web pages, as well as specific
`content of those web pages, are typically not designed to
`minimize the area in which information is displayed. In
`other words, such web pages and content are simply not
`designed with the idea of squeezing lots of important
`information into very small spaces. Consequently, the end
`result of web scraping is a composite web page that tends to
`be a very inefficient use of screen space. Further, if a portion
`of the web page that is scraped or otherwise clipped from an
`existing web page includes an animation, the web page can
`be very distracting if it's in the user's peripheral vision.
`Finally, because the web scraping technique is effectively a
`patchwork of distinct elements, the composite web page
`resulting from such techniques is typically an unappealing
`jumble of disparate elements that were never visually
`designed to appear together on a single page.
`[0015] Consequently, what is needed is new system and
`process for automatically providing dynamic communica(cid:173)
`tion access and information awareness in an interactive
`peripheral display without requiring a user to tab between
`communications channels or information types. Further,
`such a system and process should not require a user to
`choose from a predefined list of communication access
`points and information categories or sources, but instead
`should allow for creation and customization of communi(cid:173)
`cations access points and information sources. Such com(cid:173)
`munications access points should include communications
`channels for contacting other entities, such as, for example,
`people, businesses, or organizations, along with the current
`availability of each of the contacts via any of a variety of
`contact methods, such as email, voicemail, messaging serv(cid:173)
`ers, telephone, etc. The information sources should include
`any desired information elements, such as, for example,
`specific information types, information categories, or infor(cid:173)
`mation sources. In addition, this system and process should
`allow users to customize and aggregate or organize any
`desired communication channels or access points, or any
`desired information sources into any desired number of
`groups or nested groups. Also, these groups or nested groups
`should be capable of being expanded by the user to allow the
`user to view nested groups or communication access points
`or information elements within these groups or nested
`groups. Finally, this system and process should provide for
`sharing of pre-defined or user definable communications
`access points and/or information elements between users.
`
`Page 17 of 40
`
`

`

`US 2002/0186257 Al
`
`Dec. 12, 2002
`
`3
`
`SUMMARY OF INVENTION
`
`[0016]
`In general, the present invention solves the afore(cid:173)
`mentioned problems, as well as other problems that will
`become apparent from an understanding of the following
`description by automatically providing dynamic communi(cid:173)
`cation access and information awareness in an integrated
`interactive peripheral display. The present invention pro(cid:173)
`vides this capability either automatically, and/or by allowing
`a user to specify particular information or communications
`contacts of interest to that user. Customized dynamic thumb(cid:173)
`nails representing each contact and each particular informa(cid:173)
`tion element are then automatically displayed.
`
`[0017] These dynamic thumbnails or "items" generally
`comprise a combination of a "ticket" describing the infor(cid:173)
`mation or contact of interest and a specialized "viewer" for
`displaying whatever information or communications contact
`is represented by the ticket. Further, in accordance with the
`present invention, in one embodiment, tickets are sharable
`among users via conventional techniques, and may be cop(cid:173)
`ied, cut, pasted, stored, saved, transferred, transmitted,
`emailed, dragged and dropped from web pages, etc., like any
`other electronic file. The system and process of the present
`invention then either automatically tracks or receives the
`current state of the information and communications con(cid:173)
`tacts described by the tickets, and dynamically provides
`current information as well as availability and status of the
`communications contacts in an
`interactive "peripheral
`awareness" interface for displaying the items. The periph(cid:173)
`eral awareness interface displays information and/or com(cid:173)
`munications contacts in such a way as to minimize any
`potential distraction or interruption to the user.
`
`[0018]
`In the context of the present invention, the concept
`of "peripheral awareness" is best explained by the following
`discussion. In general, the peripheral awareness interface of
`the present invention takes advantage of people's innate
`ability to receive information about the world around them
`without significantly interrupting their focal tasks. One
`trivial example of this innate ability of people to perceive
`information in a peripheral manner without interrupting their
`focal task is that a person might overhear a discussion in the
`hallway between Bob and Jane and realize that Jane has
`returned from her vacation. The present invention takes
`advantage of this ability with the peripheral awareness
`interface. Such peripheral awareness interfaces are always
`on and visible rather than being a discrete user interface
`event that is shown when there is a state change of some
`information. Thus, peripheral awareness, in accordance with
`the present invention does not blatantly draw the user's
`attention to new or updated information immediately, but
`instead makes it available in the periphery so that it may be
`observed if and when the user decides to glance that way.
`Further, in one embodiment, to increase the effectiveness of
`user notification, the peripheral awareness interface utilizes
`both strategies of peripheral awareness and notification, i.e.,
`audible and/or visible alert, depending upon the time sen(cid:173)
`sitivity or priority of the information. The peripheral aware(cid:173)
`ness interface of the present invention provides a display
`area on a user's display device for displaying items as
`described herein.
`
`[0019] Further, with respect to communications contacts,
`the system and method of the present invention provides a
`"person-centric interface" for interacting with the contacts.
`
`This person centric interface is designed such that people or
`other entities are brought to the forefront of the peripheral
`display so that communications with particular persons or
`entities may be reviewed or initiated easily, while the
`communications availability of such people or entities may
`be understood by a user by simply glancing at the peripheral
`display. This capability is accomplished by displaying pic(cid:173)
`tures, images, icons, avatars, etc., within each item that
`represents a particular communications contact for visually
`representing the communications availability or status for
`each communications contact. In alternate embodiments,
`this person centric interface further includes contact specific
`information such as, for example, communication history,
`and communications availability, as well as communications
`access and interaction for particular contacts via any of a
`number of access points or communication channels, such
`as, for example, email, messaging servers, voice mail,
`telephone numbers, peer-to-peer file transfer, etc.
`
`[0020] Specifying, tracking or receiving, and providing
`the information and communications capabilities, as noted
`above, is accomplished in accordance with the present
`invention through the use of at least one customizable
`dynamic encapsulated object, hereinafter referred to as a
`"ticket," that when paired with a "viewer," provides periph(cid:173)
`eral awareness of information of interest to a user. As noted
`above, the combination of a ticket and a viewer is termed an
`"item."
`
`[0021]
`In general, a ticket is represented by a data struc(cid:173)
`ture such as an XML data file. Each ticket includes instruc(cid:173)
`tions as to what information or communications contact is to
`be represented by the ticket as well as pointers to particular
`"services" that represent any of a number of conventional
`means for interacting with the information or communica(cid:173)
`tions contacts. These services are automatically or manually
`selected from a predefined or user definable library of
`services. In particular, the different services represent shared
`code or functions that provide functionality for accessing,
`receiving, retrieving, and/or otherwise interacting with any
`conventional information, source of information, or com(cid:173)
`munications contact. Further, it should be noted that in one
`embodiment multiple services are used in combination for
`providing complex interactions with any conventional infor(cid:173)
`mation, source of information, or communications contact.
`
`[0022]
`In the context of the present invention, one
`example of a "service" is the functionality necessary for
`monitoring an email folder by connecting to a con