Embedding interactive external program objects within open-disfributed
`hypermedia documents
`
`Authors
`
`Doyle Ph.D
`Michael
`Chairman and CEO
`Eôlas Technologies
`Incorporated
`7677 Oakport St Ste 646
`Oakland CA 94621
`email mddoyle@netcom.com
`
`Cheong
`
`Ang M.S
`Programmer/Analyst
`
`Innovative Software Systems Group
`Center for Knowledge Management
`University of California San Francisco
`email cheongcJckm.ucsLedu
`
`Martin M.S
`David
`Head Innovative Software Systems Group
`Center for Knowledge Management
`University of California San Francisco
`email martin@ckm.ucsfedu
`
`Abstract
`
`The World-Wide-Web WWW has created
`
`new paradigm for online information retrieval by providing
`information of any type from data repositories located
`immediate and ubiquitous access to digital
`the world The webs development enables not only effective access for the generic user hat
`throughout
`also more efficient and timely information exchange among scientists and researchers We have extended
`the capabilities of the web to provide an improvement
`to the current paradigm for interacting with inline
`images and to allow multidimensional
`image datasets to be embedded together with realtime interactive
`viewers within WWW documents
`Those datasets can then be accessed via our modified version of
`NCSAs Mosaic WWW browser This paper will provide
`brief background on the World- Wide-Web
`these new data types and
`description of an
`overview of the extensions necessary to support
`implementation of this approach in WWW-compliant
`distributed visualization system
`
`an
`
`Introduction
`
`This paper describes two proprietary technologies CC1 and MetaMAPa which drastically expand
`the the ability to implement robust client/server applications over the Internet Much of this work relates
`for the World Wide Web WWW The WWW was developed by Tim
`to commercial applications
`Berners-Lee at Switzerlands Particle Physics Laboratory CERN in 1989 as way to manage technical
`documents for groups of geographically-remote
`It wasnt until 1993 when Marc
`Andreessen at the University of Illinois National Center for Supercomputing Applications NCSA
`developed MOSAIC that things really began to take off MOSAIC presented people with such an easy-to-
`it was soon called the Killer App for the Information Superhighway
`use interface to the Internet
`that
`Andreessen left NCSA to found
`company originally called Mosaic Communications Inc now
`to MOSAIC Despite the great
`called Netscape Communications Inc to create
`commercial
`competitor
`activity in the WWW browser market current browsers are severly limited in the types of information
`which they can handle The CCI and MetaMAP technologies allow WWW developers to go far
`beyond those limits in creating robust applications based on the Web.
`
`collaborators
`
`0-8194-1764-5/95/$6.00
`
`SPIE Vol 2417/503
`
`Petitioner IBM – Ex. 1075, p. 1
`
`

`
`few facts will
`
`illustrate the speed at which new business opportunities are developing in this area
`Although Netscape was founded less than
`year ago its most recent
`funding round valued the company
`at over $200 million Several months after Netscape was founded NCSA signed
`deal with another
`company Spyglass Inc to commercialize MOSAIC To date Spyglass has licensed over 30 million
`copies of MOSAIC Microsoft recently announced
`that Spyglass MOSAIC would be bundled with their
`next version of Windows Windows 95131 Financial
`institutions such as Bank of America MasterCard
`and Visa are already allied with either Spyglass or Netscape
`in anticipation of profiting from the vast
`the WWW provides
`Much of this commercial
`business opportunities
`friendly nature of MOSIAC and the other WWW browsers
`
`interest relates to the user-
`
`MetaMAP
`
`In order to achieve the types of user-friendly interfaces that provide the point and click simplicity that
`todays users demand multimedia programmers typically encode hot spots into their applications Hot
`spots are areas on the screen that allow the program to respond in some fashion when they are clicked
`upon The earliest
`interactive applications employed only rectangular hot spots These were the easiest
`for the programmers to implement since the program only had to compare ranges of andy coordinates
`to see if it should do anything when mouse click was detected This worked fine for things like menus
`and dialog boxes but around 1988 the approach began to prove inadequate for many of the newer
`hypermedia applications that were beginning to appear Those newer applications often included
`good example would be
`realistic photographic images or illustrations that included many components
`an illustration of the anatomy of
`frog in program to teach high school biology Teachers wanted
`programs that would allow students to click anywhere on the picture of the frog and have the computer
`them what
`the anatomical structure was Since each of the anatomy objects in the illustration was
`Such
`irregularly shaped the use of rectangular hot spots proved woefully inaccurate
`limitation played
`significant role in the failure of IBMs Info Windows system to gain significant market share against
`competitors like Supercard on the Macintosh which supported irregular hot spots
`
`tell
`
`Many innovative programmers at the time began to implement systems which allowed users to define
`irregular hotspots on images During the authoring phase of multimedia application the user would
`trace the outline of each object in an image that was intended to be hot The computer
`interactively
`would store the coordinates of each object as
`separate polygon together with the name of the object
`the systems memory The list of polygons together with their associated names then became map of
`student would click on the frog in the irregular-hotspot
`the objects in the original image Later when
`version of the teaching program the system would automatically
`look through the list of polygons
`image and use geometric operations to decide whether
`the mouse was pointing to an
`associated with that
`area inside or outside of each polygon When the search found
`polygon that surrounded the point of
`interest the object name associated with that polygon would be displayed to the student
`
`in
`
`little deceptive since the geometric operations needed in order to decode the polygonal
`This example is
`very few simple images before they
`obects identity were so complex that applications could use only
`An image as complex as
`either ran out of memory or became too slow to operate effectively
`precise
`full biology atlas could never have been successfully mapped
`illustration of frog anatomy much less
`using the these outline-based techniques on the PC technology of the late SOs
`
`These limitations had been recognized several years earlier by Dr Doyle then
`cell biology graduate
`student as he was trying to come up with way to create an interactive atlas of medical histology using
`4.77 MHz IBM PC with 256K of RAM and 3rd-party 8-bit 256 color graphics board The problem
`image similar to todays SVGA adapters
`was that
`the graphics board could display
`high quality color
`but there was no way that the IBM PC would ever be able to effectively run an interactive atlas program
`based upon irregular polygon-based hot spots An additional problem involved the fact that histology
`images can often contain thousands of individual objects such as blood cells and these objects could fall
`
`504/SPIE Vol 2417
`
`Petitioner IBM – Ex. 1075, p. 2
`
`

`
`into
`
`section of lymph node tissue there could
`number of general classes For example in an image of
`be several hundred red blood cells several hundred white blood cells 40 or 50 clumps of connective
`tissue and so on Even the relatively efficient method of using rectangular hot spots couldnt deal with so
`many objects in
`single image
`
`256-color
`
`Dr Doyle then began to think about how computer displays
`image on the screen The
`computer screen is laid out like an xy cartesian coordinate grid with the origin 00 usually at the upper
`is xy6400 The lower left
`is 0480 and the lower right
`left hand corner The upper right hand corner
`is 640480 The computer
`number in its memory for each intersection of the grid Each of
`then stores
`those numbers corresponds to the color which the monitor displays at the respective grid location Since
`color computer monitors have three color tubes one each for red green and blue one would think that
`the computer would need to store three numbers for each location on the screen each pixel That
`is
`indeed how the most expensive display systems work but much more economical method has been
`developed for mainstream machines This system stores only one 8-bit number ranging in value from 0-
`255 at each pixel location on the screen Each of these numbers or color
`index values then points to one
`of the rows of color look up table or CLIJT also called
`palette This table has rows 0-255
`corresponding to the 256 possible values for each pixel and three columns one each for red green and
`blue RGB These ROB values can be programmed or set by individual software applications as they
`run on the machine Each row in the table stores three 8-bit numbers corresponding to the RGB values
`given color index
`
`for
`
`So when the computer needs to know what color to draw at
`given pixel location it
`then finds the corresponding row of the
`color index value at that
`location Using that color index it
`CLUT and looks across that row to find the red green and blue numbers which determine what actual
`color is displayed on the screen
`is possible for many different pixel locations in an image to use the
`same color index value if the CLUT ROB numbers for that color
`index are changed in some way then
`all of the pixels on the screen which store that particular color
`index will change simultaneously
`to reflect
`the new RGB values
`
`first
`
`locks at the
`
`it
`
`Dr Doyle realized that although such
`system was capable of displaying up tp 256 simultaneous shades
`of gray the human visual system can only distinguish around 64 shades of gray at best and that
`good
`The computer only needs to use
`quality grayscale image could be rendered with as few as 16 gray values
`6-bit number ranging from 0-63 in order to store 64 possible values and only
`bits for 16 possible
`values It appeared that 2-4 bits of information were being wasted for each pixel on the screen Dr Doyle
`the unneeded bits could be used in order to store information about the objects in the
`then realized that
`image The image could be processed so that
`for our frog anatomy example the heart was rendered with
`15 theliverused 16to31 thebrainusedvalues 32to47 andsoon Here
`colorindexvaluesfrom0to
`only bits 16 gray values were being used to render the frog so the other
`bits were used to segment
`the CLUT so that each of 16 anatomically-distinct regions of the frog illustration could owa unique
`segment of the CLUT
`
`By programming the ROB values in the CLUT appropriately each of these 16 segments could be made
`into small grayscale palette ranging from black to white in the heart all of the pixels with
`value of
`would be black 1-14 would be different shades of gray and 15 would be white In the liver color
`index
`16 would be black 17-30 would be gray and 31 would be white Another way of thinking about this is
`that the only pixels in the entire image that used color index values 16 to 31 were those found in the liver
`the liver on the computer screen then simply increasing the RGB
`region If one wanted to highlight
`values in the liver segment of the CLUT rows 16-3 would result in all of the liver pixels getting
`brighter compared with the rest of the image
`
`This segmentation of the palette could also be used as the basis for an efficient means for object
`identification as well Each of the 16 different anatomical
`regions in the frog illustration could be turned
`into an interactively
`selectable hot spot by writing program subroutine that would look to see where the
`
`SPIE Vol 2417/505
`
`Petitioner IBM – Ex. 1075, p. 3
`
`

`
`location and then determine
`student was clicking find out the color
`index of the screen pixel at that
`which palette segment that
`into This method of object
`identification required no
`the color index fell
`polygons and therefore no geometric operations in order to decode an objects identity The obect
`If the image was stored using
`identities in the image were encoded into the images pixel values instead
`then identification strings for the objects could even be saved as comment
`the popular GIF file format
`fields in the GIF file Essentially each pixel in the image had been turned into an independently
`adressable hot spot and the information needed to identify each hotspot was fully encapsulated together
`with the image data This process of object encoding and interactive identification is called palette
`process Dr Doyle was awarded
`segment indexing and is commercially referred to as the MetaMAPs
`U.S patent 4847604 for this technology in 1989
`
`as well Dr Doyle realized that
`indexing had other advantages
`This scheme of object
`it solved his
`histology atlas problem of having hundreds of cells on the screen that could be divided into
`few
`categories All of the red blood cells for example could be rendered with the red blood cell palette
`different palette segment No
`segment to allow simple identification The white blood cells would use
`matter how many of these cells were on the screen each category of cells only used
`single palette
`segment so memory overhead was decreased Objects could be identified simply by looking them up in
`an object table so computational overhead was decreased And each object class on the screen owned
`its own segment of the palette so that all of the objects of
`given type could be easily highlighted by
`simply changing the ROB values in that palette segment Furthermore the efficiency of this system was
`took 10 milliseconds to identify an
`completely independent of the spatial
`resolution of the system If it
`8000
`in 640
`480 image it would take 10 milliseconds to identify an object in
`8000
`object
`resolution image Since polygon-based identification methods are intimately linked to the spatial
`image
`resolution MetaMAP-based object
`identification becomes more and more advantageous as computer
`image resolutions increase as they inevitably do
`
`On the other hand as PCs and Macs have become more powerful
`the performance degradation that
`polygon hotspot encoding imposes has become less and less noticeable for small databases In fact
`the standard technique used by popular multimedia software authoring
`polygon hotspot encoding is still
`The WWW however presents new opportunities for
`systems such as Hypercard and Toolbook
`MetaMAP encoding Most of the home pages browsable on the WWW now include images with
`hotspots The current method for defining and interacting with those hotspots is called ISMAP
`As is discussed below the same
`based upon polygon hotspot encoding and is very cumbersome
`efficiencies that made the MetaMAP process so effective on
`single platform make it an excellent
`alternative for the definition of hotspots on WVTW pages
`
`is
`
`2.1 MetaMAP as an improvement to ISMAP
`
`Hotspots on images are major way designers of WWW home pages try to distinguish themselves The
`latest and greatest home pages such as those at www.whitehouse.gov
`or www.ibm.com usually contain
`The intent is that users will use these images as menus for browsing the
`large ISMAPped images
`remaining pages at those Web sites The ISMAP approach for doing this has several problems however
`Unlike the hotwords in the text areas of the WWW pages there is no indication of hotspots as the
`users mouse cursor passes over them There is also no display of anchor URLs therefore the look and
`feel of the system is different for the user when browsing these ISMAPs than when they interact with
`hotwords in the text
`ISMAPs are difficult
`to implement requiring complex server-side ifies and operations
`There is no capability to create nested hotspots hotspots surrounded by other hotspots
`Interaction is inefficient due to the need for geometric operations polygon queries to determine the
`identity of the object selected by each of the users mouse clicks
`
`506/SPIEVo 2417
`
`Petitioner IBM – Ex. 1075, p. 4
`
`

`
`MetaMAP solves these problems in several ways
`
`Anchor URLs are dynamically displayed and hotspots are highlighted as the cursor passes over
`them so the look and feel are identical
`for interaction with both image-based and text-based hotspots
`MetaMAPa
`is easy to implement for the Web designer since the image and object names are fully
`encapsulated All decoding happens at the browser
`Since each pixel
`is an independently-addressable
`hotspot unlimited nesting is possible
`Greater efficiency is provided since no geometric operations are needed
`
`The end result of these improvements is that use of MetaMAPa
`encoding and decoding of interactive
`hotspots allows much greater degree of user friendliness for WWW-based online services than the
`limitation of the WWW however
`currently-popular ISMAP approach Another
`relates to the poor page-
`formatting features and limited interactive capabilities of HTML the language upon which the Web is
`the WWW has become
`based Nevertheless
`defacto global standard for distributed hypermedia The
`large installed base of MOSAIC users makes it
`impractical to reengineer HTML to solve these problems
`One solution therefore would be to design
`system where additional
`functionality could be added to
`WWW browsers simply through the use of plug in embeddable program objects
`
`CCI4-
`
`real-time imaging through theWWW
`While researching ways to implement dynamic three-dimensional
`the core technology for CCI1M was conceived and developed by the authors Doyle Martin
`Ang
`during the summer of 1993 at the University of California San Franciscos Center for Knowledge
`implementation in 1993 allowed real-time manipulation of 3D biomedical
`The first
`Management
`image data driven by distributed parallel array of powerful computers embedded within WWW
`version of NCSA
`document and accessed via
`remote low-end workstation running the our enhanced
`MOSAIC
`
`tomography CT
`imaging MRI and computer
`Advanced scanning devices such as magnetic resonance
`have been widely used in the fields of medicine quality assurance and meteorology The need to visualize
`resulting data has given rise to wide variety of volume visualization techniques and computer graphics
`tion e.g AVS ApE
`research groups have implemented number of systems to provide volume visualir
`Sunvision Voxel and 3D Viewaix
`Previously these systems have depended upon specialized
`graphics hardware for rendering and significant local secondary storage for the data The expense of
`To overcome the barrier of
`these requirements has limited the ability of researchers to exchange findings
`cost and to provide additional means for researchers to exchange and examine three-dimensional
`volume
`data we have implemented distributed volume visualization tool for general purpose hardware we have
`further integrated that visualization service with the distributed hypermedia system provided by the
`World-Wide-Web
`
`Our distributed volume visualization tool VIS utilizes
`pool of general purpose workstations
`to generate
`three dimensional representations of volume data The VIS tool provides integrated load-balancing across
`any number of heterogeneous UNIX workstations e.g SGI Sun DEC etc taking advantage of the
`unused cycles that are generally available in academic and research environments
`In addition VIS
`supports specialized graphics hardware e.g the RealityEngine from Silicon Graphics when available
`for real-time visualization
`
`docu
`Distributing information that includes volume data requires the integration of visualization with
`ment delivery mechanism We have integrated VIS and volume data into the WWW taking advantage of
`the client-server architecture of WWW and its ability to access hypertext documents stored anywhere on
`the Internet We have enhanced the capabilities of the most popular WWW client Mosaic from the
`
`SPIE Vol 2417/507
`
`Petitioner IBM – Ex. 1075, p. 5
`
`

`
`FIgure
`
`stereo-pair Illustration of Interactive real-lime coiol embedded within an NCSA MOSAIC document
`3-dimensional volume reconstruction of human embryonic anatomy 711 showIng
`7-week old human
`of
`embryo found In the Canegie Collection en 1997 serIal cross sections RealtIme interactive
`volume visualization
`twa of networked gragblcs workstations The stereo pair was eeed by cloning the Mosaic
`wan supported by
`rotating the embryo 60 to the right In the cloned window using the control panel
`window and then Interactively
`seen to the right of the Mosaic wIndows This technology was developed by Doyle Merlin Ang at the Center for
`Knowledge Management at the University of Cfornla San Francisco and was demonstrated there in November
`1993
`
`National Center for Supercomputer Applications NCSA to support volume data and have defined an
`for communication between VIS and Mosaic for volume visualization It should be
`inter-client protocol
`noted that other tpes of interactive applications could be embedded within HTML documents as well
`Our approach can be generalized to allow the implementation of object linking and embedding over the
`Internet similar to the features that OLE 2.0 provides users of Microsoft Windows on an individual
`We have begun working on several extensions and improvements on this software system
`machine
`
`Since the VIS display when mapped into the Mosaic window can be thought of as similarto an
`interactive movie which is sent across the net one way to reduce network transferring time would be to
`compress the data before delivery We propose to use the MPEG compression technique which will not
`entropy reduction Furthermore the
`only perform redundancy reduction but also
`MPEG algorithm performs interframe beside intraframe compression Consequently only the
`compressed difference between the current and the last frames is shipped to the client
`
`quality-adjustable
`
`508/SPIE Vol 2417
`
`Petitioner IBM – Ex. 1075, p. 6
`
`

`
`The protocols we have implemented are simple and general enough to allow most
`image-producing
`programs be modified to display in the Mosaic document page We have successfully incorporated an in-
`house CAD model rendering program into Mosaic
`
`With multiple users the VIS/Mosaic distributed visualization system will need to better manage the server
`servers will slow the servers down
`resources since multiple users utilizing the same computational
`significantly The proposed solution is for the sewer resource manager
`to allocate servers per VIS client
`request only if those servers are not overloaded Otherwise negotiation between the resource manager
`and the VIS client will be necessaly and perhaps the resource manager will allocate less busy alternatives
`to the client Since the load distributing algorithm in the current VIS implementation is not the most
`optimal load distribution solution we expect to see some improvement
`in future implementations which
`will use sender-initiated algorithms
`
`Our system takes the technology of networked multimedia system especially the World Wide Web
`further by proving the feasibility of adding new interactive data types to both the WWW servers and
`object type in the form of an HDF file to the WWW has been
`clients The addition of the 3D-volume-data
`welcomed by many medical
`is now possible for them to view volume datasets without
`researchers for it
`can be accessed via the WWW through
`high-cost workstation Furthermore these visualizations
`hypertext and hypergraphics links within an HTML page Future implementations of this approach using
`other types of embedded applications will allow the creation of
`new paradigm for the online distribution
`of both passively-browsable multimedia information and interactive high-end applications via the Internet
`
`step
`
`time interactive program objects which have since been coined
`This software represents the first
`Weblets have been embedded within distributed hypermedia documents
`The resulting system
`provides the user of the enhanced MOSAIC client with the ability to interactively control vast remote
`server resources from low-end sub $5000 client machine connected via the Internet
`computational
`This also allows the creation of compound documents which combine text and graphic elements as well
`as fully interactive plug-in applications embedded inline using the jargon of the WWW into seamless
`units with the same look and feel on Unix Mac and DOS client platforms
`
`standard application programming interface for this technology called CCIm which
`We have created
`This API
`has been released as an Internet Draft Standard http//visembiyo.ucsf.edu/eolas/ccipp.html
`represents an extension to the University of Illinois Common Client Interface CCI which specifies how
`external applications can drive MOSAIC WWW browsers supporting the CCI-- API will provide
`users with the type of functionality Microsofts object linking and embedding OLE API provides to MS
`Windows users on
`single machine but extending that functionality to easily link objects and documents
`over open-standard wide area networks such as the Internet
`
`This technology also represents the first public demonstration of working distributed-object-compound-
`document model using the Internet The distributed-object
`term refers to the nature of the server-side
`computation driving the embedded application objects
`In conventional
`compound-document
`The embedded objects in such
`two-tier structure is standard
`system are hosted either by the
`systems
`client machine first
`second tier of server computers where each embedded object runs on
`tier or by
`single server machine
`distributed-Object system on the other hand allows each of the embedded
`objects to be computed more efficiently by distributing the computational
`large number of
`load across
`number of manufacturers but none
`Such systems had been generally proposed by
`server machines
`had been implemented prior to the invention of CCI
`
`client/server
`
`The CCI-F-F distributed-object
`system allows the design of three-tier client/server systems where
`server/side logic can be coordinated at the second tier while computational
`efficiency can be achieved at
`the third tier An additional benefit of the CCI approach is that
`the look and feel of the compound
`documents is identical across Unix Mac and Windows client platforms and the various machines
`involved in the system only need to be connected
`to the Internet
`in order
`to intercommunicate
`
`SPIE Vol 24171509
`
`Petitioner IBM – Ex. 1075, p. 7
`
`

`
`Combination of both technologies
`
`into
`
`single system
`
`One of the major advantages of the CCI1M API is that
`it can be used to embed full applications with
`only minor modifications within WWW documents This means the embedded applications entire
`display graphical user interface GUI and all would appear within the compund document Essentially
`the application is converted into an interactive movie where the embedded application is hosted on
`compressed video stream to the MOSAIC client and the client sends
`remote server The server sends
`GJU selection messages back to the sewer To accomplish this
`flexible means to decode the users GUI
`interactions at the client side is needed Since the system needs to be able to deal with any arbitrary GUI
`the GUT elements would be cumbersome inefficient and limiting
`using polygonal hotspots to represent
`Using the MetaMAPs process solves this problem in an efficient and flexible
`with palette segment
`indexing encoding hotspots on the digital movie video stream This will allow us to embed any existing
`application within WWW document with minimumof effort Regardless of what operating system or
`computer system the user has all he or she will need in order to run any computer application will be
`CCI-H--enabled WWW browser and
`connection to the Internet Such
`technology has the power to
`redefine the paradigm of personal computing in the coming years
`
`References
`
`Andreessen
`1993
`
`NCSA Mosaic Technical Summary fromFTP site ftp.ncsa.uiuc.edu
`
`8May
`
`Ang C.S D.C Martin and M.D Doyle Integrated Control of Distributed Volume Visualization
`Through the World Wide Web Proc Visualization 94 IEEE Press 1994
`Web Browsers The WebUntangled PC Magazine 14/3173-196
`
`andReichard
`
`Ayre
`1995
`
`Berners-Lee
`
`et al The World Wide Web Communications of the ACM 37/S 76-82 1994
`
`Bloomer
`
`Distributed Computing and the OSF/DCE Dr Dobbs
`
`20/218-32 1995
`
`Sundsten J.W Knowledge-basedcient-server approach to stuctural
`Brinldey J.F Eno
`the Digital Anatomist Browser Computer methods and Programs in Biomedicine
`information retrieval
`Vol 40 No
`June 13 1-145 1993
`
`Doyle M.D Raju
`Ang
`KleinG Goshtasby
`and DeFanti
`The Visible Embivo
`interactive visualization of high-density 3D image data of
`distributed workstationlsupercomputer
`embryonic anatomy presented at the High Performance Computing and Communication Showcase
`SIGGRAPH 92 the annual meeting of the Association for Computing Machiners Special Interest Group
`for Graphics Chicago August 1992
`
`Doyle M.D and Sadler L.L Health Informatics MetaMap indexing and retrieval of image-based
`data for an institutional PACS system presented at the 1991 Forum in Cellular and Organ Biology
`American Association of Anatomists Chicago April 1991
`
`Doyle M.D Palette Segmentation Indexing The MetaMap Process SIGBIO Newsletter The Journal
`of the ACM Special Interest Group for Biological Computing 12/1 1992
`
`510/SPIE Vol 2417
`
`Petitioner IBM – Ex. 1075, p. 8
`
`

`
`10 Doyle M.D
`New Method for Identilring Features of an hnage on Digital Video Display
`Biostereometrics Technology and Applications SPIE Press 1991
`
`Ran
`Ang
`11 Doyle M.D
`Grzesczuk and
`Klein B.S Williams
`Goshlasby
`DeFanti
`image data for reconstruction of human developmental anatomy from
`Noe Processing cross-sectional
`museum specimens SIGBIO Newsletter The Journal of the ACM Special
`Interest Group for Biological
`Computing 13/1 1993
`
`12 Giertsen
`and Petersen
`Parallel VolumeRendering
`Computer Graphics and Applications 16-23 November 1993
`
`on Network of Workstations IEEE
`
`13 Green
`1981
`
`Genetics and Probability in animal breeding experiments Oxford University Press
`
`14 http//visernbryo.ucsf.edu/
`
`The Visible Embryo Project Home Page 1994
`
`15 http/Ivisembryo.ucsLedu./eolas/ccipp.html
`
`CCI/l .0 Internet Draft Standard 1995
`
`Building an OLE Server Using Visual C-H- 2.0 Dr Dobbs
`20/282-88 1995
`16 LaPlante
`17 McConathy DA and Doyle M.D Interactive Displays in Medical Art chapter
`in Pictorial
`Ellis Editor Pub Taylor
`Communication in Virtual and Real Environments Stephen
`London 1991
`
`Francis
`
`18 Udupa J.K Course notes Visualization of biomedical data principles and algorithms 1st ConL on
`14-16 1990
`Visualization in Biomed Computing IEEE Computer Society Press
`
`19 Vaaben
`
`and Niss
`
`Photos of the future Iris Universe 20 62-66 1992
`
`20 Wolf
`1994
`
`The Second Phase of the Revolution Has Begun Wired October 1994 116-154
`
`SPIE Vol 2417/511
`
`Petitioner IBM – Ex. 1075, p. 9