USOO9641644B2
`
`(12) United States Patent
`US 9,641,644 B2
`(10) Patent No.:
`Levanon et al.
`(45) Date of Patent:
`*May 2, 2017
`
`(54) OPTIMIZED IMAGE DELIVERY OVER
`LIMITED BANDWIDTH COMMUNICATION
`CHANNELS
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`(71) Applicant: BRADIUM TECHNOLOGIES LLC,
`Suffern, NY (US)
`
`Inventors:
`
`(72)
`
`Isaac Levanon, Raanana (IL); Yonatan
`Lavi, Raanana (IL)
`
`(73)
`
`Assignee:
`
`BRADIUM TECHNOLOGIES LLC,
`Suffern, NY (US)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`This patent is subject to a terminal dis-
`claimer.
`
`(21)
`
`Appl. No.: 14/970,526
`
`(22)
`
`Filed:
`
`Dec. 15, 2015
`
`Prior Publication Data
`
`US 2016/0112486 A1
`
`Apr. 21, 2016
`
`4,222,076 A
`4,672,444 A
`
`9/1980 Knowlton
`6/1987 Bergen et a1.
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`CA
`CA
`
`2215270
`2420390
`
`9/1997
`8/2001
`
`(Continued)
`
`OTHER PUBLICATIONS
`
`George H. Forman and John Zahorjan, “The challenges of mobile
`computing,” Computer v01. 27, N0. 4, pp. 38, 47 (Apr. 1994), all
`pages.
`
`(Continued)
`
`Primary Examiner 7 David Lazaro
`(74) Attorney, Agent, or Firm iAnatoly S. Weiser, Esq.;
`Techlaw LLP.
`
`(65)
`
`(63)
`
`(51)
`
`Related US. Application Data
`
`(57)
`
`ABSTRACT
`
`Continuation of application No. 14/547,148, filed on
`Nov. 19, 2014, now Pat. No. 9,253,239, which is a
`(Continued)
`
`Int. C l.
`G06F 15/16
`H04L 29/08
`
`(2006.01)
`(2006.01)
`(Continued)
`
`(52) US. Cl.
`CPC ............ .. H04L 67/327 (2013.01); G06F 3/14
`(2013.01); G06F 3/1454 (2013.01);
`(Continued)
`Field of Classification Search
`CPC .... .. G06T 3/4092; G09G 2340/02; G06F 3/14
`(Continued)
`
`(58)
`
`Large-scale images are retrieved over network communica-
`tions channels for display on a client device by selecting an
`update image parcel relative to an operator controlled image
`viewpoint to display via the client device. A request
`is
`prepared for the update image parcel and associated with a
`request queue for subsequent issuance over a communica-
`tions channel. The update image parcel is received from the
`communications channel and displayed as a discrete portion
`of the predetermined image. The update image parcel opti-
`mally has a fixed pixel array size, is received in a single and
`or plurality of network data packets, and were the fixed pixel
`array may be constrained to a resolution less than or equal
`to the resolution of the client device display.
`
`65 Claims, 5 Drawing Sheets
`
`iiixgrrfistijr’“
`am
`
`i “
`
`E?
`Mfume: 13m
`
`
`
`
`
`Microsoft Corp. Exhibit 1001
`
`Microsoft Corp. Exhibit 1001
`
`

`

`US 9,641,644 132
`
`Page 2
`
`Related U.S. Application Data
`
`continuation of application No. 13/027,929, filed on
`Feb. 15, 2011, now Pat. No. 8,924,506, which is a
`continuation-in-part of application No. 12/619,643,
`filed on Nov. 16, 2009, now Pat. No. 7,908,343,
`which is a continuation of application No. 10/035,
`987, filed on Dec. 24, 2001, now Pat. No. 7,644,131.
`
`(60)
`
`Provisional application No. 60/258,465, filed on Dec.
`27, 2000, provisional application No. 60/258,466,
`filed on Dec. 27, 2000, provisional application No.
`60/258,467,
`filed on Dec. 27, 2000, provisional
`application No. 60/258,468, filed on Dec. 27, 2000,
`provisional application No. 60/258,488, filed on Dec.
`27, 2000, provisional application No. 60/258,489,
`filed on Dec. 27, 2000.
`
`Int. Cl.
`
`(51)
`
`G06F 3/14
`G06T 3/40
`H04L 29/06
`G09G 5/00
`U.S. Cl.
`
`(2006.01)
`(2006.01)
`(2006.01)
`(2006.01)
`
`CPC ......... .. G06T 3/4092 (2013.01); G09G 5/003
`(2013.01); H04L 65/602 (2013.01); H04L
`67/42 (2013.01); G09G 2340/02 (2013.01);
`G09G 2350/00 (2013.01); G09G 2370/02
`(2013.01); G09G 2370/16 (2013.01)
`Field of Classification Search
`USPC ............. .. 709/202, 203, 217, 230, 246, 247;
`345/625; 382/232, 305
`See application file for complete search history.
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`(52)
`
`(58)
`
`(56)
`
`4,698,689 A
`4,972,319 A
`5,179,638 A
`5,263,136 A
`5,321,520 A
`5,384,643 A
`5,604,824 A
`5,630,757 A
`5,651,676 A
`5,682,441 A
`5,692,193 A
`5,724,070 A
`5,734,893 A
`5,760,783 A
`5,764,235 A
`5,798,770 A
`5,818,469 A
`5,929,860 A
`5,940,117 A
`5,949,425 A
`5,968,109 A
`5,978,381 A
`5,987,256 A
`6,046,744 A
`6,061,473 A
`6,088,044 A
`6,092,091 A
`6,108,006 A
`6,118,456 A
`6,121,970 A
`6,139,197 A
`6,179,618 B1
`6,182,114 B1
`6,192,393 B1
`6,212,301 B1
`
`10/1987 Tzou
`11/1990 Delorme
`1/1993 Dawson et a1.
`11/1993 DeAguiar et a1.
`6/1994 Inga et a1.
`1/1995 Inga et a1.
`2/1997 Chui et a1.
`5/1997 Gagin et a1.
`7/1997 Artwick
`10/1997 Ligtenberg et a1.
`11/1997 Jagannathan et a1.
`3/1998 Denninghoff et a1.
`3/1998 Li et a1.
`6/1998 Migdal et a1.
`6/1998 Hunt et a1.
`8/1998 Baldwin
`10/1998 Lawless et a1.
`7/1999 Hoppe
`8/1999 Hasan et a1.
`9/1999 Willis
`10/1999 Israni et a1.
`11/1999 Perlman et a1.
`11/1999 Wu et a1.
`4/2000 Hoppe
`5/2000 Chen et a1.
`7/2000 Kwok et a1.
`7/2000 Sumita et a1.
`8/2000 Hoppe
`9/2000 Cooper
`9/2000 Guedalia
`10/2000 Banks
`1/2001 Stone
`1/2001 Yap et a1.
`2/2001 Tarantino et a1.
`4/2001 Warner et a1.
`
`6,314,452
`6,346,938
`6,397,259
`6,490,627
`6,496,189
`6,525,732
`6,536,043
`6,553,141
`6,573,900
`6,594,687
`6,608,933
`6,633,674
`6,633,688
`6,636,802
`6,650,998
`6,664,960
`6,671,424
`6,674,038
`6,675,210
`6,684,087
`6,684,255
`6,704,024
`6,711,297
`6,728,960
`6,750,864
`6,801,665
`6,850,235
`
`6,882,755
`6,961,754
`6,963,347
`6,982,710
`7,024,045
`7,024,046
`7,075,553
`7,139,794
`
`7,206,804
`7,212,678
`7,236,637
`7,242,406
`7,248,262
`7,343,555
`7,433,881
`7,490,104
`7,536,446
`7,561,156
`
`7,589,737
`7,644,131
`
`7,904,594
`7,908,343
`
`8,825,812
`8,924,506
`
`9,253,239
`2002/0054692
`2002/0057850
`2002/0097411
`2002/0108127
`2002/0118224
`
`B1
`B1
`B1
`B1
`B1
`B1
`B1
`B1
`B1
`B1
`B1
`B1
`B1
`B1
`B1
`B2
`B1
`B1
`B1
`B1
`B1
`B2
`B1
`B1
`B1
`B1
`B2*
`
`B2
`B2
`B1
`B2
`B2
`B2
`B2
`B2 *
`
`B1
`B2
`B2
`B2
`B2
`B2
`B1
`B2
`B2
`B2 *
`
`B2
`B2 *
`
`B2
`B2 *
`
`B2
`B2 *
`
`B2 *
`A1
`A1
`A1
`A1
`A1*
`
`11/2001
`2/2002
`5/2002
`12/2002
`12/2002
`2/2003
`3/2003
`4/2003
`6/2003
`7/2003
`8/2003
`10/2003
`10/2003
`10/2003
`11/2003
`12/2003
`12/2003
`1/2004
`1/2004
`1/2004
`1/2004
`3/2004
`3/2004
`4/2004
`6/2004
`10/2004
`2/2005
`
`4/2005
`11/2005
`11/2005
`1/2006
`4/2006
`4/2006
`7/2006
`11/2006
`
`4/2007
`5/2007
`6/2007
`7/2007
`7/2007
`3/2008
`10/2008
`2/2009
`5/2009
`7/2009
`
`9/2009
`1/2010
`
`3/2011
`3/2011
`
`9/2014
`12/2014
`
`2/2016
`5/2002
`5/2002
`7/2002
`8/2002
`8/2002
`
`2002/0120753
`
`A1*
`
`8/2002
`
`2006/0210196
`2007/0182734
`
`A1
`A1*
`
`9/2006
`8/2007
`
`2010/0064002
`
`A1*
`
`3/2010
`
`2011/0175914
`
`A1*
`
`7/2011
`
`Dekel et a1.
`Chan et a1.
`Lincke et a1.
`Kalra et a1.
`Yaron et a1.
`Gadh et a1.
`Guedalia
`Huffman
`Lindholm et a1.
`Yap et a1.
`Dowell et a1.
`Barnes et a1.
`Nixon et a1.
`Nakano et a1.
`Rutledge et a1.
`Goel et a1.
`Skoll et a1.
`Latta
`Takeo et a1.
`Yu et a1.
`Martin
`Robotham et a1.
`Chang et a1.
`Loomans
`Anwar
`Atsumi et a1.
`Levanon ................. .. G06F 3/ 14
`345/423
`
`Silverstein et a1.
`Christopoulos et a1.
`Selvaggi et a1.
`Salomie
`McIntyre
`Dekel et a1.
`Miller et a1.
`Levanon ................. .. G06F 3/ 14
`345/420
`
`Deshpande et a1.
`Brown et a1.
`Sirohey et a1.
`Robotham et a1.
`Cao
`K0 et a1.
`Hill
`Li et a1.
`Blumberg
`Levanon ............. .. G06T 17/005
`345/419
`
`Hochmuth et a1.
`Levanon ................. .. G06F 3/ 14
`345/625
`
`Spicer et a1.
`Levanon ................. .. G06F 3/ 14
`345/625
`
`Asher
`Levanon ............. .. G06F 3/1454
`345/625
`Levanon ............. .. G06F 3/1454
`Suzuki et a1.
`Sirohey et a1.
`Roche et a1.
`Lew et a1.
`Levanon ................. .. G06F 3/ 14
`715/748
`Levanon ................. .. G06F 3/ 14
`709/228
`
`Wensley et a1.
`Levanon ............. .. G06T 17/005
`345/420
`Levanon ................. .. G06F 3/ 14
`709/203
`Levanon ............. .. G06F 3/1454
`345/428
`
`FOREIGN PATENT DOCUMENTS
`
`CA
`EP
`
`2349150
`1070290 B1
`
`2/2005
`1/2015
`
`Microsoft Corp. Exhibit 1001
`
`Microsoft Corp. Exhibit 1001
`
`

`

`US 9,641,644 132
`
`Page 3
`
`(56)
`
`KR
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`WO
`
`References Cited
`FOREIGN PATENT DOCUMENTS
`
`10-2000-7010415
`94/24625
`96/29818
`97/30551
`WO98/15920
`WO99/41675
`01/16764
`01/98925 A1
`02/059817
`
`10/2006
`10/1994
`9/1996
`8/1997
`4/1998
`8/1999
`3/2001
`12/2001
`8/2002
`
`OTHER PUBLICATIONS
`
`filed Jan. 11, 2016,
`
`K. Brown & S. Singh, A Network Architecture for Mobile Com-
`puting, INFCOM ’96 15th Annual Joint Conf. IEEE Comp Soc,
`Networking the Generation, Proceedings IEEE v3 all pages.
`Kreller, B. et al “UMTS: a middleware architecture and mobile API
`approach,” Personal Communications, IEEE, vol. 5, No. 2, pp.
`32-38 (Apr. 1998) (all pages).
`Hansen, J. et al, “Real-time synthetic vision cockpit display for
`general aviation,” AeroSense ’99, International Society for Optics
`and Photonics, 1999., all pages.
`GeoTIFF Format Specification Revision 1.0, all pages.
`TIFF Revision 6.0, dated Jun. 3, 1992, all pages.
`FlashPix Format Specification v1.0, dated Sep. 11, 1996, all pages.
`The Virtual Reality Modeling Language ISO/IEC 14772-1:1997, all
`pages.
`Prasad, Accelerating SIFT Feature extraction with a vector DSP
`(Master Thesis), all pages.
`IPR Petition re US. Pat. No. 7,908,343,
`IPR2016-00448, all pages.
`Excerpt of Hanan Samet, The Design and Analysis of Spatial Data
`Structures, University of Maryland (1989, Reprinted with correc-
`tions in Jan. 1994), all pages.
`B. Fuller and I. Richer, The MAGIC Project: From Vision to Reality,
`IEEE Network May/Jun. 1996, pp. 15-25 (all pages).
`International Telegraph and Telephone Consultative Committee
`(“CCITT”) Recommendation T.81, Sep. 1992, all pages.
`Ken Cabeen & Peter Gent, Image Compression and the Discrete
`Cosine Transform, all pages, 1998.
`IEEE
`M. Antonini,
`Image Coding Using Wavelet Transform ,
`Transactions on Image Processing, vol. 1, No. 2, Apr. 1992, all
`pages.
`Lance Williams, Pyramidal Parametrics, Computer Graphics, vol.
`17, No. 3, Jul. 1983, all pages.
`OpenGL Standard Version 1.1, Mar. 1997, available: https://www.
`opengl.org/documentation/specs/version1.l/glspecl.1/node84.
`htm1#SECTION00681100000000000000, all pages.
`H. Hoppe, Progressive Meshes, SIGGRAPH ’96: Proceedings of
`the 23rd annual conference on computer graphics and interactive
`techniques, pp. 99-108, all pages.
`OpenGL Standard Version 1.2.1, Apr. 1999, available: https://www.
`opengl .org/documentation/specs/version1 .2/openg11 .2 . 1 .pdf,
`all
`pages.
`Printout of IEEE Explore citations to Reddy et al., all pages.
`Printout of Google Scholar citations to Reddy et al., all pages.
`Cover page and authenticating declaration of Reddy et al., from
`British Library, all pages.
`Cover page of Reddy et al. from Linda Hall Library, all pages.
`Reddy et al., TerraVision II: Visualizing Massive Terrain Databases
`in VRML, IEEE Computer Graphics and Applications, Mar/Apr.
`1999, pp. 30-38 (all pages).
`Related Matters Notice in IPR2016-00448, all pages.
`Scheduling Transcript, Bradium Tech. v. Microsoft Case No. 15-CV—
`031 (D. Del.), Exh. 2001 in IPR2016-00449 and IPR2016-00448, all
`pages.
`Patent Owner’s Preliminary Response in IPR2016-00448, all pages.
`Notice of Filing Date Accorded to Petition in IPR2016-00448, all
`pages.
`
`filed Jan. 11, 2016,
`
`1009 in
`
`Patent Owner’s Updated Mandatory Notices in IPR2016-00448, all
`pages.
`Curriculum Vitae of William R. Michalson, all pages.
`Boris Rabinovich & Craig Gotsman, Visualization of Large Terrains
`in Resource-Limited Computing Environments (1997), all pages.
`User Datagram Protocol (UDP)
`(Windows CE 5.0, Microsoft,
`Available: https://msdn.microsoft.com/enus/library/ms885773.aspx
`[Accessed Apr. 28, 2015] all pages.
`Theresa-Marie Rhyne, A Commentary on GeoVRML: A Tool for
`3D Representation of FeoReferenced Data on the Web, Int’l J. of
`Geographic Information Sciences i4 v13 1999 all pages.
`Michalson Decl. with Appendices A-I, in IPR2016-00449, US. Pat.
`No. 8,924,506, all pages.
`Michalson Decl. Appendices J-KK, in IPR2016-00449, US. Pat.
`No. 8,924,506, all pages.
`IPR Petition re US. Pat. No. 8,924,506,
`IPR2016-00449, all pages.
`Patent Owner’s Mandatory Notices, Related Matters, IPR2016-
`00449, all pages.
`Patent Owner’s Preliminary Response, IPR2016-00449, all pages.
`Declaration of Charles Randall Carpenter, Exh. 1015 in IPR2015-
`01434, all pages.
`Notice of Filing Date Accorded to Petition IPR2016-00449, all
`pages.
`Patent Owner’s Updated Mandatory Notices, IPR2016-00449, all
`pages.
`Declaration of Dr. Peter Lindstrom, Exh. 1014 in IPR2015-01434,
`all pages.
`Michalson Declaration with Appendices A-O, Exh.
`IPR2015-01434, all pages.
`Michalson Declaration Appendices P-FF, Exh. 1008 in IPR2015-
`01434, all pages.
`An Integrated Global GIS and Visual Simulation System by P.
`Lindstrom et al., Tech. Rep. GIT-GVU-97-07, Mar. 1997, Exh. 1004
`in IPR2015-01434, all pages.
`d’Arnaud Decl. with Maps Alive: Viewing Geospatial Information
`on the WWW, Michael Potrnesil, Computer Networks and ISDN
`Systems vol. 29, issues 8-13, pp. 1327-42, all pages.
`IPR Petition re US. Pat. No. 7,908,343,
`filed Jun. 16, 2015,
`IPR2015-01434, all pages.
`Patent Owner’s Updated Mandatory Notices in IPR2015-01434, all
`pages.
`Michalson Decl. with Appendices A-O, IPR2015-01435, US. Pat.
`No. 8,924,506, all pages.
`Michalson Decl. Appendices P-EE, IPR2015-01435, US. Pat. No.
`8,924,506, all pages.
`IPR Petition re US. Pat. No. 8,924,506,
`IPR2015-00435, all pages.
`Notice of Filing Date Accorded to Petition in IPR2015-01435, all
`pages.
`Patent Owner’s Preliminary Response in IPR2015-01435, all pages.
`Patent Owner’s Mandatory Notices, IPR2015-01435, all pages.
`Patent Owner’s Updated Mandatory Notices, IPR2015-01435, all
`pages.
`Patent Owner’s Second Updated Mandatory Notices, IPR2015-
`01435, all pages.
`Patent Owner’s Preliminary Response in IPR2015-01434, all pages.
`Hon. McNamara et al., Decision Denying Institution of Inter Partes
`Review in IPR2015-01434, US. Pat. No. 7,908,343, Dec. 23, 2015,
`all pages.
`Hon. Chung et al., Decision Denying Institution of Inter Partes
`Review in IPR2015-01435, US. Pat. No. 8,924,506,Dec. 23,2015,
`all pages.
`Michalson Declaration with Appendices A-I, Exhibit 1005 in
`IPR2016-00448, US. Pat. No. 7,908,343, Jan. 11, 2016, all pages.
`Michalson Declaration Appendices J-KK, Exhibit 1005 in IPR2016-
`00448, US. Pat. No. 7,908,343, Jan. 11, 2016, all pages.
`Ritter et al., GeoTIFF Format Specification, Rev. 1.0, Specification
`Ver. 1.8.1, Oct. 1995, all pages.
`Adobe Systems Inc., TIFF Revision 6.0, Jun. 1992, all pages.
`Eastman Kodak Co., FlashPix Format Specification Ver. 1.0, 1996,
`all pages.
`
`filed Jun. 16, 2015,
`
`Microsoft Corp. Exhibit 1001
`
`Microsoft Corp. Exhibit 1001
`
`

`

`US 9,641,644 132
`
`Page 4
`
`(56)
`
`References Cited
`OTHER PUBLICATIONS
`
`The VRML Consortium Inc., The Virtual Reality Modeling Lan-
`guage, ISO/IEC 14772-121997, 1997, all pages.
`Invalidity Contentions, Exhibit 88, Bradium Techs. LLC V.
`Microsoft Corp., 1:15-cv-00031-RGA (D. Del) (all pages).
`Invalidity Contentions, Exhibit 89, Bradium Techs. LLC V.
`Microsoft Corp., 1:15-cv-00031-RGA (D. Del) (all pages).
`Invalidity Contentions, Exhibit 90, Bradium Techs. LLC v.
`Microsoft Corp., 1:15-cv-00031-RGA (D. Del) (all pages).
`Invalidity Contentions, Exhibit 91, Bradium Techs. LLC v.
`Microsoft Corp., 1:15-cv-00031-RGA (D. Del) (all pages).
`Maps Alive: Viewing Geospatial
`Information on the WWW,
`Michael Potmesil, Bell Labs., http:
`//www.ra.ethz.chlcdstore/
`www6/technica11paper 130/paper130.htm1 (all pages), 1997.
`Thakkar, Vaishali; Quadtrees, Octrees and their applications in DIP.
`Presentation slides, Apr. 22, 1998, all pages.
`Levanon, Isaac and Lavi, Yoni; U.S. Appl. No. 60/258,465, filed
`Dec. 26, 2000, Request for Filing a Provisional Application or
`Patent Under 37 CFR §1.53 cwptimization T-Junction Cracking-
`Problem of Image Parcels Being Packet Streamed by Utilizing
`Quadtree Scheme.
`Levanon, Isaac and Lavi, Yoni; U.S. Appl. No. 60/258,468, filed
`Dec. 26, 2000, Request for Filing a Provisional Application or
`Patent Under 37 CFR §1.53 ciMultiple Parallel Download of
`Target Image Parcels Streamed Over Limited and Narrowband
`Communications Channels.
`TIMPF, Sabine and Frank, Andrew U.; Using hierarchical spatial
`data structures for hierarchical spatial reasoning. Spatial Informa-
`tion TheoryiA Theoretical Basis for GIS (International Confer-
`ence COSIT97); S. C. Hirtle and A.U. Frank. Berlin-Heidelberg,
`Springer-Verlag. Lecture Notes in Computer Science 1329: 69-83;
`Apr. 2006; Dept. of Geoinformation, Technical University Vienna.
`Rauschenbach, Uwe; Progressive Image Transmission Using Levels
`of Detail and Regions of Interest; University of Rostock, Computer
`Science Department, D-18051 Rostock, Germany, all pages, 1998.
`Sivan, Ron; Surface Modeling Using Quadtrees; Feb. 1996; Com-
`puter Vision Laboratory, Center for Automation Research, Univer-
`sity of Maryland, College Park, MD, all pages.
`Baumann, Peter, Web-enabled Raster GIS Services for Large Image
`and Map Databases. 5th Int’l Workshop on Query Processing and
`Multimedia Issues in Distributed Systems (QPMIDS’2001); Sep.
`3-4, 2001; Active Knowledge GmbH, Kirchenstr. 88, D-81675
`Munich, Germany, all pages.
`Chang, Tianhorng and Kuo, C.-C. Jay; Texture Analysis and Clas-
`sification with Tree-Structured Wavelet Transform. IEEE Transac-
`tions on Image Processing, vol. 2, No. 4, Oct. 1993; IEEE, all pages.
`ESRI; ESRI Data & Maps 1999. An ESRI White Paperisep. 1999,
`Sep. 1999, Environmental Systems Research Institute,
`Inc., all
`pages.
`Durst, Martin J.; A New Method for Image Compression and
`Progressive Transmission. Dissertation submitted to the Graduate
`School of the University of Tokyo in Partial Fulfillment of the
`Requirements for the Degree of Doctor of Science in Information
`Science, Jun. 1990, all pages.
`Heckbert, Paul. Course Organizer; Multiresolution Surface Model-
`ing. Course Notes for SIGGRAPH ’97, Los Angeles, California,
`Aug. 5, 1997, all pages.
`Gorte, Ben G.H.; Multi-spectral Quadtree based Image Segmenta-
`tion. International Archives of Photogrammetry and Remote Sens-
`ing. vol. XXXI, Part B3. Vienne 1996, International Institute for
`Aerospace Survey and Earth Sciences (ITC), Enschede, the Neth-
`erlands, 1996, all pages.
`Misenti, Meg; 3-D GIS system throws public discourse in relief.
`http://web.archive.org/web/19990224153934/http:///www.fcw-
`civic.com/pubs/nov97/civ-gis-11-1-1997.htm1, FCW Government
`Technology Group. FCW.com, Nov. 1997, all pages.
`Laws, Kenneth 1.; Integrated Split/Merge Image Segmentation.
`Technical Note 441. SRI Projects 2000 and 8388, SRI International,
`Artificial Intelligence Center, Computer and Information Science,
`333 Ravenswood Ave., Menlo Park, CA 94025, Jul. 1998, all pages.
`
`Nebiker, Stephan; Spatial Raster Data Management for Geo-Infor-
`mation SystemsiA Database Perspective. Dissertation ETH No.
`12374. A dissertation submitted to the Swiss Federal Institute of
`Technology for the degree of Doctor of Technical Sciences, all
`pages, 1997.
`Liang, Kai-Chieh and Kuo, C.-C. Jay; WaveGuide: A Joint Wavelet-
`Based Image Representation and Description System. IEEE Trans-
`actions on Image Processing, vol. 8, No. 11, Nov. 1999, IEEE, all
`pages.
`Bouman, Charles A. and Shapiro, Michael; A Multiscale Random
`Field Model for Bayesian Image Segmentation. IEEE Trans. On
`Image Processing, vol. 3, No. 2, pp. 162-177, Mar. 1994.
`To, Danny S.P.; Lau, Rynson W.H. and Green, Mark; A Method for
`Progressive and Selective Transmission of Multi-Resolution Mod-
`els, Danny S.P. To and Rynson W.H. Lau, Department of Computer
`Science, City University of Hong Kong, Hong Kong; Mark Green,
`Department of Computer Science, University of Alberta, Canada,
`1999, all pages.
`Boelitz, Carole and Beck, Eric V.; Orbit Analysis Software Index.
`Final Report. PL-TR-95-1139, Rev. 1, vol. II, Phillips Laboratory,
`Space Technology Directorate, Air Force Materiel Command,
`Kirtland Air Force Base, NM 8117-5776, Jul. 1997, all pages.
`Martin, Ioana M.; IBM Research Report. Adaptive Rendering of 3D
`Models Over Networks Using Multiple Modalities. RC 21722 (Log
`97821), IBM Research Division, IBM T.J. Watson Research Center,
`PO. Box 704, Yorktown Heights, NY 10598, Apr. 11, 2000, all
`pages.
`Aftosmiss, M. J.; Solution Adaptive Cartesian Grid Methods for
`Aerodynamic Flows with Complex Geometries. Von Karman Insti-
`tute for Fluid Dynamics, Lecture Series Feb. 1997, 28th computa-
`tional
`fluid dynamics, M.
`J. Aftosmis, USAF/NASA Research
`Center, Mail Stop T27B-2, Moffett Field, CA 94035-1000, Mar. 3-7,
`1997, all pages.
`Deren, Li and Jianya, Gong; An Unified Data Structure Based on
`Linear Quadtrees. EARSel. Advances in Remote Sensing, vol. 1,
`No. 3-VIL, 1992, Li Deren and Gong Jianya, Department of
`Photogrammetry and Remote Sensing, Wuhan Technical University
`of Surveying and Mapping, Wuhan, China, all pages.
`Barclay, Tom; Eberl, Robert, et al.; The Microsoft TerraServerTM.
`Technical Report MSR-TR-98-17, Jun. 1998, Microsoft Research,
`Microsoft Corporation, One Microsoft Way, Redmond, WA 98052,
`all pages.
`Barclay, Tom; Gray, Jim and Slutz, Don; Microsoft TerraServer: A
`Spatial Data Warehouse, Tom Barclay, Jim Gray and Don Slutz,
`Microsoft Research, 301 Howard St., Suite 830, San Francisco, CA
`94105, all pages, 1999.
`Cohen, Daniel and Gotsman, Craig; Photorealistic Terrain Imaging
`and Flight Simulation. IEEE Computer Graphics and Applications,
`Mar. 1994, all pages.
`Cohen-OR, Daniel; Rich, Eran; Lerner, Uri; Shenkar, Victor; A
`Real-Time Photo-Realistic Visual Flythrough. IEEE Transactions
`on Visualization and Computer Graphics, vol. 2, No. 3, Sep. 1996,
`all pages.
`Deshpande, Sachin and Zeng, Wenjun; Scalable Streaming of
`JPEG2000 Images using Hypertext Transfer Protocol, Sachin
`Deshpande and Wenjun Zeng, Sharp Laboratories of America, Inc.
`5750 NW, Pacific Rim Blvd., Camas, WA, all pages, 2001.
`Reddy, Martin; Leclerc, Yvan G. et al.; Modeling the Digital Earth
`in VRML, SRI International, 333 Ravenswood Ave., Menlo Park,
`CA 94025, all pages, 2000.
`Hoppe, Hugues; Eflicient Implementation of Progressive Meshes.
`Jan. 1998, Technical Report MSR-TR-98-02., Microsoft Research,
`Microsoft Corporation, One Microsoft Way, Redmond, WA 98052,
`all pages.
`Gross, Markus H.; Staadt, Oliver G.; Gatti, Roger; Efiicient Trian-
`gular Surface Approximations using Wavelets and Quadtree Data
`Structures. Reprint: IEEE Transactions on Visualization and Com-
`puter Graphics, vol. 2, No. 2, Jun. 1996, pp. 130-143.
`Barnell, Brad; ArcView 3D Analyst Used in Virtual Reality Models.
`http://web.archive.org/web/19990302022552/http://www.esri.com/
`news/arcnews/summer98articles/03-av3dana1yst.html, Aug.
`7,
`1998, Environmental Systems Research Institute, Inc.
`
`Microsoft Corp. Exhibit 1001
`
`Microsoft Corp. Exhibit 1001
`
`

`

`US 9,641,644 132
`
`Page 5
`
`(56)
`
`References Cited
`OTHER PUBLICATIONS
`
`Ormsby, Tim and Alvi, Jonell; Extending ArcView GIS, 1993, ESRI
`Press, all pages.
`Gang, Chen; Gang, Wan; Zhiqiang, Wu; An Integrated Global
`Visual Simulation System Based on Map Data, Chen Gang, Wan
`Gang and Wu Zhiqiang, Department of Cartography, Institute of
`Surveying and Mapping, 66 Longhai Road, Zhengzhou 450052,
`PR. China, all pages, 2001.
`Falby, John S.; Zyda, Michael J.; Pratt, David R.; Mackey, Randy
`L; NPSNET: Hierarchical Data Structures for Real-Time Three-
`Dimensional Visual Simulation. In Computer & Graphics, vol. 17,
`No. 1, pp. 65-69; John S. Falby et al., Naval Postgraduate School,
`Code CSZk, Dept. of Computer Science, Monterey, CA 93943-
`5100, all pages, 1993.
`Breslin, Pat; Frunzi, Nick; Napolean, Eileen; Ormsby, Tim; Getting
`to Know ArcView GIsithe geographic information system (GIS)
`for everyoneTM, 1998, ESRI Press, all pages.
`Gonzalez, Agustin José; Abdel-Wahab, Hussein and Wild, J. Chris-
`tian; Scalable and Resilient Application Sharing System for Internet
`Collaboration, Agustin José Gonzalez, Electronic Engineering
`Department, Universidad Técnica Federico Santa Maria, Valparaiso,
`Chile; Hussein Abdel-Wahab and J. Christian Wild, Computer
`Science Department, Old Dominion University, Norfolk, VA, all
`pages.
`Hildebrandt, John; Grigg, Mark; et al.; Dynamic C2 application of
`Imagery and GIS information using backend repositories, John
`Hildebrandt et al., Information Technology Division, Defence Sci-
`ence and Technology Organisation; OSTO C3 Research Centre,
`Fernhill Park, Department of Defence, Canberra Act 2600, Austra-
`lia, all pages.
`Summers, Cathy and Poreca, Matt; Press Release. Launch of
`ImagePumpTM Provides Visually Rich, Interactive Solutions for
`E-Commerce Sites. https://web.archive.org/web/20011203114858/
`http://www.xippix.com/HTML/PressRoom/PressReleases/
`PressReleasesOlhtm, Apr. 3, 2000, Xippix, Inc.
`Furht, Borko; Wang, Yingli; Celli, Joe; Interactive Progressive
`Encoding System for Transmission of Complex Images, Borko
`Furht and Yingli Wang, NSF Multimedia Laboratory, Florida Atlan-
`tic University, Boca Raton, FL 33431; Joe Celli, IBM, Boca Raton,
`FL.
`d’Arnaud, Judea; Declaration of Judea d’Arnaud in Support of
`Petition for Inter Partes Review of US. Pat. No. 7,139,794 B2,
`7,908,343 B2, and 8,924,506 B2. Before the Patent Trial and Appeal
`Board of the USPTO, Microsoft Corporation, Petitioner v Bradium
`Technologies LLC, Patent Owner, May 12, 2014, all pages.
`Lindstrom, Dr. Peter; Declaration of Dr. Peter Lindstrom Regarding
`1997 Article Entitled “An Integrated Global GIS and Visual Simu-
`lation System” Before the Patent Trial and Appeal Board, Jun. 9,
`2015, all pages.
`Carpenter, Charles Randall; Declaration of Charles Randall Car-
`penter Regarding 1997 Article Entitled “An Integrated Global GIS
`and Visual Simulation System” Before the Patent Trial and Appeal
`Board, Jun. 11, 2015, all pages.
`Kaneda, Kazufumi; Kato, Fujiwa; et al.; Three Dimensional Terrain
`Modeling and Display for Environmental Assessment. Computer
`Graphics, vol. 23, No. 3, Jul. 1989, all pages.
`Kennard, Douglas J. and Barrett, William A.; Just-In-Time Brows-
`ing for Digital Images. Proceedings of the Data Compression
`Conference (DCC’01) IEEE, 2001, Douglas J. Kennard and Wil-
`liam A. Barrett, Department of Computer Science, Brigham Young
`University, all pages.
`Pajarola, Renato; Large scale Terrain Visualization using the
`Restricted Quadtree Triangulation, Feb. 1998, Renato Pajarola,
`Eidgenossische Technische Hochschule Zurich (Institute of
`Theorectical Computer Science, ETH, Ziirich, Switzerland, all
`pages.
`To, Danny; Lau, Rynson W.H. and Green, Mark; Ar1 Adaptive
`Multiresolution Method for Progressive Model Transmission,
`Danny To and Rynson W.H. Lau, Department of Computer Science,
`
`City University of Hong Kong, Hong Kong; Mark Green, Depart-
`ment of Computer Science, University of Alberta, Canada, all
`pages, 2001.
`Lemaire, ED. and Jeffreys, Y.; Low-bandwidth telemedicine for
`remote orthotic assessment. Prosthetics and Orthotics International.
`1998. 22. 155-167, E.D. Lemaire andY. Jeffreys, The Rehabilitation
`Centre, Ottawa, Ontario, Canada, all pages.
`Macedonia, Michael R.; Zyda, Michael J.; et al.; NPSNET: A
`Network Software Architecture For Large Scale Virtual Environ-
`ments. In Presence, vol. 3, No. 4, Fall 1994, Michael R. Macedonia,
`et al., Naval Postgraduate School, Department of Computer Sci-
`ence, Monterey, CA 93943-5100, all pages.
`Machiraju, Raghu; Fowler, James E. et al.; EVITA: A Prototype
`System for Eflicient Visualization and Interogation of Terascale
`Datasets, all pages, 2000.
`Ofek, Eyal; Shilat, Erez; et al.; Multiresolution Textures from Image
`Sequences. IEEE Computer Graphics and Application, Mar.-Apr.
`1997, all pages.
`Hoppe, Hugues; View-Dependent Refinement of Progressive
`Meshes, Microsoft Research, all pages, 1997.
`Barclay, Tom; Gray, Jim and Slutz, Don; Microsoft TerraServer: A
`Spatial Data Warehouse. Jun. 1999, Revised Feb. 2000. Technical
`Report MS-TR-99-29, Microsoft Research, Microsoft Corporation,
`One Microsoft Way, Redmond, WA 98052, all pages.
`Asche, Ruediger R.; Multithreading Performance, Jan. 31, 1996,
`Microsoft Developer Network Technology Group, all pages.
`Macedonia, Michael R.; Brutzman, Donald P.; et al.; NPSNET: A
`Multi-plaer 3D Virtual Environment Over the Internet.
`In the
`Proceedings of the ACM-1995 Symposium on Interactive 3D
`Graphics, Apr. 9-12, 1995, Monterey, CA, Naval Postgraduate
`School, Department of Computer Science, Monterey, CA 93943-
`5100, all pages.
`Clarke, Malcolm; Fragos, Aristeides; et al.; Optimum Delivery of
`Telemedicine over Lowe Bandwidth Links, Brunel University, UK,
`all pages, 2000.
`Oskard, David N.; Hong, Tsai-Hong; Shaffer, Clifford A.; Real-
`Time Algorithms and Data Structures for Underwater Mapping.
`IEEE Transactions on Systems, Man, and Cybernetics, vol. 20, No.
`6, Nov/Dec. 1990, pp. 1469-1475, all pages.
`Samet, Hanan and Webber, Robert E.; Storing a Collection of
`Polygons Using Quadtrees. ACM Transactions on Graphics, vol. 4,
`No. 3, Jul. 1985, pp. 182-222., Association for Computing Machin-
`ery.
`Turner, Charles J. and Peterson, Larry L; Image Transfer: Ar1
`End-to-End Design, 1992, Association for Computing Machinery.
`Hoppe, Hugues; Smooth View-Dependent Level-of-Detail Control
`and Its Application to Terrain Rendering, 1998, IEEE, all pages.
`Pearlman, William A.; Trends of Tree-Based, Set-Partitioning Com-
`pression Techniques in Still and Moving Image Systems, Center for
`Next Generation Video, Electrical Computer and System Engineer-
`ing Department, Rensselaer Polytechnic Institute, Troy, NY 12180-
`3590, all pages, 2001.
`Penny, Simon; From A to D and back again: The emerging aesthet-
`ics of Interactive Art, First published in Leonardo Electronic
`Alamanac Apr. 1996 and NextWave catalog, May 1996, Melbourne
`Australia, all pages.
`Hoppe, Hugues; Progressive Meshes, Microsoft Research, all pages,
`1996.
`Potrnesil, M; Maps alive: viewing geospatial information on the
`WWW. Computer Networks and ISDN Systems; Papers from the
`Sixth International World Wide Web Conference,vol. 29, Issue 8-13,
`Sep. 1997, pp. 1327-1342, Elsevier Science B.V.
`Potrnesil, M; Maps alive: viewing geospatial information on the
`WWW. Computer Networks and ISDN Systems 29 (1997)1327-
`1342, Elsevier Science B.V.
`Prandolini, Robert; AU, T. Andrew; et al.; Use of UDP for eflicient
`imagery dissemination, Use of UDP for efficient imagery dissemi-
`nation, all pages, 2000.
`Barclay, Tom; Gray, Jim; et al.; Microsoft Terra Server. Presentation
`slides format, Microsoft, all pages.
`
`Microsoft Corp. Exhibit 1001
`
`Microsoft Corp. Exhibit 1001
`
`

`

`US 9,641,644 132
`
`Page 6
`
`(56)
`
`References Cited
`OTHER PUBLICATIONS
`
`Shaffer, Clifford A.; Samet, Hanan; Nelson, Randal C.; Quilt: a
`geographic information system based on quadtrees. Int. J. Geo-
`graphical Information Systems, 1990, vol. 4, No. 2, 103-131, Taylor
`& Francis Ltd., all pages.
`Rauschenbach, Uwe; The Rectangular Fish Eye View as an Eflicient
`Method for the Transmission and Display of Large Images, Uni-
`versity of Rostock, Computer Science Department, D-18051
`Rostock, Germany, all pages, 1999.
`Geisler, Wilson S. and Perry, Jeffrey S.; A real-time foveated
`multiresolution system for low-bandwidth video communication,
`Center for Vision and Image Sciences, University of Texas, Austin,
`TX 78712, all pages, 1998.
`Zhang, Jianguo; Stahl, Johannes N.; et al.; Real-Time Teleconsulta-
`tion with High-Resolution and Large-Volume Medical Images for
`Collaborative Healthcare. IEEE Transactions on Information Tech-
`nology in Biomedicine, vol. 4, No. 2, Jun. 2000, all pages.
`Fox, Armando and Brewer, Eric A.; Reducing WWW Latency and
`Bandwidth Requirements by Real-Time Distillation. Fifth Interna-
`tional World Wide Web Conference, May 6-10, 1996, Paris, France,
`University of California, Berkeley, all pages.
`Samet, Hanan; Webber, Robert B; Data Structures. Hierarchical
`Data Structures and Algorithms for Computer Graphics, Part I:
`Fundamentals. IEEE Computer Graphics & Applications, 1988,
`IEEE Xplore® Digital Library, all pages.
`Schneider, Bengt-Olaf and Martin, Ioana M.; An adaptive frame-
`work for 3D graphics over networks. Computers & Graphics 23
`(1999) 867-874, Elsevier Science Ltd., all pages.
`Sethuraman, Sriram; Siegel, M.W.;
`Jordan, Angel G.; A
`multiresolutional region based segmentation scheme for stereo-
`scopic image compression. Published in SPIE vol. 24197Digital
`Video CompressioniAlgorithms and technologies in 1995, Sriram
`Sethuraman et al., Department of Electrical and Computer Engi-
`neering, The Robotics Insstitute, School of Computer Science,
`Carnegie Mellon University, Pittsburgh, PA 15213, all pages.
`Shum, Heung-Yeung; Szeliski, Richard; et al.; Interactive 3D Mod-
`eling from Multiple Images Using Scene Regularities, Heung-
`Yeung Shum, Ricth Szeliski and P. AnandaniMicrosoft
`Research; Simon Bfler%olumbia University; Mei
`Ilani
`Carnegie Mellon University, all pages, 1998.
`Slowe, Thomas E. and Marsic, Ivan; Saliency-Based Visual Rep-
`resentation for Compresion., 1997, Thomas E. Slowe, The Media
`Laboratory, Massachusetts Institute of Technology, Cambridge,
`MA; Ivan Marsic, CAIP Center, Rutgers University, Piscataway, NJ,
`all pages.
`Woodrow, Edward; Chen, Lei; et al.; SPIN-IT: The PRISM Project
`Network Protocol for Image Retrieval, Edward Woodrow, Lei Chen
`and Wendi HeinzelmaniUniversity of Rochester;
`Sundar
`Venkataraman, Charles Judice and Joseph WilderiRutgers Uni-
`versity, all pages, 2002.
`Basu, Anup and Cheng, Irene; Super High Resolution 3D Imaging
`and Efficient Vi