`
`A]bw
`
`IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`REQUEST FOR FILING A PROVISIONAL APPLICATION FOR PATENT
`UNDER 37 CFR §1.53 (c)
`
`| Levanon
`
`| )
`
`1.
`
`| Isaac
`
`OF DATA PACKETS STREAMED OVER LIMITED AND NARROWBAND COMMUNICATION CHANNELS
`ENCLOSED APPLICATION PARTS (checkall that apply)
`
`EL 661 534 257 US Address To:_Box Provisional Application, Assistant Commissioner for Patents, Washington, DC 2023]
`
`INVENTOR(S)
`| 3 Nachal Besor St., Ramat Hasharn,Israel
`|
`
`Lavi
`
`21 BarIlan St., Raanana,Israel
`
`TITLE OF THE INVENTION
`
`OPTIMIZATION OF IMAGE PARCELSIZE FOR FAST QUALITY BUILD-UP
`
`Direct all correspondence to Customer Number 23488. yA
`X
`Gerald B. Rosenberg, Esq.
`(Reg No.: 30,320)
`Telephone:
`650.325.2100
`23488
`I{ NewTechLaw
`Facsimile:
`650.325.2107
`PATENT TRADEMARK OFFICE
`285 Hamilton Avenue, Suite 520
`Palo Alto, California 94301
`
`Specification
`
`No. of pages:
`
`Drawings
`
`Declaration
`
`No. of sheets:
`
`Other: Return-Receipt Post Card
`
`é
`
`3
`
`_____
`
`Small Entity Statement
`
`___—
`
`Powerof Attorney
`
`____ Assignment and Cover Sheet
`
`METHOD OF PAYMENT OF FILING FEES FOR THIS PROVISIONAL APPLICATION FOR PATENT
`
`;
`
`i] Provisional Basic Filing Fee: $ 150.00 (Small Entity: $75.00)
`
`Filing Fee Amount: $ 150.00
`
`X_
`
`X
`
`Acheck is enclosed to cover the Filing Fees.
`
`The Commissioner is hereby authorized charge Filing Fees or credit any
`overpayment to: Deposit Account Number: 50-0890.
`
`This invention was not made by or under contract with a US Governmentagency.
`
`US Government agency and Contract:
`
`Gerald B. Rosenberg
`Reg. No.: 30,320
`
`Date: December 26, 2000
`
`plication Docket No:
`
`FLVT3000
`
`Express Mail Label No.:
`
`gbr/flvt'3000 002 prov xmuttal wpd
`
`1 of 12
`
`Microsoft Corp. Exhibit 1070
`
`
`
`Old‘s'nzZs6°F
`
`N—r
`—D
`
`—a
`
`n
`—li
`o
`ao
`
`
`
`1 of 12
`
`Microsoft Corp. Exhibit 1070
`
`
`
`OMANAOORWN—
`
`
`
`
`OPTIMIZATION OF IMAGE PARCELSIZE FOR
`FAST QUALITY BUILD-UP OF DATA PACKETS
`STREAMED OVER LIMITED AND
`NARROWBAND COMMUNICATION
`CHANNELS
`
`Inventors:
`Isaac Levanon
`Yoni Lavi
`
`Background of the Invention
`The presentinvention is generally related to the delivery of high-resolution
`highly featured graphic images overlimited and narrowband communications
`channels.
`
`Summary of the Invention
`Theobjectiveis to display a two-dimensionalpixel map, a16-Bit RGBcolor
`imagein the preferred embodiments, of very large dimensions and permitting the
`viewing of the image from a dynamicthree-dimensional viewpoint. Multiple such
`
`Attorney Docket No.: FLVT3000
`gbr/flvt/3000.000.provisional.wpd
`
`12/26/2000
`
`2 of 12
`
`Microsoft Corp. Exhibit 1070
`
`2 of 12
`
`Microsoft Corp. Exhibit 1070
`
`
`
`OoOONOWOOF&FWDNY—-
`
`1]
`
`12
`
`13
`
`14
`
`15
`
`16
`17
`
`18
`
`19
`
`20
`
`2]
`
`22
`
`23
`
`24
`
`-2-
`
`images are remotely hosted for on-demandselection and transfer to a client
`
`system for viewing.
`
`Images, as stored bythe server, may individually range from gigabytes to
`
`multiple terabyte in total size. A correspondingly large server storage and
`
`processing system is contemplated. Conversely, client systems are contemplated
`
`to be conventional personal computersystems and,in particular, mobile,cellular,
`
`embedded, and handheld computer systems, such as personal digital assistants
`
`(PDAs) and internet-capable digital phones, with relatively limited to highly
`
`constrained network communications capabilities. For most wireless applications,
`
`conventional narrowband communicationslinks have a bandwidth ofless than
`
`approximately three kilobytes of data per second. Consequently, transmittal of
`
`entire images to a client system in reasonable time is infeasible as a practical
`
`matter.
`
`Description of the Invention
`
`For purposes of the present invention, each image (Figure 1) is at least
`logically defined in terms of multiple grids of image parcels with various levels of
`
`resolutions (Figure 2) that are created through composition of information from
`
`all level of resolutions, and stored by the server to provide an imagefortransfer
`
`to a client system (Figure 3). Composed and separate static and dynamically
`
`created layers are transferred to client system in parcels in a program selectable
`
`order to optimize for fast quality build-up of the image presented to a userof the
`
`client system, particularly when the parcels are streamed over a narrowband
`
`communication link.
`
`
`
`
`Attorney Docket No.: FLVT3000
`gbr/flvt/3000.000.provisional.wed
`
`12/26/2000
`
`3 of 12
`
`Microsoft Corp. Exhibit 1070
`
`3 of 12
`
`Microsoft Corp. Exhibit 1070
`
`
`
`3.
`
`The multiple layers of an image allow the selectivity to incorporate
`topographical, geographical, orientational, and other terrain and mapping
`related information into the image delivered. Other layers, such as geographic
`grids, graphicaltext overlays, and hyperlink selection areas, separately provided
`or composed, aid in the useful presentation and navigation of the image as
`presented by the client system and viewed bythe user.
`Compositing of layers on the server enables the data transfer burden to be
`reduced, particularly in analysis of the requirements and capabilities of the client
`system andthe connecting communicationslink. Separate transfer of layers to the
`client system allows the client system selectivity in managing and presentation of
`the data to the user.
`The system and methods of the present invention are designed to, on
`demand, select, process and immediately transfer data parcels to the client
`system, which immediately processes anddisplays a low-detail representation of
`the image requested by the client system. The system and methods immediately
`continueto select, process and sequentially transfer data parcels that, in turn, are
`processed and displayed by the client system to augment the presented image
`and thereby provide a continuously improving image to the user.
`Selection of the sequentially transferred data is, in part, dependent on the
`progressive translation of the three-dimensional viewpoint as dynamically
`modified on the client system during the transfer process. This achieves the
`above-stated objective while concurrently achieving a good rendering quality for
`continuousfly-overof the imageasfast as possible, yet continuously building the
`image quality to the highest resolution of the image as stored by the server.
`
`] 2 3 4 5 6
`
`7 8 9
`
`0]
`im
`12
`13
`14
`15
`16
`17
`18
`19
`20
`21
`22
`23
`24
`
`
`
`bs
`
`Attorney Docket No.: FLVT3000
`gbr/flvt/3000.000.provisional.wpd
`
`12/26/2000
`
`4 of 12
`
`Microsoft Corp. Exhibit 1070
`
`4 of 12
`
`Microsoft Corp. Exhibit 1070
`
`
`
`]
`2
`3
`4
`5
`6
`7
`8
`9
`10
`11
`12
`13
`14
`15
`16
`17
`
`
` 18
`
`19
`20
`21
`22
`23
`24
`
`-4-
`
`limited and narrowband
`To optimize image quality build-up over
`communication links, the target image, as requested by the client system,is
`represented by multiple grids of 64x64 imagepixels (Figure 4) with each grid
`having some corresponding level of detail. That is, each grid is treated as a
`sparse data array that can be progressively revised to increase the resolution of
`the grid and therebythe level of detail presented by the grid. The reason for
`choosing the 64x64 pixel dimensionis that, using current image compression
`algorithms, a 16-bit 64x64 pixel array image can be presented as a 2KByte data
`parcel.
`In turn, this 2KByte parcel is the optimal size, subject to conventional
`protocol and overhead requirements, to be transmitted through a 3KByte per
`second narrowband transmission channel. Using a smaller image array, such as
`32x32, would create a 0.5KByte parcel, hence causinginefficiencies due to packet
`transmission overhead, given the nature of current wireless communications
`protocols.
`Image array dimensionsare preferably powers of two so that they can be
`used in texture mappingefficiently. Each parcel, as received by the client system,
`is preferably immediately processed and incorporated into the presented image.
`To do so efficiently, according to the present invention, each data parcel
`is
`independenily processable by the client system, which is enabled bythe selection
`and server-side processing used to prepare a parcelfor transmission.
`In addition,
`each data parcelis sized appropriate to fit within the level-1 cache, or equivalent,
`of the client system processor, thereby enable the data processing intensive
`operations neededto process the data parcel to be performed without extended
`memory access delays.
`In the preferred embodiment of the present invention,
`
`Attorney Docket No.: FLVT3000
`gbr/flvt/3000.000.provisional.wpd
`
`12/26/2000
`
`5 of 12
`
`Microsoft Corp. Exhibit 1070
`
`5 of 12
`
`Microsoft Corp. Exhibit 1070
`
`
`
`-5-
`
`data parcels are also processed for texture mapping and other image features,
`such as topographical detailing.
`Currently, with regard to conventionalclient systems, a larger imagearray,
`such as 128x128,is too large to befully placed within the level-1 cache of many
`of the smaller conventional current processors, such as used by personal digital
`assistants (PDAs) and cellular phones.
`Since access to cache memory is
`substantially faster than to RAM this will likely result in lower framerate.
`Different and larger data parcel sizes may be optimal as transmission
`protocols and micro-architectures of the client computers change. For purposes
`above, the data content wasa pixel array representing image data. Where the
`data parcel contentis vector, text or other data that may subject to different client
`system design factors, other parcel sizes may be used.
`In the process implemented bythe presentinvention, data parcels maybe
`selected for sequential transmission based on a prioritization of the importance
`of the data contained. Thecriteria of importance maybe defined assuitable for
`particular applications and may directly relate to the presentation of image
`quality, provision of a textual overlay of a low-quality image to quickly provide a
`navigational orientation, or the addition of topography information at a rate or
`timing different from the rate of image quality improvement. Thus, image data
`layers reflecting navigational cues,
`text overlays, and topography can be
`composed into data packets for transmission subjectto prioritizations set by the
`server alone, based onthe nature and type ofthe client system, andinteractively
`influenced by the actions and commandsprovidedby the user of the client system
`
`(Figure 5).
`
`1
`2
`3
`4
`5
`6
`7
`8
`9
`10
`11
`12
`13
`14
`15
`16
`17
`18
`19
`20
`21
`22
`23
`
`24
`
`
`
`
`=
`
`Attorney Docket No.: FLVT3000
`gbr/flvi/3000.000.provisional.wpd
`
`12/26/2000
`
`6 of 12
`
`Microsoft Corp. Exhibit 1070|NN
`
`6 of 12
`
`Microsoft Corp. Exhibit 1070
`
`
`
`-6-
`
`Progressive transmission of image parcels is performed in an iterative
`processinvolving selection of an image data grid within the target image of the
`client system, whichis a portion of a potentially multi-layered source imagestored
`by the server. The selection parameters are preferably dependenton the client
`navigation viewpoint, effective velocity, and height, and the effective level of detail
`currently presented in each grid. Once a grid is selected, the server selects the
`source data to be logically composed into the selected grid to complement the
`effective resolution of that grid, processing the grid data to produce the optimally
`sized size grid data parcels, and sequentially transmitting the parcels to the client
`system. Preferably, the detail of a grid array is sequentially enhancedby division
`of the grid into sub-grids related by a poweroftwo (Figure6). Thus, a given grid
`is preferably updated using four data parcels having twice the data resolution of
`the existing grid. Whatever numberof parcels are used, each data parcel is
`rendered by the client system into the target image. Additional client system
`image data processing to providetexturing and three-dimensional representation
`of the data may be performedas part of the parcel rendering and integration into
`
`the target image.
`
`]
`
`2 3 4 5
`
`6
`7
`8
`9
`10
`1]
`12
`13
`14
`15
`16
`
` 17
`
`Attorney Docket No.: FLVT3000
`gbr/flvt/3000.000.provisional.wpd
`
`12/26/2000
`
`7 of 12
`
`Microsoft Corp. Exhibit 1070
`
`7 of 12
`
`Microsoft Corp. Exhibit 1070
`
`
`
`i/s
`
`
`
`sjexidpaywijuy
`
`GINpopujun
`
`eve
`
`
`
`1x9}Jo}J8AR]pearydeis
`
`
`
`‘4‘Sdd‘GIES
`
`sjuewejegepuegz
`
`ty
`Spe
`om
`pe
`Ywe
`gt
`
`PHS)~~s1ydesBoe5
`
`aAl}edsiod
`
`XISUJIMQe
`
`josooiBep
`
`woOpeal
`
`SJEUILUIO|S[IQOINUlQZ
`
`8 of 12
`
`Microsoft Corp. Exhibit 1070
`
`8 of 12
`
`Microsoft Corp. Exhibit 1070
`
`
`
`
`
`
`
`FIG.2
`
`9 of 12
`
`Microsoft Corp. Exhibit 1070
`
`9 of 12
`
`Microsoft Corp. Exhibit 1070
`
`
`
`3/5
`
`64
`
`64
`
`64
`
`64
`
`
`
`64
`
`64
`
`«64
`
`64
`
`FIG. 4
`
`10 of 12
`
`Microsoft Corp. Exhibit 1070
`
`10 of 12
`
`Microsoft Corp. Exhibit 1070
`
`
`
`4)s
`
`
`
`
`FIG.5
`
`11 of 12
`
`Microsoft Corp. Exhibit 1070
`
`11 of 12
`
`Microsoft Corp. Exhibit 1070
`
`
`
`S/S
`
`(
`
`\O
`
`O— L
`
`L,
`
`.\
`
`O
`
`.\
`
`O
`
`|\
`
`O
`
`3
`
`
`
`a,
`
`12 of 12
`
`Microsoft Corp. Exhibit 1070
`
`12 of 12
`
`Microsoft Corp. Exhibit 1070
`
`