WORLD INTELLECTUAL PROPERTY ORGANIZATION
`International Bureau
`
`
`
`INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT)
`
`(51) International Patent Classification 5 =
`H L
`04
`
`(11) International Publication Number:
`
`WO 97/31445
`
`(43) International Publication Date:
`
`28 August 1997 (28.08.97)
`
`(21) International Application Number:
`
`PCT/IB97/00573
`
`(22) International Filing Date:
`
`6 February 1997 (O6.02.97)
`
`(30) Priority Data:
`08/594,890
`
`9 February 1996 (O9.02.96)
`
`US
`
`(71) Applicant: GEO INTERACTIVE MEDIA GROUP, LTD.
`[IL/IL];
`I Corazin Street, 53583 Givataim (IL).
`
`(81) Designated States: AL, AM, AT, AU, AZ, BA, BB, BG, BR,
`BY, CA, CH, CN, CU, CZ, DE, DK, EE, ES, FI, GB, GE,
`I-IU, IL, IS, JP, KE, KG, KP, KR, KZ, LC, LK, LR, LS,
`LT, LU, LV, MD, MG, MK, MN, MW, MX, NO, NZ, PL,
`PT, RO, RU, SD, SE, SG, SI, SK, TJ, TM, ’I‘R, Tl“, UA,
`UG, UZ, VN, ARIPO patent (KE, LS, MW, SD, SZ, UG),
`Eurasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM),
`European patent (AT, BE, CH, DE, DK, ES, FI, FR, GB,
`GR, IE, IT, LU, MC, NL, PT, SE), OAPI patent (BF, B],
`CF, CG, CI, CM, GA, GN, ML, MR, NE, SN, TD, TG).
`
`(72) Inventors: CARMEL, Sharon; 25 Kakal Street, 53224 Gi- Published
`vataim (IL). DABOOSH, Tzur, 236 Derech Ben Gurion,
`Without international search report and to be republished
`53326 Givataim (IL). REIFMAN, Eli;
`I9 Nordoi Street,
`upon receipt of that report.
`75265 Rishon Lezion (IL). SHANI, Naftali; 6 Hamishna
`Street, 62917 Tel Aviv (IL).
`
`Saving Anlntlen I-‘Ila
`
`(54) Title: METHOD AND SYSTEM OF BUILDING AND TRANSMI'I'I'ING A DATA FILE FOR REAL TIME PLAY OF
`MULTIMEDIA, PARTICULARLY ANIMATION, AND A DATA FILE FOR REAL TIME PLAY OF MULTIMEDIA
`APPLICATIONS
`
`(57) Abstract
`
`A compressed data file for real
`time display of multimedia applica-
`tions, e.g., animation, (51) on a net-
`work (11) is disclosed. The file in-
`cludes general
`information about
`the
`animation. Also included in the file are
`complete segment blocks of informa-
`tion (65, 67) representing single frames
`in the animation. Each frame is made
`up of multiple images (layers) which
`are overlapped. Each image is made
`up of vector objects. Display of the
`tile is conducted through asynchronous
`transfer of data so that as a frame is
`displayed, the next frame is transmitted
`and received by an end user for imme-
`drate display.
`
`‘
`
`,3,
`
`/
`
`-
`Inn" Dh:¥;:::,:l:,:,'. whd“
`
`Prime Creation by (inning and
`POIMOMII llnlln III Stile Wild“
`
`“mm”
`1) Ii‘:-nine by Frame
`2) In Bctwunlng
`
`Applying Inks
`
`Page 1 of 33
`
`HTC EXHIBIT 1024
`
`HTC EXHIBIT 1024
`
`Page 1 of 33
`
`

`

`FOR THE PURPOSES OF INFORMATION ONLY
`
`Codes used to identify States party to the PCI‘ on the front pages of pamphlets publishing international
`applications under the PCT.
`
`AM
`AT
`AU
`BB
`BE
`BF
`BC
`8.1
`BR
`BY
`CA
`CF
`
`Armenia
`Austria
`Australia
`Barbados
`Belgium
`Burkina Faao
`Bulgaria
`Benin
`Brazil
`Belarus
`Canada
`Central African Republic
`Congo
`Switzerland
`C614: d'Ivoire
`Cameroon
`China
`Czechoslovakia
`Czech Republic
`Germany
`Denmark
`Estonia
`Spain
`Finland
`France
`Gabon
`
`United Kingdom
`Georgia
`Guinea
`Greece
`Hungary
`Ireland
`Italy
`Japan
`Kenya
`Kyrgystan
`Democratic People's Republic
`of Korea
`Republic of Korea
`Kazakhstan
`Liechtenstein
`Sri Lanka
`Liberia
`Lithuania
`Luxembourg
`Latvia
`Monaco
`Republic of Moldova
`Madagascar
`Mali
`Mongolia
`Mauritania
`
`Malawi
`Mexico
`Niger
`Netherlands
`Norway
`New Zealand
`Poland
`Portugal
`Romania
`Russian Federation
`Sudan
`Sweden
`Singapore
`Slovenia
`Slovakia
`Senegal
`Swaziland
`Chad
`Togo
`Tajikistan
`Trinidad and Tobago
`Ukraine
`Uganda
`United States of America
`Uzbekistan
`Viet Nam
`
`Page 2 of 33
`
`Page 2 of 33
`
`

`

`W0 97/31 445
`
`PCT/IB97/00573
`
`METHOD AND SYSTEM OF BUILDING AND TRANSMITTING
`A DATA FILE FOR REAL TIME PLAY OF MULTIMEDIA,
`PARTICULARLY ANIMATION, AND A DATA FILE FOR REAL
`TIME PLAY OF MULTIMEDIA APPLICATIONS
`
`TE
`
`I
`
`L IE
`
`This invention relates to a method and system for building data
`
`files for transmission over a network for display to an end user in real
`
`time. More particularly, the invention relates to such a file and system
`
`for use on a network which is more commonly known as global
`
`computer networks connected by common protocols, such as the
`network known by the term "Internet.” The data transmitted,
`in
`
`accordance with the invention, is transmitted using an asynchronous
`
`transfer of data through the existing transfer of data protocol of the
`
`network, which in the case of the Internet, such a transfer protocol, is
`
`known as an FTP, i.e., file transfer protocol.
`
`5
`
`10
`
`l5
`
`20
`
`25
`
`30
`
`35
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 3 of 33
`
`Page 3 of 33
`
`

`

`W0 97/31445
`
`PCTIIB97/00573
`
` BI
`
`The invention relates to a method of building data files, the data
`
`files built, and the transfer of data from such files for the purposes of
`
`delivering real time animation to an end user, and the real time display
`
`to an end user, over a network, particularly global computer networks
`
`connected by common protocols, such as the Internet.
`
`For purposes of this disclosure, by the term ”network” is meant
`
`at least two computers connected through a physical communication
`
`10
`
`line which can be hardwired, or virtual, such as satellite or other
`
`wireless communications. A computer can mean a personal computer,
`
`server, or other similar-type device capable of receiving, transmitting,
`
`and / or manipulating data for such purposes as, but not limited to,
`
`display on a display unit connected thereto.
`
`15
`
`Presently there are no standards for real time transmission and
`
`display of multimedia programs and / or applications on such global
`
`computer networks such as the Internet. The reason why such real time
`
`transmissions and displays are not possible, is that the data transfer rates
`
`necessary for multimedia applications are measured in 50 to 110
`
`20
`
`kilobytes per second, whereas the average data transfer lines in such
`
`networks, for an end user having a 14.4 b.p.s. modem, can only handle
`
`a maximum of 1
`
`to 1.5 kilobytes per second. Thus, real
`
`time
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 4 of 33
`
`Page 4 of 33
`
`

`

`WO 97/31445
`
`PCT/IB97I00573
`
`-3-
`
`transmission and display of multimedia applications, such as animation,
`
`is impossible because of the physical limitations of existing wiring when
`
`considering present-day modem compression techniques.
`
`Thus, the present invention avoids the limitations of the prior art
`
`and provides a system, data format, and method of conveying and
`
`operating on data over a network to provide real time multimedia play,
`
`including display, particularly, a real time display of animation.
`
`10
`
`In one aspect,
`
`the invention is directed to storage media
`
`DI C
`
`F INV
`
`N
`
`containing data for playing multimedia applications, particularly for
`
`display of animation. The storage media includes a first block of data
`
`made up of general information for an entire animation file. A plurality
`of segment information blocks make up the rest of the data for
`
`15
`
`displaying the animation.
`
`Each segment information block is made up of a first and a
`
`second section. The first section of the segment information block
`
`includes general information data about a segment, including data
`
`identifying the frame identification for the respective segment, and data
`
`20
`
`identifying the number of layers in the frame. The first section also
`
`includes data making up information about each layer in the frame,
`
`including data identifying the layer identification for the respective
`
`frame, data identifying the image, data defining the placement of the
`
`layer on the frame, and ink data.
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 5 of 33
`
`Page 5 of 33
`
`

`

`W0 97I3l445
`
`PCT/[B97/00573
`
`-4-
`
`The second section is made up of image data, for each image in
`
`a frame, and includes image identification data, background color data,
`
`width and height of image data, and data identifying the number of
`
`objects in the respective image. The second section also includes object
`
`data for each object, which is made up of identification of object-type
`
`data, enclosing rectangle data, fill-in background and foreground data,
`
`fill-pattern data, pen-pattem data, line-size data, and ink data.
`
`In another aspect, the invention is directed to a method of
`
`building a data file for use in displaying real time animation. The
`
`10
`
`method includes the steps of building images by storing of vector objects
`
`in an image data file. The built images are displayed in windows as
`
`"thumbnails/’ hereinafter defined. The respective frames of the
`
`animation are built by positioning images in a stage window for each
`
`frame. A time line is then defined for the frames by at least one of: 1)
`
`15
`
`sequentially arranging the frames; or 2) for frames having a common
`
`image, constructing a start frame and an end frame using the common
`
`image, leaving (1- n) empty frames between the defined start and end
`
`frame, and using a predetermined function, as will be readily apparent
`
`to those skilled in the art, to create the remaining frames from the empty
`
`20
`
`frames, from the common image. This is known as an ”in-betweening"
`
`function, as will be readily apparent to those skilled in this art. The
`
`transparency ink for the frame data is then defined, and the data is
`
`stored as animation file for later transmission of the data file and display
`
`of an animation in real time.
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 6 of 33
`
`Page 6 of 33
`
`

`

`W0 97/31445
`
`PCT/IB97/00573
`
`-5-
`
`In yet still another aspect, a method of the invention includes a
`
`method of displaying real
`
`time multimedia data,
`
`in particular,
`
`animation, from data stored on storage media, as previously described.
`
`The method includes the steps of, through asynchronous transmission,
`
`retrieving and storing the first block of data which is comprised of
`
`general information. Retrieving the first segment of information block
`
`of a plurality of segment information blocks, and when a full segment
`
`information block is retrieved, displaying a frame of the animation while
`
`simultaneously retrieving the next segment information block as the
`
`frame of the animation is displayed. These steps are then repeated until
`
`the number of frames in the animation defined in the first block of data
`
`has been retrieved and displayed.
`
`B
`
`IO
`
`WI
`
`The preferred embodiments of this invention will now be
`
`described by way of example, with reference to the drawings
`
`accompanying this specification in which:
`
`l0
`
`15
`
`FIG. 1 is a schematic diagram of a network of the type in which
`
`20
`
`the invention is implemented, particularly global computer networks
`
`connected by common protocols such as the Internet;
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 7 of 33
`
`Page 7 of 33
`
`

`

`W0 97/31445
`
`PCT/IB97/00573
`
`-5-
`
`FIG. 2 illustrates a typical end user computer on which the
`
`multimedia software, particularly animation, in accordance with the
`
`invention, can be operated and displayed;
`
`FIG. 3 illustrates a typical computer and the components thereof
`
`on which the invention can be implemented;
`
`FIG. 4 is a block diagram illustrating a multimedia, specifically,
`
`animation, file formatted in accordance with the invention;
`
`FIGS. 5a and 5b, respectively, illustrate an image paint window,
`
`and a tools window, in accordance with the invention, which are used
`
`for creating the multimedia, i.e., animation, file, in accordance with the
`
`system of the invention;
`
`FIG. 6 is a two-part diagram illustrating how an image window
`
`with image thumbnails created, in accordance with the invention, is
`
`used to create a stage window having numerous objects therein as
`
`images;
`
`FIG. 7 is a time—line window illustrating how the frames and
`
`layers of the animation in accordance with the invention are assembled;
`
`10
`
`15
`
`20
`
`SUBSTITUTE SHEET (RULE 26‘)
`
`Page 8 of 33
`
`Page 8 of 33
`
`

`

`WO 97/31445
`
`PCT/IB97/00573
`
`FIG. 8 illustrates a typical video-panel window which can be used
`
`by an animation creator, using the editor software of the invention, to
`
`review created animation at all times prior to completing creation of an
`
`animation file; and
`
`FIG. 9 is a flow chart illustrating how the system, in accordance
`
`with the invention, can be used to create an animation file.
`
`10
`
`15
`
`T
`
`I G O
`
`I
`
`0
`
`FIG. 1 illustrates a typical network on which the invention can be
`
`implemented. As noted previously, for purposes of this disclosure, the
`
`term ”network” shall mean at least two computers connected for
`
`communications through communication lines which can be hard wired
`
`or virtual, such as satellite communications. In a more preferred form,
`
`the invention is implemented on global computer networks made up of
`
`multiple networks connected by common protocols, such as the network
`
`presently known as the "Internet.” Such a network consists of multiple
`
`computers, including, for example, but not limited to such devices as
`
`servers, and end user computers, such as personal computers, all
`
`20
`
`connected through telephone lines, or other communication links, both
`
`physical and wireless.
`
`As previously explained, in order to achieve a display of real
`
`time, multimedia applications such as animation, average data
`
`transmission rates of S0 to 100 kilobytes per second are required, while
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 9 of 33
`
`Page 9 of 33
`
`

`

`W0 97/31445
`
`PCT/IB97l00573
`
`-3-
`
`current existing telephone lines are only capable of handling 1 to 1.5
`
`kilobytes per second. Thus, achieving real time display of animation
`
`with current data carrying capabilities is impossible.
`
`As illustrated in FIG. 1, a network 11, of the type on which the
`
`invention may be
`
`implemented,
`
`consists of plural
`
`network
`
`interconnections 17, and multiple computers such as servers 13,
`
`identified as servers 13, — 13,, and end user computers, such as computer
`
`15.
`
`A typical end user computer 15, as further illustrated in FIG. 2,
`
`10
`
`will include a main computer unit 19, with peripherals such as a
`
`keyboard 21, mouse 25, and display 23 connected thereto. Computer 19
`
`may be connected by a telephone line 27, either physically or through
`
`wireless connections, to the network interconnections 17 of FIG. 1.
`
`As further illustrated in FIG. 3, the main computer portion 19
`
`15
`
`includes, and this is equally applicable to servers 13 of FIG. 1, typically
`
`a central processing unit 29 connected to random access memory 31 and
`
`read only memory 33. Random access memory 31 is used to download
`
`programs and to operate the computer unit 19, in cooperation with the
`
`central processing unit 29. Read only memory 33 includes certain
`
`20
`
`computer routines configuring how the computer operates such as its
`
`basic input/ output system (BIOS). The computer 15 can also include a
`
`direct access storage device 35, such as a hard drive, as well as a
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 10 of 33
`
`Page 10 of 33
`
`

`

`W0 97/31445
`
`PCTIIB97/00573
`
`-9-
`
`removable storage media drive 37 for floppy discs and/ or CD ROM
`
`applications. A modem 39 serves to connect the computer 19 to the
`
`network 17.
`
`In order to implement the invention, which includes a method of
`
`building a multimedia file, such as an animation file, the animation file
`
`itself and a method of transmitting and using the animation file to
`
`display a real time multimedia application, such as an animation, it
`
`becomes necessary to cut down the information passed through the
`
`network down to the minimum required for display of an animation file
`
`10
`
`on a frame—by-frame basis. Thus, in accordance with the invention, each
`
`complete information unit that is sufficient to display a frame, will be
`
`defined as a "segment” hereafter. By using the techniques of the
`
`invention, data transmission rates can be kept to about no more than 200
`bytes per second, well below current data transmission rate capability
`
`15
`
`limits.
`
`Referring now to FIG. 4, a typical animation file formatted in
`
`accordance with the invention is illustrated.
`
`The animation file,
`
`in accordance with FIG. 4,
`
`is generally
`
`designated with the number 51, and includes a first block of information
`
`20
`
`53. The first block of information which is passed to an end user over
`
`the network through asynchronous FTP, i.e., file transfer protocol, in a
`
`manner which is conventional and well known to those in the art,
`
`contains general
`
`information about
`
`the animation and includes
`
`information about the width 55 and height 57 of the animation display.
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 11 of 33
`
`Page 11 of 33
`
`

`

`WO 97/31445
`
`PCT/lB97/00573
`
`-10-
`
`The width 55 and height 57 information typically consists of no more
`
`than 2 bytes. A record 59 defines the frames per second or rate of
`
`displaying frames and is typically made up of no more than 1 byte.
`
`Record 61 defines the total number of images and makes up no more
`
`than 2 bytes, while record 63 identifies the total number of frames and
`
`makes up no more than 2 bytes.
`
`For purposes of this disclosure, it should be noted that a ”frame"
`
`consists of a complete picture which is displayed as part of a sequence
`
`of multiple frames in the animation. Each frame is made up of layers,
`
`10
`
`and in the present form of the invention, can be up to Slayers, although
`
`it is contemplated, as will be readily apparent to those of ordinary skill
`
`in the art, that up to 200 layers can be provided. The layers can be made
`
`up of images, or can simply be a layer without an image. Thus, when
`
`each layer is an image, then a frame can be made up of up to five images
`
`15
`
`in the current embodiment, and more, as may be apparent to those of
`
`ordinary skill in the art. Each image is itself made up of objects, which,
`
`as explained hereafter, are vector objects consisting of polygons, circles,
`
`or other such shapes.
`
`In accordance with the invention, after an end user receives the
`
`20
`
`general information block, the block is stored by the end user computer
`
`for use during display of the animation. Segment blocks are then
`
`transmitted to the end user. As noted, each complete information unit
`
`that will be used to display a frame is, for purposes of this disclosure,
`
`called a segment.
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 12 of 33
`
`Page 12 of 33
`
`

`

`W0 97/31445
`
`PCT/IB97/00573
`
`-1]-
`
`Thus, in operation, after receiving the general information block
`
`53, an end user then receives segment blocks coming sequentially, one
`
`after each _other, until the end of the animation. The advantage of
`
`knowing from the general information block 53 the total number of
`
`frames in animation, is that a delimiter need not be set after each
`
`complete segment is received in order to terminate the program after a
`
`predetermined number of segments count has been reached.
`
`In order to know when a full segment has been loaded that can
`
`be displayed, two bytes are transmitted before each segment to identify
`
`the length of the segment. This segment information is part of segment
`
`information section 65 and is identified as frame identification
`
`information 69. In this manner, time is saved as the system need not
`
`check, with conditional code, each and every byte for a segment
`
`delimiter, but instead, a predetermined amount of data is read initially
`
`in advance. Thus, upon receiving a complete segment information, a
`
`subroutine is executed at the end user to display the specific frame
`
`received on the screen. Simultaneously, the next segment is being
`
`transmitted through an asynchronous FTP.
`
`10
`
`15
`
`As previously discussed, each segment is constructed as two
`
`20
`
`sections. Section one is the general segment information section 65 and
`
`includes the previously discussed frame identification (ID) information
`
`69; made up of up to 2 bytes, and information 71 identifying the number
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 13 of 33
`
`Page 13 of 33
`
`

`

`W0 97/31445
`
`PCT/IB97/00573
`
`-12..
`
`of layers, and making up approximately 1 byte of information. Layer
`
`information is also provided in the form of layer information blocks 73] -
`
`73“, with each layer information box 73 providing a layer identification
`
`(ID) number. In this regard, the layer identification (ID) number will be
`
`0 if the layer is identical to the previous one.
`
`If the layer is not identical to the previous one, then the layer
`
`identification (ID) will be made up of 1 byte. A mode identification (ID),
`
`which is reserved for implementing interactivity functions, consists of
`
`1 byte, and an image identification (ID) used to identify a particular
`
`10
`
`image, and consisting of up to 2 bytes of information, is also provided.
`
`The X,Y locations of the particular layer are also provided in the form of
`
`X and Y coordinates and is made up of general information of up to 4
`
`bytes, and ink information for the layer, made up of up to 1 byte, is also
`
`provided.
`
`15
`
`The second segment information section 67 provides general
`
`image information and includes a first block 75 which includes the
`
`image identification (ID), which is made up of up to 2 bytes, background
`
`color which is made of up to 1 byte, width and height information which
`
`is made up of up to 2 bytes, and number of objects in the image which
`
`20
`
`is made up of up to 1 byte.
`
`There can be up to 255 objects in an image and object information
`
`is p'assed in the form of blocks 771-77“. Each object block 77 includes a
`
`definition of the object type, for example, whether the object is a
`
`rectangle or circle, and this information is made up of up to 1 byte. A
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 14 of 33
`
`Page 14 of 33
`
`

`

`W0 97/314115
`
`PCT/IB97/00573
`
`-13-
`
`definition of an enclosing rectangle for the object, i.e., the minimum size
`
`rectangle within which a particular object can be fit, made up of up to 4
`
`bytes, is also provided. In addition, the fill-in color information for the
`
`foreground and the background is provided and is made up of up to 2
`
`bytes. The pen color for the foreground and the background is also
`
`provided and each is made up of up to 2 bytes. The fill pattern, as well
`
`as the pen pattern is also provided, each respectively made up of up to
`
`1 byte. Finally, line size and pixel information, making up to 1 byte
`
`each, is also provided as well as ink information, making up to 1 byte,
`
`l0
`
`for a total of 13 bytes per object.
`
`In addition to the object information, optional special information
`
`can be provided such as a sequence of X and Y coordinates for polygonal
`
`shapes, if any. Other types of special information includes "center / X
`
`radius, Y-radius” information if the object is a circle, or ”center plus start
`
`angle and end angle” information if the object is an arch. In addition,
`
`text information, including color, size, font, alignment, and text itself,
`
`can also be provided.
`
`It will be appreciated by those of ordinary skill in the art that the
`
`animation file,
`
`in accordance with the invention, can be further
`
`compressed to accommodate both sound and interactivity functions.
`
`Specifically, further compression of data, once the basic concept
`
`described above is known, can be achieved by currently available
`
`15
`
`20
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 15 of 33
`
`Page 15 of 33
`
`

`

`WO 97/31445
`
`PCTIIB97/00573
`
`-14-
`
`character and ASCII compression techniques using conventional pattern
`
`recognition. By achieving such a compression, sound can then be
`
`provided with the animation file.
`
`Sound data, as is readily apparent, is the same as animation data
`
`in that it is pure digital data. Thus, to provide sound capabilities with
`
`the compressed data format of the invention, conventional sound
`
`transmission techniques, such as those currently commercially available
`
`from Real Audio Co., can be displayed.
`
`In addition, interactivity can be provided in the system. This is
`
`10
`
`done by modifying the architecture to accept inputs such as a clicking on
`
`a mouse, or after a period of time has expired. The software resident at
`
`the end user computer can be modified to define ”hot” areas on a screen
`
`so that, e.g., when a user with a mouse clicks on the hot area, the
`
`asynchronous transmission is terminated and diverted to another
`
`15
`
`asynchronous activity.
`
`An example of such an interactivity change may involve clicking
`
`on a game character to shoot another game character. If a bullet hits the
`
`other game character, the file transfer is aborted and a new transfer may
`
`commence showing the character hit by the bullet and falling.
`
`20
`
`Having described the general format of an animation file, created
`
`in accordance with the process of the invention, the following describes
`
`how such a file is to be built. Specifically, reference is made to FIGS. 5a
`
`and 5b. FIG. 5a illustrates, in schematic form, an image paint window.
`
`FIG. 5b illustrates a tools window, implemented in accordance with the
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 16 of 33
`
`Page 16 of 33
`
`

`

`WO 97/31445
`
`PCT/IB97/00573
`
`-15-
`
`editor program of the invention, which allows construction of an
`
`animation file.
`
`In accordance with the process employed by the editor program
`
`of the invention, an image paint window 91 is set up on a computer
`
`display on which the animation is being built. A person using the editor
`
`draws an image in the image window 91. The image is constructed out
`
`of vector objects 93 and 95, for example, a polygon and a circle. This is
`
`done by using conventional vector drawing tools and functions from the
`
`tool window 97 of FIG. Sb, as illustrated, for example, by tool function
`
`line 99, circle 101, and rotate 103, as will be readily apparent to one of
`
`ordinary skill in the art.
`
`In implementing the editor of the invention, it will be apparent to
`
`those of ordinary skill in the art that there are currently over seventy
`conventional vector tools and functions readily available for creating
`
`drawings, such as a line, rectangle, circle, polygon, etc. Additional
`
`functions such as rotation, distortion, etc. can be applied to the vector
`
`objects in a conventional manner. The objects are generated in an
`
`overlay environment. As such, the objects can be shuffled back and
`
`forth with respect to each other to create different overlays and
`
`10
`
`15
`
`20
`
`overlapping effects.
`
`After the image is completed, it is stored as a single unit. As such,
`
`the objects constructed cannot be individually manipulated during the
`
`animation, and they form a fixed portion of the image.
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 17 of 33
`
`Page 17 of 33
`
`

`

`W0 97/31445
`
`PCT/lB97I00573
`
`-15-
`
`FIG. 6 illustrates construction of a stage window from images
`
`which have been created and are displayed on an image window. The
`
`image window 111 displays images 113—119 as image thumbnails, i.e., as
`
`captioned thumbnails, as will be readily apparent to those of ordinary
`
`skill in the art. A frame is then constructed by dragging the image
`
`thumbnails into a stage window 121 which, as illustrated, shows images
`
`117 and 119, after dragging into the stage window 121. The stage
`
`window 121 emulates the actual stream portion that the animation will
`
`be played on. The frames and layers created are then assembled in a
`
`time-line window, as generally illustrated in FIG. 7.
`
`Having thus created animation, the person using the editor
`
`program can then review the animation using a video panel window, as
`
`created in a touch screen form, in a conventional manner, as illustrated
`
`in FIG. 8, similar to the functions provided on a tape player.
`
`Thus, as further illustrated in the flow chart of FIG. 9, the
`
`animation, in accordance with the invention, is created in accordance
`
`with the flow chart 131 of FIG. 9. As shown in FIG. 9, the first step of
`
`creating an animation file involves building images at a step 133, as
`
`previously described. The images can be built by importing objects,
`
`10
`
`15
`
`20
`
`specifically, vector objects 135, functions 137, which create the objects, or
`
`alternatively, objects created by conventional software and imported at
`
`a step 139. At step 141, the images are then displayed in an image
`
`window as thumbnails. A frame is then created at step 143 by dragging
`
`and positioning images in the stage window. The animation is then
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 18 of 33
`
`Page 18 of 33
`
`

`

`W0 97l31445
`
`PCT/IB97I00573
`
`-17-
`
`created at step 145 on a frame-by-frame basis, or by using an ”in-
`
`between” function. The in-betvveen function is hereafter described. Ink
`
`is then applied at step 147, and after constructing the animation
`
`sequence, the frame per/second rate for the animation is encoded into
`
`the file at step 149, and the entire animation file,
`
`in a format in
`
`accordance with the invention, is then saved at step 151.
`
`By ”in between” function is meant a conventional technique
`
`which takes a base set of data and avoids repeating it in a manner
`
`duplicating it for repetitive instances in which it appears in a file. An
`
`example of how an ”in between" function is implemented can be a first
`
`frame showing an object such as a ball in an upper right location. The
`
`last frame shows the ball in the lower left location. The ”in between”
`
`function is used to generate images of the ball in transition from one
`
`frame to the next
`
`in either a linear progression, or exponential
`
`progression, depending upon the type of function chosen, as will be
`
`readily apparent to those of ordinary skill in the art.
`
`Having thus described the invention, the same will become better
`
`understood from the following claims viewed in a non-limiting manner.
`
`10
`
`15
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 19 of 33
`
`Page 19 of 33
`
`

`

`WO 97/31445
`
`PCT/IB97/00573
`
`-]8..
`
`SZLALMS
`
`1.
`
`Storage media containing data for displaying animation,
`
`5
`
`characterized by:
`
`a first block of data comprised of general information for an entire
`
`animation file;
`
`a plurality of segment information blocks making up the rest of
`
`the data for displaying animation, each segment information block
`
`10
`
`comprised of first and second sections;
`
`said first section made up of:
`
`1) general information data about a segment including:
`
`15
`
`a) data identifying the frame identification for
`
`the
`
`respective segment, and
`
`b) data identifying the number of layers in the frame; and
`
`2) data comprised of information about each layer in the frame
`
`20
`
`including;
`
`a) data identifying the layer
`
`identification for
`
`the
`
`respective frame,
`
`b) data identifying the image,
`
`c) data defining the placement of the layer on the frame,
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 20 of 33
`
`Page 20 of 33
`
`

`

`wo 97/31445
`
`PCTIIB97/00573
`
`-19-
`
`and
`
`d) ink data; and
`
`said second section made up of;
`
`1) image data, for each image in a frame, made up of,
`
`a) image identification data,
`
`b) background color data,
`
`c) width and height of image, and
`
`d) data identifying the number of objects in the respective
`
`image, and
`
`2) object data for each object made up of,
`
`a) identification of object-type data,
`
`b) enclosing rectangle data,
`
`c) fill-in background and foreground data,
`
`d) pen background and foreground date,
`
`10
`
`15
`
`e) fill pattern data,
`
`f) pen pattern data,
`
`20
`
`g) line size data, and
`
`h) ink data.
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 21 of 33
`
`Page 21 of 33
`
`

`

`WO 97/31445
`
`PCT/[B97/00573
`
`-20-
`
`2.
`
`A method of building a data file for use in displaying real time
`
`animation, characterized by the steps of:
`
`a) building images by storing vector objects in an image data file,
`
`b) displaying built images in image windows as thumbnails,
`
`c) building respective frames by positioning images in a stage
`
`window for each frame,
`
`cl) defining a time line for the frames by at least one of;
`
`1) sequentially arranging the frames, and
`
`2) for frames having a common image, constructing a start
`
`frame an end frame using the common image, leaving (1-n) empty
`
`frames between the start and the end frame, and using a predetermined
`
`function to create the remaining frames from the empty frames from
`
`said common image,
`
`e) defining transparency inks to the frame data, and
`
`f) storing the data as an animation file for later transmission of the
`
`data file and displaying of an animation as real time.
`
`10
`
`15
`
`3.
`
`A method of displaying real time animation from data stored on
`
`storage media as in claim 1, characterized by the steps of, through
`
`20
`
`asynchronous transmission:
`
`a) retrieving and storing said first block of data comprised of
`
`general information,
`
`b) retrieving a first segment information block of a plurality of
`
`segment information blocks, and when a full segment information block
`
`25
`
`is received, displaying a frame of said animation,
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 22 of 33
`
`Page 22 of 33
`
`

`

`WO 97/31445
`
`PCT/IB97/00573
`
`-21-
`
`c) retrieving the next segment information block as a frame of
`
`said animation is displayed, and
`
`d) repeating said retrieval of segment information blocks and
`
`display of frames until the number of frames in said animation defined
`
`5
`
`in said first block of data has been retrieved and displayed.
`
`SUBSTITUTE SHEET (RULE 26)
`
`Page 23 of 33
`
`Page 23 of 33
`
`

`

`WO 97/31445
`
`PCTIIB97/00573
`
`1/10
`
`