(12) United States Patent
`So0d
`
`USOO6697632B1
`(10) Patent No.:
`US 6,697,632 B1
`(45) Date of Patent:
`Feb. 24, 2004
`
`(54) MULTI-MEDIA COORDINATED DELIVERY
`SYSTEMAND METHOD
`
`(75) Inventor: Prem Sood, Vancouver, WA (US)
`(73) ASSignee: Sharp Laboratories of America, Inc.,
`Camas, WA (US)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(*) Notice:
`
`(21) Appl. No.: 09/074,574
`(22) Filed:
`May 7, 1998
`(51) Int. Cl." .......................... H04B 7/005; H04B 7/01;
`H04B 7/015; H04B 15/00
`(52) U.S. Cl. ....................... 455/502; 455/503; 455/403;
`455/422; 455/517; 455/560; 375/354; 375/355
`(58) Field of Search ................................. 455/502, 503,
`455/403, 422, 560, 517, 416; 125/48; 348/14.02,
`1404,375,354,355,356
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`4,694,490 A * 9/1987 Harvey et al. .............. 380/234
`5,333,299 A * 7/1994 Koval et al. ...
`... 395/550
`5,345,551 A 9/1994 Shelley et al. .
`... 395/157
`5,392.223 A * 2/1995 Caci .............
`... 364/514
`5,465.240 A 11/1995 Mankovitz. ..................... 369/1
`5,517,253 A 5/1996 De Lange ............
`34.8/513
`5,526,024. A
`6/1996 Gaglianello et al. ........... 345/1
`5,537,685 A * 7/1996 Matsuno ...........
`... 455/51.1
`5,553,222 A 9/1996 Milne et al. ...
`... 395/154
`5,561,715 A 10/1996 Long ........................... 381/14
`5,583.980 A 12/1996 Anderson ..
`... 395/173
`5,594,660 A 1/1997 Sung et al. ....
`... 364/514
`5,630,017 A 5/1997 Gasper et al. .
`... 395/2.85
`5,694,455. A 12/1997 Goodman .................... 379/59
`5,751,694. A * 5/1998 Toft .............
`... 370/503
`5,758,294 A
`5/1998 Ganesan et al. ............ 455/561
`
`
`
`5,799,067 A * 8/1998 Kikinis et al. ........... 379/93.06
`5,802.469 A * 9/1998 Nounin et al. .............. 455/422
`5,812,951 A
`9/1998 Ganesan et al. ............ 455/445
`5,818,825 A * 10/1998 Corrigan et al. ............ 370/329
`5,875,396 A * 2/1999 Stocklon et al. ............ 455/562
`6,052,594 A * 4/2000 Chuang et al. ............. 455/450
`OTHER PUBLICATIONS
`Document entitled, TIA/EIA/IS-95-A+TSB74, Mobile Sta
`tion-Base Station Compatibility Standard for Dual-Mode
`Wideband Spread Spectrum Cellular System--Telecommu
`nications Systems Bulletin: Support for 14.4 kops Data Rate
`and PCS Interaction for Wideband Spread Spectrum Cellular
`System, Feb. 27, 1996, pp 7-141 to 7–144.
`* cited by examiner
`Primary Examiner Vivian Chin
`ASSistant Examiner Marceau Milord
`(74) Attorney, Agent, or Firm-David C. Ripma; Matthew
`D. Rabdau
`ABSTRACT
`(57)
`A method of coordinating the delivery of two independent
`messages, of different mediums, for Simultaneous presenta
`tion is provided. The messages are communicated in a
`System capable of including coordination plans with the
`messages. The coordination plans include the identity of the
`independent messages, points in the messages where the
`coordination begins, and the duration of the presentation.
`Once linkage points in the first and Second messages are
`defined, the relationship between messages is defined, So
`that independent messages 10 are displayed with predefined,
`meaningful timing. In communication System flexible
`enough to Support real-time, two-way communications, Such
`as wireleSS telephones, at least one of the messages to be
`coordinated can be received and presented in real-time. A
`System of coordinating two independent messages with a
`coordination plan message is also provided.
`
`6 Claims, 3 Drawing Sheets
`
`1 O
`PROVIDING A FIRST AND SECOND INFORMATION SOURCE
`1 2
`
`ACCEPTING MANAGEMENT INSTRUCTIONS
`
`s 4
`
`ACCEPNG THE FRS SOURCE OF INFORMAON
`
`ACCEPTENG THE SECOND SOURCE OF INFORMATION Ea. 8
`
`IN RESPONSE TO STEP 12, SYNCHRONIZING THE INFORMATION
`18C
`
`1 6
`
`SELEC DELAY
`
`SELECT DURATON
`
`ESABSH 1ST MEDUMYPE
`
`ESTABLISH2ND MEDIUM TYPE
`
`18
`
`18 e
`
`:18
`
`2 O
`
`PRESENTING THE SYNCHRONIZED INFORMATION
`
`PRODUC 2 Nopnon SOURCES OF INFORMATION
`SYNCHRONIZED USING THE INSTRUCTIONS OF STEP 12
`
`cities
`
`Ex.1009
`APPLE INC. / Page 1 of 10
`
`

`

`U.S. Patent
`
`Feb. 24, 2004
`
`Sheet 1 of 3
`
`US 6,697,632 B1
`
`Fig. 1
`1 O
`PROVIDING A FIRST AND SECOND INFORMATION SOURCE
`1 2
`
`ACCEPTING MANAGEMENT INSTRUCTIONS
`
`ACCEPTING THE FIRST SOURCE OF INFORMATION
`
`1 4.
`
`ACCEPTING THE SECOND SOURCE OF INFORMATION EO 8
`
`IN RESPONSE TO STEP 12, SYNCHRONIZING THE INFORMATION
`18C
`
`1 6
`
`SELECT DELAY
`
`SELECT DURATION
`
`ESTABLISH 1ST MEDUM TYPE
`ESTABLISH2ND MEDIUM TYPE
`
`18d
`
`18 e
`
`18
`
`2 O
`
`PRESENTING THE SYNCHRONIZED INFORMATION
`
`PROVIDING FIRST AND SECOND SOURCE OF INFORMATION O2
`
`PRODUCT 2 INDEPENDENT SOURCES OF INFORMATION
`SYNCHRONIZED USING THE INSTRUCTIONS OF STEP 12
`Fig. 4
`
`6 2
`
`ACCEPTING THE FIRST INFORMATION SOURCE
`WITH EMBEDDED MANAGEMENT INSTRUCTIONS
`
`ACCEPTING THE SECOND INFORMATION SOURCE GENEs
`ACCEPTING THE SECOND INFORMATION SOURCE
`
`6 6
`N RESPONSE TO INSTRUCTIONS INSTEP 62, SYNCHRONOUSLY
`PRESENTING THE FIRST AND SECOND INFORMATION SOURCES
`
`Eig:55, 8
`
`PRODUCT 2 DATA SOURCES COORDINATED WITH
`ACCOMPANYING SYNCHRONIZATION PLANS
`
`Ex.1009
`APPLE INC. / Page 2 of 10
`
`

`

`U.S. Patent
`
`Feb. 24, 2004
`
`Sheet 2 of 3
`
`US 6,697,632 B1
`
`Fig. 2
`
`CHANNEL ASSIGNMENT MESSAGE
`
`AS
`
`FIELD
`MSG-TYPE ("00001OOO"
`3NSFSR5RSSESS5s
`ONE OR MORE OCCURRENCE
`ACK SEQ
`3
`MSGSEQ
`3
`ACK REC
`VALIDACK
`ADDRTYPE
`ADDREN
`ADDRESS
`ASSIGN MODE
`ADDRECORD LEN
`ADDITIONAL RECORD FIELDS 8X ADDRECORD LEN
`RESERVED
`O-7 AS NEEDED
`
`3
`4
`8X ADDRLEN
`
`
`
`Fig. 3
`
`ELEMENT NAME
`OORD TO STREAMS1
`C
`1 MEDIUM ID
`1 MESSAGE ID
`OORDINATION STRIPS2
`2 MEDIUM ID
`2 MESSAGE ID
`2 LENGTH
`S2 RUN LENGTH
`OORD PT ID IN S1
`START OF PLAY DELA
`RESERVED
`
`
`
`
`
`ENGTH (OCTETS
`BEINGSHOWN HERE ONLY FORREFERENCE
`
`BEINGSHOWN HERE ONLY FORREFERENCE
`
`Ex.1009
`APPLE INC. / Page 3 of 10
`
`

`

`U.S. Patent
`
`Feb. 24, 2004
`
`Sheet 3 of 3
`
`US 6,697,632 B1
`
`
`
`1ST
`CHANNEL
`102
`
`2ND
`CHANNEL
`124
`
`3RD
`CHANNEL
`126
`
`134
`
`MEMORY
`132
`
`MEMORY
`136
`
`2ND
`PRESENTATION
`UNIT
`122
`
`NSTRUCTION
`PROCESSOR
`112
`
`SYNCHRO-
`NZER
`116
`
`MEMORY
`136
`
`1ST
`PRESENTATION
`UNIT
`120
`
`Ex.1009
`APPLE INC. / Page 4 of 10
`
`

`

`1
`MULTI-MEDIA COORDINATED DELIVERY
`SYSTEMAND METHOD
`
`US 6,697,632 B1
`
`BACKGROUND AND SUMMARY OF THE
`INVENTION
`This invention relates generally to communications and,
`more particularly, to a System and method of Synchronizing
`a multi-media message communication.
`A System is typically considered to have multi-media
`capabilities if it can Simultaneously present different types of
`information mediums. Specialized computer applications
`have been developed for Some Systems to permit a user to
`integrate independent Streams of information. Shelley et al.,
`U.S. Pat. No. 5,345,551 disclose a system permitting a
`computer operator to manually Synchronize information
`streams. Koval et al., U.S. Pat. No. 5,333,299 disclose a
`Software program, Stored in computer memory, capable of
`embedding Synchronization Signals into master and Slave
`information Streams. Neither System permits real-time Syn
`chronization of the independent data Streams. The multiple
`information mediums must undergo a separate process of
`Synchronization before the information is presented in the
`synchronized form. Further, neither system operates flexibly
`enough to Support the convenient transfer of two-way mes
`Sages between people.
`Current mobile and land-line communication Systems
`allow Voice, data, and Sometimes Video information to be
`communicated in real-time, or near real-time. However
`these Systems do not Support the delivery of multi-media
`information Streams, as only one type of information
`medium is communicated. That is, current communication
`Systems do not simultaneously communicate multiple infor
`mation mediums. Further, these System do not provide a
`means of Synchronizing a Second medium of information
`with a communicated medium of information.
`It would be advantageous if multiple information medi
`ums could be delivered in a format ready for presentation.
`It would be advantageous if multiple information medi
`ums could be delivered with Synchronization instructions.
`It would be advantageous if information coding, delivery
`System, and Synchronization instructions could be embedded
`in a Standard communication System, Such as a telephone, or
`a network-linked computer.
`It would be advantageous if at least one Stream of infor
`mation could be received, Synchronized, and presented with
`a Second Stream of information in real-time. It would also be
`advantageous if the two Streams of information could be of
`different medium types.
`Accordingly, a method for presenting information from a
`first Source, Synchronously, with at least a Second Source of
`information is provided. The method comprises the Steps of:
`a) accepting instructions to control the acceptance and
`management of the first and Second information
`SOurceS,
`b) accepting the first Source of information;
`c) accepting the Second Source of information;
`d) in response to instructions accepted in Step a), Syn
`chronizing the information of the Second Source with
`information of the first Source; and
`e) presenting the Synchronized information of both the
`first and Second Sources.
`The information Streams and management instructions are
`communicated in a variety of ways. For example, three
`
`5
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`distinct physical channels, or time multiplexed data group
`ings may be provided. In a TDMA system these channels
`may be different slots, and the function of the slots may be
`adaptive, changing in response to internal, or base directed
`Software commands. In a CDMA system the three channels
`may be different orthogonal Spreading codes. The three
`channels permit Steps a)-c) to include accepting the man
`agement instructions, and the first and Second Sources of
`information.
`Step d) includes Selecting a bit, or Some other conve
`niently identified part of the first Source of information as a
`coordination point which is Synchronized to the Starting bit
`of information in the Second Source. Then, Step e) includes
`presenting the Starting bit in the Second Source in response
`to presenting the coordination point in the first Source. That
`is, a point in the first Source is chosen as a reference for
`Synchronization.
`To fine-tune the synchronization of the information
`Streams a further Step, following Step d), Selects a delay to
`define the time duration between the coordination point in
`the first Source and the Starting bit in the Second Source.
`Then, Step e), delays the presentation of the starting bit in
`the Second Source from the presentation of the coordination
`point in the first Source. Likewise, a time duration is Selected
`for the presentation of the Second Source of information, and
`Step e) includes presenting the Second Source of information
`for the Selected time duration.
`Typically, the first Source of information is a first com
`munication medium type, and the Second Source is a differ
`ent communication medium type. The management instruc
`tions are used to establish the first and Second Source
`medium types. The medium types are presented in Stepe) in
`response to the communication medium types established.
`In this manner, the Synchronization method is able to inte
`grate different types of communication medium. Typically,
`the first and Second communication medium types are
`Selected from the group consisting of audio, audio/video,
`Video, text, images, and data. For example, Step d) may
`include Synchronizing the audio information of the Second
`Source with the audio/video information of the first Source,
`So that a voice is dubbed over an audio/visual presentation.
`Specifically, the management instructions may include a
`field devoted strictly to synchronization. This so-called
`Inter-Medium Coordination Management Field defines the
`Synchronization of the first and Second Sources of
`information, with a series of Sub-fields to define the medium
`types of each Source, the identity of each Source, the number
`of bits in the Second Source, the presentation length of the
`Second Source, the coordination point in the first Source, and
`the delay between the coordination point and the beginning
`the Second Source presentation.
`The method of the present invention is not necessarily
`limited to Synchronizing two streams of information. In one
`aspect of the invention a Step c) accepts a third Source of
`information and Step a) includes accepting management
`instructions to control the acceptance of the third Source.
`Then, Step d) includes Synchronizing the information in the
`third Source with information in the first Source, and Stepe)
`includes presenting the Synchronized information of the
`first, Second, and third Sources.
`The present invention is useful in almost any communi
`cation System including, but not limited to, wireleSS Systems
`Such as those of the IS-95, W-CDMA, IS-136, and GSM
`Standards.
`A receiver has also been provided to Synchronize at least
`two independent Streams of information for real-time pre
`Sentation. The receiver comprises at least a first communi
`
`Ex.1009
`APPLE INC. / Page 5 of 10
`
`

`

`US 6,697,632 B1
`
`15
`
`25
`
`35
`
`40
`
`3
`cation channel having an input to accept at least a first
`stream of modulated information. The channel down
`converts, demodulates, and decodes the information part of
`the received signal. The information is either received with
`embedded management instructions, or the instructions and
`information are received on Separate channels. An instruc
`tion processor accepts management instructions. The
`instruction processor creates information Stream manage
`ment commands in response to the instructions.
`A Synchronizer, having a first input connected to the first
`communication channel output, accepts information
`Streams. A Second input connected to the instruction pro
`ceSSor output accepts management commands. The Synchro
`nizer Synchronizes the first and Second information Streams
`in real-time as the first information Stream is accepted by the
`first communication channel. At least a first information
`presentation unit, having an input connected to the Synchro
`nizer output, presents the first Stream of information Simul
`taneously with the acceptance of the first Stream of infor
`mation by the first receiver channel. In this manner, two
`Streams of information are Synchronized for real-time pre
`Sentation. A Second presentation unit, having an input con
`nected to the Synchronizer output, presents the Second
`medium type, when the two information Streams are differ
`ent medium types.
`BRIEF DESCRIPTION OF THE DRAWINGS
`FIG. 1 is a flow chart illustrating a method for synchro
`nously presenting information.
`FIG. 2 is a example of management instructions organized
`in accordance with IS-95 standards (prior art).
`FIG. 3 is an example of the synchronization field, called
`the Inter-Medium Coordination Field, part of the Channel
`ASSignment Message, organized in accordance with IS-95
`Standards.
`FIG. 4 is a flow chart illustrating another aspect of the
`method for presenting information Synchronously.
`FIG. 5 is a schematic representation of a receiver which
`Synchronizes at least two independent Streams of informa
`tion for realtime presentation.
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENT
`FIG. 1 is a flow chart illustrating a method for synchro
`nously presenting information. The present invention is
`useful in multi-media, e-mail, and wireleSS communications.
`Step 10 provides a wireleSS communication Systems includ
`ing at least one base Station, the present method permits a
`mobile Station to Synchronize the presentation of a first
`communication Stream to the presentation of at least a
`Second communication Stream. In Some aspects of the
`invention, the first and Second Sources of information are
`provided by base Station, e-mail Sender, and memory. The
`wireleSS communication System is Selected from the group
`consisting of IS-95, W-CDMA, IS-136, and GSM.
`In an e-mail System, for example, a realtor may send a
`pre-existing video (with Sound) clip of a listed house as one
`Source of information. The realtor may choose to dub their
`Voice over parts of the Video to point out Special features of
`interest to a specific client. The two independent mediums
`are Sent to the client with the Synchronization instructions.
`When the client opens their e-mail, the Synchronization
`instructions automatically present the Video and Voice dub
`bing with the timing arranged by the Sender (realtor).
`In a wireless System, a client (receiver) has their telephone
`attached to auxiliary presentation equipment, Such as a Video
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`monitor. AS above, a Video of a house is Sent as one piece of
`data, and the realtor (Sender) sends a voice commenting on
`features in the Video. Technically, it is challenging to Send
`both pieces of information and the Synchronization instruc
`tions in real-time, So that the client Sees the presentation of
`information at approximately the same time that it is sent.
`The Sender may send the Video at an earlier time, or access
`a Video record Stored in the memory of the client's receiver.
`Then, the Sender can trigger the presentation of the previ
`ously Sent Video, and make comments on the Video, creating
`Synchronization commands.
`Step 12 accepts instructions to control the acceptance and
`management of the first and Second information Sources. In
`a wireleSS System management fields of instructions are
`received to control the reception of the first and Second
`communication Streams. The management instructions are
`grouped into Octets, fields, packets, or messages depending
`on the Specific communication System. Hereafter, the term
`“management instructions is intended to include any Such
`possible grouping of data. Step 14 accepts the first Source of
`information. In a wireleSS System, the first communication
`stream of information is received. Hereafter it is understood
`that the terms “communication Streams' and "Sources are
`Substantially interchangeable. Likewise, Step 16 accepts the
`Second Source of information. In a wireleSS System, the
`Second communications Stream of information is received.
`The order of steps 12, 14, and 16 are somewhat arbitrary. In
`Some aspects of the invention, the information is received
`before the management instructions. In other aspects, the
`information is received after the instructions. Further, the
`information and instruction Segments are received in cycles
`or in changing order in response to the nature of the
`information or management considerations in the commu
`nication System.
`Step 18, in response to instructions accepted in Step 12,
`Synchronizes the information of the Second Source with
`information of the first source. Step 20 presents the syn
`chronized information of both the first and Second Sources.
`Alternately, Steps 18 and 20 are considered to be combined
`So that the Second communication Stream of information is
`Synchronously presented with the first communication
`Stream of information in response to the instructions
`received in Step 12. Step 22 is a product, where two
`independent information Sources are Synchronized, or two
`independent communication Streams, or data Sources are
`joined, or coordinated with the use of the accompanying
`coordination plans in Step 12.
`In one aspect of the invention, a memory device is
`provided in Step 10 to Store information and management
`instructions. Then, further Steps (not shown), following Step
`18, occur. Step 18a stores the synchronized information of
`the first and second sources in memory, and Step 18b
`accesses the information Stored in Step 18a. In this manner,
`the information of the first and Second Sources is Synchro
`nously presented after being Stored. Alternately, the memory
`device Stores information and management instructions.
`Then, further Steps (not shown) preceding Step 18 occur.
`Step 16a stores, in memory, the information of the first and
`Second Sources accepted in Steps 14 and 16, respectively,
`and the management instructions accepted in Step 12. Step
`16b accesses the information and management instructions
`stored in Step 16a. In this manner, the information of the first
`and Second Sources is Stored before processing into Synchro
`nously linked data Sources.
`In one aspect of the invention at least three communica
`tion channels are provided in Step 10. The definition of
`communication channel, as used herein, is very broad. In
`
`Ex.1009
`APPLE INC. / Page 6 of 10
`
`

`

`S
`one aspect of the invention, the channels are distinct physi
`cal channels, Such as different carrier frequency bands.
`Alternately, the channels are a single carrier that is time
`multiplexed. Further, the channels may be different time
`slots of a single physical channel. In a CDMA system the
`channels are data Sent on a single carrier, at the same time,
`with different orthogonal spreading codes. In Some aspects
`of the invention, the definition of the channels is adaptive, as
`the use and characteristics of time multiplexed slots change
`in response to broadcast commands, or receiver logic. The
`channels are also combinations of physical, time, frequency,
`and orthogonally coded messages. In Some aspects of the
`invention, the channels are also specified as higher layers of
`a layered hierarchical protocol structure Such as Open SyS
`tem Interconnection (OSI) and Integrated Services Digital
`Network (ISDN) and are implemented in Software/firmware
`only to implement the time sharing of a physical channel.
`However defined, all three, or any combination of the
`information Streams and management instructions are car
`ried on one, two, or three channels. Steps 12-16 include
`accepting the management instructions, and the first and
`Second Sources of information on the three communication
`channels, however the channels have been defined.
`Typically, the communications are digitally formatted,
`although the present invention's method also applies to
`analog formats. Whether the communication is organized in
`Octets, packets, fields, messages or other groupings, the
`ultimate basis of information transfer is usually the bit.
`Given the nature of modern communications, even the
`analog Advanced Mobile Phone Service (AMPS) wireless
`System uses receiver equipment which digitizes data at Some
`point in the receiving process. Step 18 includes Selecting a
`bit in the first Source of information as a coordination point
`Synchronized to the Starting point of information in the
`Second Source. For example, the coordination point could be
`the rising edge of the first bit in a specified field. Step 20
`includes presenting the Starting point in the Second Source in
`response to presenting the is coordination point in the first
`Source. It is assumed for the purposes of this discussion that
`the location of the Starting point in the Second stream is a
`predetermined bit location, in accordance with a format
`known to all the communication players in the System. For
`example, the Starting point is the first bit of the information
`to be presented in the Second Stream Strip. Alternately, the
`Starting point is a bit in the Second stream of bits preceding,
`or Subsequent to the actual bits of information to be pre
`Sented. In Some aspects of the invention, the Starting point is
`defined by the management instructions in the same manner
`that the coordination point is defined. Regardless of the
`exact location of the coordination point in the first Stream
`and the Starting point in the Second Stream, once references
`are taken in the two Streams, it becomes possible to Syn
`chronize the Streams.
`Generally, the information Streams and the management
`instructions are communicated in a Serial order, So that a first
`bit precedes a second bit in time. However the method of the
`present invention applies equally well to parallel data trans
`fer Systems where a number of bits arrive Simultaneously.
`Even in parallel processing Systems, groupings of data are
`handled in a Serial Sequence. StepS 14 and 16 include
`accepting, respectively, first and Second Sources of informa
`tion in a Sequentially order, and Step 12 includes accepting
`Sequentially ordered fields as the management instructions.
`Then, Step 18 includes Selecting a coordination point in a
`Sequence of bits in the first Source.
`The method includes further steps, following Step 18.
`Step 18c, in response to instructions from the management
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 6,697,632 B1
`
`6
`fields accepted in Step 12, Selects a delay which defines the
`time duration between the coordination point in the first
`Source and the Starting point, or bit in the Second Source.
`Step 20, in response to the time duration selected in Step
`18c, includes delaying the presentation of the Starting point
`in the Second Source from the presentation of the coordina
`tion point in the first Source. The Synchronized presentations
`are finely adjusted with a delay, after coarse adjustment with
`the coordination point.
`Step 18d, in response to instructions from the manage
`ment fields accepted in Step 12, Selects a duration for the
`presentation of the Second Source of information. Then, Step
`20 includes presenting the Second Source of information for
`the time duration selected in Step 18d. Once the starting
`point, delay, and duration are known, the Synchronization of
`the Second information Stream to the first information Stream
`is completely described.
`In Some aspects of the invention, the first Source provided
`in StepS 10 is a first predetermined communication medium
`type and the Second Source is a Second predetermined
`communication medium type. Further Steps, then, follow
`Step 16. Step 18e establishes the first source first commu
`nication medium type in response to accepting the manage
`ment fields in Step 12. Step 18festablishes the second source
`Second communication medium type in response to accept
`ing the management fields in Step 12. Then, Step 20 includes
`presenting information fields of the first Source in response
`to the communication medium type established in Step 18e,
`and also includes presenting information fields of the Second
`Source in response to the communication medium type
`established in Step 18.f. In this manner, the synchronization
`method is able to integrate different types of communication
`medium.
`The first and Second communication medium types pro
`Vided in Step 10 are Selected from the group consisting of
`audio, audio/video, Video, images, text, and data. The
`method includes broadcast quality audio as well as com
`pression Schemes Such as a variety of Vocoders, Adaptive
`Delta Modulation (ADPCM), and u-law PCM, as are well
`known in the art. The audio/video medium includes full
`motion, Slow motion, and Slow Scan video. Data medium
`includes images, animation, text, moving images, graphs,
`and abstract pictures. In Some aspects of the invention, Step
`10 provides a receiver, audio/video information as the first
`medium type, and audio information as the Second medium
`type. StepS 12-16 include accepting the management fields
`and first and Second Source information fields, respectively,
`with the receiver. For example, when Step 10 provides a
`audio/video first medium type and an audio Second medium
`type, Step 18 includes Synchronizing the audio information
`of the second Source with the audio/video information of the
`first Source. In this manner, a voice is dubbed over an
`audio/visual presentation.
`Step 10 provides for a plurality of information streams,
`with each Source having a unique message identification
`number. For example, each information Stream is given an
`identification number in an octet of data before, or after the
`information. In Some aspects of the invention the informa
`tion is also Supplied with the management instructions. The
`identification number is Supplied with the management
`channel, and the correlation between each information
`Stream and identification number is made through timing
`relationships. Then, Step 12 includes accepting a first Source
`message identification number and a Second Source message
`identification number in the management fields. Step 14
`includes Selecting the Source with the first Source message
`identification number, and Step 16 includes Selecting the
`Source with the Second Source message identification num
`ber.
`
`Ex.1009
`APPLE INC. / Page 7 of 10
`
`

`

`US 6,697,632 B1
`
`15
`
`25
`
`35
`
`40
`
`7
`FIG. 2 is a example of management instructions organized
`in accordance with IS-95 standards (prior art). Although the
`IS-95 is specifically described, the method applies equally
`well any communication System, especially one which com
`munication System data and management instructions. The
`functions of the pre-existing field names and assignment
`values in the Channel ASSignment Message are defined in
`section 7.7.2.3.2.8 of IS-95, Revision B. The pre-existing
`values of ASSIGN MODE are “000” to “101", represent
`ing a traffic channel assignment, paging channel assignment,
`acquire analog System assignment, analog Voice channel
`assignment, extended traffic channel assignment, extended
`paging channel assignment. To implement a new field to
`control synchronization, a new ASSIGN MODE with a
`value greater than “101 is created, such as “110” to define
`the Synchronization field and function.
`FIG. 3 is an example of the synchronization field, called
`the Inter-Medium Coordination Field, part of the Channel
`ASSignment Message, organized in accordance with IS-95
`Standards. Returning to FIG. 1, Step 12, in response to
`receiving the management fields, identifies an Inter-Medium
`Coordination Field in a message, Such as the Channel
`ASSignment Message. In this manner, Synchronization is
`conducted in the context of established communication
`management protocols. Step 12 includes accepting an Inter
`Medium Coordination Management Field to define the syn
`chronization of the first and Second Sources of information.
`These sub-fields, or sub-steps (not shown) identify the first
`and Second information Streams, the coordination point, the
`duration, and the medium types (also see FIG. 3).
`Step 12a accepts a first sub-field (S1 MEDIUM ID) to
`define the first source first medium type. In the IS-95
`example of FIG. 3, the S1 MEDIUM ID field is % of an
`octet in length. Step 12b accepts a second (S1
`MESSAGE ID) sub-field to define the first source message
`identification number, whereby a specific Sequence of infor
`mation is identified as the first source in Step 14. In the IS-95
`example, S1 MESSAGE ID has a length of 1 octet to
`identify the first communication Stream. Step 12c accepts a
`third Sub-field to define the Second Source Second medium
`type. In the IS-95 example, S2 MEDIUM ID is a field of
`% an octet to identify the Second communication Stream
`medium type.
`Step 12d accepts a fourth sub-field to define the second
`Source message identification number, whereby a specific
`Sequence of information is identified as the Second Source.
`In the IS-95 example, S2 MESSAGE ID is a field of 1
`octet to identify the Second communication Stream in Step
`16. Step 12e accepts a fifth sub-field to define the size of the
`Second Source information Stream. Typically, the number of
`bits or octets in the Second Source of information, whereby
`the amount of information in the Second Source is defined.
`In the IS-95 example, a S2 LENGTH field has a length of
`1 Octet identifies the number of octets in the Second com
`munications Stream.
`Step 12f accepts a Sixth Sub-field to define the presenta
`tion duration of the second source. In the IS-95 example,
`S2 RUN LENGTH field has a length of 1 octet to identify
`the presentation time duration of the Second communica
`tions Stream. Step 12g accepts a Seventh Sub-field to define
`the coordination point in the first Source of information from
`which the Synchronization of the Second Source is refer
`enced. In the IS-95 example, COORD PT ID IN S1 is
`a field of /2 an octet to identify a reference point in the first
`communications Stream to Synchronize the Second commu
`nication Stream with the first information Stream.
`Step 12h accepts an eighth sub-field to define the delay
`between the coordination point established in Sub-field 12g
`
`45
`
`50
`
`55
`
`60
`
`65
`
`8
`and the Start of the presentation of the Second Source
`information stream. In the IS-95 example, START OF
`PLAY DELAY is a field of 1 octet to identify a time delay,
`from the presentation of the coordi