INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATIONISO/IEC JTC1/SC29/WG11CODING OF MOVING PICTURES AND AUDIOISO/IEC JTC1/SC29/WG11 N220115 May 1998Source:MPEG-4 SystemsStatus:Approved at the 43rd MeetingTitle:Text for ISO/IEC FCD 14496-1 SystemsAuthors:Alexandros Eleftheriadis, Carsten Herpel, Ganesh Rajan, and Liam Ward(Editors)
`
`IPR2018-01413
`Sony EX1017 Page 1
`
`
`
`IPR2018-01413
`Sony EX1017 Page 1
`
`
`
`INFORMATION TECHNOLOGY –GENERIC CODING OF AUDIO-VISUAL OBJECTSPart 1: SystemsISO/IEC 14496-1Final Committee Draft of International StandardVersion of: 18 May, 1998, 06:15Please address any comments or suggestions to: spec-sys@fzi.de© ISO/IEC 1998All rights reserved. No part of this publication may be reproduced in any form or by any means,electronic or mechanical, including photocopying and microfilm, without permission in writing fromthe publisher.ISO/IEC Copyright Office • Case Postale 56 • CH1211 Genève 20 • SwitzerlandPrinted in Switzerland.
`
`IPR2018-01413
`Sony EX1017 Page 2
`
`
`
`© ISO/IECISO/IEC FCD 14496-1:1998iTable of Contents1.Introduction_____________________________________________________11.1Overview______________________________________________________________________11.2Architecture____________________________________________________________________11.3Terminal Model: Systems Decoder Model___________________________________________21.3.1Timing Model______________________________________________________________________21.3.2Buffer Model_______________________________________________________________________31.4Multiplexing of Streams: TransMux Layer___________________________________________31.5Synchronization of Streams: Sync Layer____________________________________________31.6Compression Layer______________________________________________________________31.6.1Object Descriptor Streams_____________________________________________________________31.6.2Scene Description Streams____________________________________________________________41.6.3Media Streams______________________________________________________________________41.6.4Object Content Information Streams_____________________________________________________41.6.5Upchannel Streams__________________________________________________________________42.Normative References_____________________________________________53.Additional References_____________________________________________54.Definitions_______________________________________________________65.Abbreviations and Symbols_________________________________________96.Conventions_____________________________________________________106.1Syntax Description_____________________________________________________________107.Systems Decoder Model___________________________________________117.1Introduction___________________________________________________________________117.2Concepts of the Systems Decoder Model____________________________________________117.2.1Stream Multiplex Interface (SMI)______________________________________________________117.2.2SL-Packetized Stream (SPS)__________________________________________________________127.2.3Access Units (AU)__________________________________________________________________127.2.4Decoding Buffer (DB)_______________________________________________________________127.2.5Elementary Streams (ES)_____________________________________________________________127.2.6Elementary Stream Interface (ESI)_____________________________________________________127.2.7Media Object Decoder_______________________________________________________________127.2.8Composition Units (CU)_____________________________________________________________127.2.9Composition Memory (CM)__________________________________________________________127.2.10Compositor________________________________________________________________________137.3Timing Model Specification______________________________________________________137.3.1System Time Base (STB)_____________________________________________________________137.3.2Object Time Base (OTB)_____________________________________________________________137.3.3Object Clock Reference (OCR)________________________________________________________137.3.4Decoding Time Stamp (DTS)_________________________________________________________137.3.5Composition Time Stamp (CTS)_______________________________________________________147.3.6Occurrence and Precision of Timing Information in Elementary Streams_______________________147.3.7Time Stamps for Dependent Elementary Streams__________________________________________147.3.8Example__________________________________________________________________________14
`
`IPR2018-01413
`Sony EX1017 Page 3
`
`
`
`© ISO/IECISO/IEC FCD 14496-1:1998ii7.4Buffer Model Specification_______________________________________________________157.4.1Elementary Decoder Model___________________________________________________________157.4.2Assumptions_______________________________________________________________________167.4.2.1Constant end-to-end delay__________________________________________________________167.4.2.2Demultiplexer___________________________________________________________________167.4.2.3Decoding Buffer__________________________________________________________________167.4.2.4Decoder________________________________________________________________________167.4.2.5Composition Memory_____________________________________________________________167.4.2.6Compositor______________________________________________________________________167.4.3Managing Buffers: A Walkthrough_____________________________________________________168.Object Descriptors_______________________________________________188.1Introduction___________________________________________________________________188.2Object Descriptor Stream________________________________________________________198.2.1Structure of the Object Descriptor Stream________________________________________________198.2.2Principles of Syntax Specification and Parsing____________________________________________198.2.3OD Messages______________________________________________________________________198.2.4Access Unit Definition_______________________________________________________________198.2.5Time Base for Object Descriptor Streams________________________________________________208.2.6Implicit Length of Descriptor Lists_____________________________________________________208.2.7OD Message Syntax and Semantics____________________________________________________208.2.7.1ObjectDescriptorUpdate____________________________________________________________208.2.7.1.1Syntax______________________________________________________________________208.2.7.1.2Semantics____________________________________________________________________208.2.7.2ObjectDescriptorRemove___________________________________________________________208.2.7.2.1Syntax______________________________________________________________________208.2.7.2.2Semantics____________________________________________________________________208.2.7.3ObjectDescriptorRemoveAll________________________________________________________218.2.7.3.1Syntax______________________________________________________________________218.2.7.3.2Semantics____________________________________________________________________218.2.7.4ES_DescriptorUpdate_____________________________________________________________218.2.7.4.1Syntax______________________________________________________________________218.2.7.4.2Semantics____________________________________________________________________218.2.7.5ES_DescriptorRemove_____________________________________________________________218.2.7.5.1Syntax______________________________________________________________________218.2.7.5.2Semantics____________________________________________________________________218.3Syntax and Semantics of Object Descriptor Components______________________________228.3.1ObjectDescriptor___________________________________________________________________228.3.1.1Syntax_________________________________________________________________________228.3.1.2Semantics_______________________________________________________________________228.3.2InitialObjectDescriptor______________________________________________________________238.3.2.1Syntax_________________________________________________________________________238.3.2.2Semantics_______________________________________________________________________238.3.3ES_Descriptor_____________________________________________________________________248.3.3.1Syntax_________________________________________________________________________248.3.3.2Semantics_______________________________________________________________________258.3.4DecoderConfigDescriptor____________________________________________________________268.3.4.1Syntax_________________________________________________________________________268.3.4.2Semantics_______________________________________________________________________268.3.5DecoderSpecificInfo_________________________________________________________________278.3.5.1Syntax_________________________________________________________________________278.3.5.2Semantics_______________________________________________________________________288.3.6SLConfigDescriptor_________________________________________________________________288.3.7IP Identification Data Set____________________________________________________________288.3.7.1Syntax_________________________________________________________________________288.3.7.2Semantics_______________________________________________________________________29
`
`IPR2018-01413
`Sony EX1017 Page 4
`
`
`
`© ISO/IECISO/IEC FCD 14496-1:1998iii8.3.8IPI_DescPointer____________________________________________________________________308.3.8.1Syntax_________________________________________________________________________308.3.8.2Semantics_______________________________________________________________________308.3.9QoS_Descriptor____________________________________________________________________308.3.9.1Syntax_________________________________________________________________________308.3.9.2Semantics_______________________________________________________________________318.3.10ExtensionDescriptor________________________________________________________________328.3.10.1Syntax_________________________________________________________________________328.3.10.2Semantics______________________________________________________________________328.3.11RegistrationDescriptor_______________________________________________________________328.3.11.1Syntax_________________________________________________________________________328.3.11.2Semantics______________________________________________________________________328.3.11.2.1Implementation of a Registration Authority (RA)___________________________________338.3.12Descriptor Tags____________________________________________________________________338.4Usage of the Object Descriptor Framework_________________________________________348.4.1Linking Scene Description and Object Descriptors_________________________________________348.4.1.1Associating Object Descriptors to Media Objects________________________________________348.4.1.2Hierarchical scene and object description______________________________________________348.4.1.3Name Scope Definition for Scene Description and Object Descriptor Streams_________________348.4.2Associating Multiple Elementary Streams in a Single Object Descriptor_______________________358.4.2.1Object Descriptor as Grouping Mechanism____________________________________________358.4.2.2Associating Elementary Streams with Same Type_______________________________________358.4.2.3Associating Elementary Streams with Different Types____________________________________358.4.2.4Dependent Elementary Streams______________________________________________________358.4.3Accessing ISO/IEC 14496 Content_____________________________________________________358.4.3.1Introduction_____________________________________________________________________358.4.3.2The Initial Object Descriptor________________________________________________________368.4.3.3Selection of Elementary Streams for a Media Object_____________________________________368.4.3.4Usage of URLs in the Object Descriptor Framework_____________________________________368.4.3.5Accessing content through a known Object Descriptor___________________________________368.4.3.5.1Pre-conditions________________________________________________________________368.4.3.5.2Content Access Procedure_______________________________________________________368.4.3.6Accessing content through a URL in an Object Desciptor_________________________________378.4.3.6.1Pre-conditions________________________________________________________________378.4.3.6.2Content access procedure_______________________________________________________378.4.3.7Accessing content through a URL in an Elementary Stream Descriptor______________________378.4.3.7.1Pre-conditions________________________________________________________________378.4.3.7.2Content access procedure_______________________________________________________378.4.3.8Example of Content Access_________________________________________________________378.4.3.9Example of Complex Content Access_________________________________________________389.Scene Description________________________________________________409.1Introduction___________________________________________________________________409.1.1Scope____________________________________________________________________________409.1.2Composition_______________________________________________________________________419.1.3Scene Description__________________________________________________________________419.1.3.1Grouping of objects_______________________________________________________________419.1.3.2Spatio-Temporal positioning of objects________________________________________________419.1.3.3Attribute value selection___________________________________________________________419.2Concepts______________________________________________________________________429.2.1Global Structure of BIFS_____________________________________________________________429.2.2BIFS Scene Graph__________________________________________________________________429.2.3Standard Units_____________________________________________________________________439.2.42D Coordinate System_______________________________________________________________439.2.53D Coordinate System_______________________________________________________________449.2.6Mapping of Scenes to Screens_________________________________________________________44
`
`IPR2018-01413
`Sony EX1017 Page 5
`
`
`
`© ISO/IECISO/IEC FCD 14496-1:1998iv9.2.6.1Transparency____________________________________________________________________449.2.7Nodes and fields____________________________________________________________________459.2.7.1Nodes__________________________________________________________________________459.2.7.2Fields and Events_________________________________________________________________459.2.8Basic Data Types___________________________________________________________________459.2.8.1Numerical data and string data types_________________________________________________459.2.8.1.1Introduction__________________________________________________________________459.2.8.1.2SFInt32/MFInt32______________________________________________________________459.2.8.1.3SFTime_____________________________________________________________________459.2.8.2Node data types__________________________________________________________________459.2.9Attaching nodeIDs to nodes___________________________________________________________459.2.10Using Pre-Defined Nodes____________________________________________________________469.2.11Internal, ASCII and Binary Representation of Scenes______________________________________469.2.11.1Binary Syntax Overview___________________________________________________________469.2.11.1.1Scene Description____________________________________________________________469.2.11.1.2Node Description_____________________________________________________________469.2.11.1.3Fields description_____________________________________________________________469.2.11.1.4ROUTE description___________________________________________________________469.2.12BIFS Elementary Streams____________________________________________________________479.2.12.1BIFS-Command_________________________________________________________________479.2.12.2BIFS Access Units_______________________________________________________________479.2.12.3Time base for the scene description__________________________________________________479.2.12.4Composition Time Stamp semantics for BIFS Access Units_______________________________479.2.12.5Multiple BIFS streams____________________________________________________________479.2.12.6Time fields in BIFS nodes_________________________________________________________479.2.12.7Time events based on media time___________________________________________________489.2.13Time-dependent nodes_______________________________________________________________489.2.14Audio____________________________________________________________________________489.2.14.1Audio sub-trees__________________________________________________________________489.2.14.2Overview of sound node semantics__________________________________________________499.2.14.2.1Sample-rate conversion________________________________________________________499.2.14.2.2Number of output channels_____________________________________________________509.2.14.3Audio-specific BIFS Nodes________________________________________________________509.2.15Drawing Order_____________________________________________________________________509.2.16Bounding Boxes____________________________________________________________________519.2.17Sources of modification to the scene____________________________________________________519.2.17.1Interactivity and behaviors_________________________________________________________519.2.17.1.1Attaching ROUTEIDs to ROUTEs_______________________________________________519.2.17.2External modification of the scene: BIFS-Commands____________________________________519.2.17.2.1Overview___________________________________________________________________519.2.17.3External animation of the scene: BIFS-Anim__________________________________________529.2.17.3.1Overview___________________________________________________________________539.2.17.3.2Animation Mask_____________________________________________________________539.2.17.3.3Animation Frames____________________________________________________________539.3BIFS Syntax___________________________________________________________________539.3.1BIFS Scene and Nodes Syntax_________________________________________________________539.3.1.1BIFSConfig_____________________________________________________________________539.3.1.2BIFSScene______________________________________________________________________549.3.1.3SFNode_________________________________________________________________________549.3.1.4MaskNodeDescription_____________________________________________________________549.3.1.5ListNodeDescription______________________________________________________________549.3.1.6Field___________________________________________________________________________559.3.1.7MFField________________________________________________________________________559.3.1.8SFField_________________________________________________________________________559.3.1.8.1Float________________________________________________________________________569.3.1.8.2SFBool______________________________________________________________________569.3.1.8.3SFColor_____________________________________________________________________56
`
`IPR2018-01413
`Sony EX1017 Page 6
`
`
`
`© ISO/IECISO/IEC FCD 14496-1:1998v9.3.1.8.4SFFloat______________________________________________________________________579.3.1.8.5SFInt32_____________________________________________________________________579.3.1.8.6SFRotation___________________________________________________________________579.3.1.8.7SFString_____________________________________________________________________579.3.1.8.8SFTime_____________________________________________________________________579.3.1.8.9SFUrl_______________________________________________________________________579.3.1.8.10SFVec2f____________________________________________________________________589.3.1.8.11SFVec3f____________________________________________________________________589.3.1.9QuantizedField___________________________________________________________________589.3.1.10ROUTE syntax__________________________________________________________________609.3.1.10.1ROUTEs___________________________________________________________________609.3.1.10.2ListROUTEs________________________________________________________________609.3.1.10.3VectorROUTEs______________________________________________________________609.3.1.10.3.1ROUTE_________________________________________________________________609.3.2BIFS Command Syntax______________________________________________________________609.3.2.1Command Frame_________________________________________________________________609.3.2.2Command_______________________________________________________________________619.3.2.3Insertion Command_______________________________________________________________619.3.2.3.1Node Insertion________________________________________________________________619.3.2.3.2IndexedValue Insertion_________________________________________________________629.3.2.3.3ROUTE Insertion______________________________________________________________629.3.2.4Deletion Command_______________________________________________________________629.3.2.4.1Node Deletion________________________________________________________________629.3.2.4.2IndexedValue Deletion_________________________________________________________629.3.2.4.3ROUTE Deletion______________________________________________________________639.3.2.5Replacement Command____________________________________________________________639.3.2.5.1Node Replacement_____________________________________________________________639.3.2.5.2Field Replacement_____________________________________________________________639.3.2.5.3IndexedValue Replacement______________________________________________________649.3.2.5.4ROUTE Replacement__________________________________________________________649.3.2.5.5Scene Replacement____________________________________________________________649.3.3BIFS-Anim Syntax_________________________________________________________________649.3.3.1BIFS AnimationMask_____________________________________________________________649.3.3.1.1AnimationMask_______________________________________________________________649.3.3.1.2Elementary mask______________________________________________________________649.3.3.1.3InitialFieldsMask______________________________________________________________659.3.3.1.4InitialAnimQP________________________________________________________________659.3.3.2BIFS-Anim Frame Syntax__________________________________________________________679.3.3.2.1AnimationFrame______________________________________________________________679.3.3.2.2AnimationFrameHeader________________________________________________________679.3.3.2.3AnimationFrameData__________________________________________________________679.3.3.2.4AnimationField_______________________________________________________________689.3.3.2.5AnimQP_____________________________________________________________________689.3.3.2.6AnimationIValue______________________________________________________________709.3.3.2.7AnimationPValue_____________________________________________________________719.4BIFS Decoding Process and Semantics_____________________________________________729.4.1BIFS Scene and Nodes Decoding Process________________________________________________759.4.1.1BIFS Decoder Configuration________________________________________________________759.4.1.2BIFS Scene______________________________________________________________________759.4.1.3SFNode_________________________________________________________________________759.4.1.4MaskNodeDescription_____________________________________________________________769.4.1.5ListNodeDescription______________________________________________________________769.4.1.6NodeType_______________________________________________________________________769.4.1.7Field___________________________________________________________________________769.4.1.8MFField________________________________________________________________________769.4.1.9SFField_________________________________________________________________________769.4.1.10QuantizedField__________________________________________________________________77
`
`IPR2018-01413
`Sony EX1017 Page 7
`
`
`
`© ISO/IECISO/IEC FCD 14496-1:1998vi9.4.1.10.1Local Quantization Parameter Table_____________________________________________779.4.1.10.2Quantization method__________________________________________________________819.4.1.11Field and Events IDs Decoding Process_______________________________________________839.4.1.11.1DefID______________________________________________________________________839.4.1.11.2inID_______________________________________________________________________839.4.1.11.3outID______________________________________________________________________839.4.1.11.4dynID______________________________________________________________________839.4.1.12ROUTE Decoding Process_________________________________________________________839.4.2BIFS-Command Decoding Process_____________________________________________________839.4.2.1Command Frame_________________________________________________________________839.4.2.2Command_______________________________________________________________________839.4.2.3Insertion Command_______________________________________________________________839.4.2.3.1Node Insertion________________________________________________________________849.4.2.3.2IndexedValue Insertion_________________________________________________________849.4.2.3.3ROUTE Insertion______________________________________________________________849.4.2.4Deletion Command_______________________________________________________________849.4.2.4.1Node Deletion________________________________________________________________849.4.2.4.2IndexedValue Deletion_________________________________________________________849.4.2.4.3ROUTE Deletion______________________________________________________________849.4.2.5Replacement Command____________________________________________________________849.4.2.5.1Node Replacement_____________________________________________________________849.4.2.5.2Field Replacement_____________________________________________________________849.4.2.5.3IndexedValue Replacement______________________________________________________849.4.2.5.4ROUTE Replacement__________________________________________________________849.4.2.5.5Scene Replacement____________________________________________________________859.4.3BIFS-Anim Decoding Process_________________________________________________________859.4.3.1BIFS AnimationMask_____________________________________________________________879.4.3.1.1AnimationMask_______________________________________________________________879.4.3.1.2Elementary mask______________________________________________________________879.4.3.1.3InitialFieldsMask______________________________________________________________889.4.3.1.4InitialAnimQP________________________________________________________________889.4.3.2Animation Frame Decoding Process__________________________________________________889.4.3.2.1AnimationFrame______________________________________________________________889.4.3.2.2AnimationFrameHeader________________________________________________________889.4.3.2.3AnimationFrameData__________________________________________________________889.4.3.2.4AnimationField_______________________________________________________________889.4.3.2.5AnimQP_____________________________________________________________________899.4.3.2.6AnimationIValue and AnimationPValue___________________________________________899.4.3.2.6.1Quantization of I Values____________________________________________________899.4.3.2.6.2Decoding Process__________________________________________________________919.5Node Semantics________________________________________________________________919.5.1Shared Nodes______________________________________________________________________919.5.1.1Shared Nodes Overview____________________________________________________________919.5.1.2Shared Native Nodes______________________________________________________________919.5.1.2.1AnimationStream_____________________________________________________________919.5.1.2.1.1Semantic Table____________________________________________________________919.5.1.2.1.2Main Functionality_________________________________________________________929.5.1.2.1.3Detailed Semantic__________________________________________________________929.5.1.2.2AudioDelay__________________________________________________________________929.5.1.2.2.1Semantic Table____________________________________________________________929.5.1.2.2.2Main Functionality_________________________________________________________929.5.1.2.2.3Detailed Semantics_________________________________________________________929.5.1.2.2.4Calculation_______________________________________________________________929.5.1.2.3AudioMix____________________________________________________________________939.5.1.2.3.1Semantic Table____________________________________________________________939.5.1.2.3.2Main Functionality_________________________________________________________939.5.1.2.3.3Detailed Semantics_________________________________________________________93
`
`IPR2018-01413
`Sony EX1017 Page 8
`
`
`
`© ISO/IECISO/IEC FCD 14496-1:1998vii9.5.1.2.3.4Calculation_______________________________________________________________939.5.1.2.4AudioSource_________________________________________________________________949.5.1.2.4.1Semantic Table____________________________________________________________949.5.1.2.4.2Main Functionality_________________________________________________________949.5.1.2.4.3Detailed Semantics_________________________________________________________949.5.1.2.4.4Calculation_______________________________________________________________959.5.1.2.5AudioFX____________________________________________________________________959.5.1.2.5.1Semantic Table____________________________________________________________959.5.1.2.5.2Main Functionality_________________________________________________________959.5.1.2.5.3Detailed Semantics_________________________________________________________959.5.1.2.5.4Calculation_______________________________________________________________959.5.1.2.6AudioSwitch_________________________________________________________________969.5.1.2.6.1Semantic Table____________________________________________________________969.5.1.2.6.2Main Functionality_________________________________________________________969.5.1.2.6.3Detailed Semantics_________________________________________________________969.5.1.2.6.4Calculation_______________________________________________________________969.5.1.2.7Conditional__________________________________________________________________969.5.1.2.7.1Semantic Table____________________________________________________________969.5.1.2.7.2Main Functionality_________________________________________________________969.5.1.2.7.3Detailed Semantics_________________________________________________________979.5.1.2.8MediaTimeSensor_____________________________________________________________979.5.1.2.8.1Semantic Table____________________________________________________________979.5.1.2.8.2Main Functionality_________________________________________________________979.5.1.2.8.3Detailed Semantics_________________________________________________________979.5.1.2.9QuantizationParameter_________________________________________________________979.5.1.2.9.1Semantic Table____________________________________________________________979.5.1.2.9.2Main Functionality_________________________________________________________989.5.1.2.9.3Detailed Semantics_________________________________________________________989.5.1.2.10TermCap___________________________________________________________________989.5.1.2.10.1Semantic Table__________________________________________________
Accessing this document will incur an additional charge of $.
After purchase, you can access this document again without charge.
Accept $ Charge
Still Working On It
This document is taking longer than usual to download. This can happen if we need to contact the court directly to obtain the document and their servers are running slowly.
Give it another minute or two to complete, and then try the refresh button.
A few More Minutes ... Still Working
It can take up to 5 minutes for us to download a document if the court servers are running slowly.
Thank you for your continued patience.
This document could not be displayed.
We could not find this document within its docket. Please go back to the docket page and check the link. If that does not work, go back to the docket and refresh it to pull the newest information.
Your account does not support viewing this document.
You need a Paid Account to view this document. Click here to change your account type.
Your account does not support viewing this document.
Set your membership
status to view this document.
With a Docket Alarm membership, you'll
get a whole lot more, including:
- Up-to-date information for this case.
- Email alerts whenever there is an update.
- Full text search for other cases.
- Get email alerts whenever a new case matches your search.
One Moment Please
The filing “” is large (MB) and is being downloaded.
Please refresh this page in a few minutes to see if the filing has been downloaded. The filing will also be emailed to you when the download completes.
Your document is on its way!
If you do not receive the document in five minutes, contact support at support@docketalarm.com.
Sealed Document
We are unable to display this document, it may be under a court ordered seal.
If you have proper credentials to access the file, you may proceed directly to the court's system using your government issued username and password.
Access Government Site
