Europaisches Patentamt
`
`(19) 0'
`
`European Patent Office
`
`Office européen des brevets
`
`lllllllllllllllllllllllllllllllllllllllllllllllllll||llllllllllllllllllllll
`
`(11)
`
`EP 0 755162 A2
`
`(12)
`
`EUROPEAN PATENT APPLICATION
`
`(43) Date of publication:
`22.01.1997 Bulletin 1997(04
`
`(51) [m CLS: H04N 9:806
`
`(21) Application number: 963053244
`
`(22) Date of filing: 19.07.1996
`
`(84) Designated Contracting States:
`DE FR GB
`
`(30) Priority: 21.07.1995 JP 207778795
`
`(71) Applicant: SONY CORPORATION
`Tokyo 141 (JP)
`
`(72) Inventors:
`. Murase, Hirofumi, Sony Corp.
`Shinagawe-ku, Tokyo 141 (JP)
`
`- Kaiimoto, Masato, Sony Corp.
`Shinagawa-ku, Tokyo 141 (JP)
`' Yamamoto, Toshihisa, Sony Corp.
`Shinagawa-ku, Tokyo 141 (JP)
`
`(74) Representative: Cotter, Ivan John et al
`D. YOUNG 8: CO.
`21 New Fetter Lane
`
`London EC4A 1DA (GB)
`
`
`
`(54)
`
`Recording andfor reproducing video data
`
`A still image recordingi'reproducing apparatus
`(57)
`records andfor reproduces still image data and audio
`data onto andfor from a recording medium. such as a
`
`magnetooptical disk (51). Characters andfor patterns
`may be provided with the still image. Additionally, the
`still image may be modified andfor the size thereof may
`be increased or decreased.
`
`
` AUDIOCOMPRESSOR
`JEXPAVDER
`VIDEOSIRNM
`PROCESSOR
`
`
`
`
` MEMORY
`CONTROLLER
`
`lanDREscaconER
`
`
`
`
`AHERAS.GNAL
`PRDGESSCR
`
`:I(L
`
`
`
`4'1
`
`t
`
`a;
`
`DIn¢muDhc
`
`6]
`
`
`
`Printed by Jouve, 75001 PARIS (FR)
`
`HTC Exhibit 1032
`
`i
`
`MEME"ORV
`
`31w
`
`Fig.3
`
`EP0755162A2
`
`HTC Exhibit 1032
`
`

`

`Description
`
`EP 0 755 162 A2
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`This invention relates to video processing and, more particularly, to recording andlor reproducing video data. A
`preferred form of the invention disclosed below by way of example provides a video processing apparatus and method
`tor use with an electronic still camera tor recording andror reproducing still image digital video signals and audio data
`onto andror from a recording medium such as an optical disk, a magneto—optical disk or a semiconductor memory.
`In a digital recording type electronic still camera, an image of an object may be supplied through a photographing
`or charge coupled device (COD) so as to obtain a video signal. Such video signal may be converted to digital term and
`compressed in accordance with an image compression technique of the Joint Photographic Experts Group (JPEG).
`The JPEG technique may compress still image data by using a discrete cosine transform (DOT) and length—variable
`coding. As a result, such JPEG technique may be able to compress colored still image data with a relatively high
`compression ratio, such as ‘I to 1f100. The digital compressed video signal may thereafter be recorded on a recording
`medium.
`
`The recording medium may be magneto-optical disk which is contained in a housing or cartridge. Such magneto-
`optical disk may have an outer diameter of approximately 64 mm and a thickness of approximately 1.2 millimeters.
`Further, such magneto-optical disk may have a plurality of tracks tor storing data with a track pitch ot approximately
`1.6 micrometers.
`
`The above—described magneto—optical disk/cartridge may be similar to a so—called mini—disk (MD) used to record
`audio data. Such disk may record approximately 140 Mbytes at data, which corresponds to approximately 365 still
`pictures in JPEG—compressed form and approximately 40 minutes of audio information in a so—called ATFlAC (Adaptive
`Transform Acoustic Coding) form.
`The above-described electronic still camera which records data in a digital form onto a magneto-optical disk has
`numerous advantages. For example, a relatively large number of still image data may be recorded on one disk, the
`quality ot the recorded images may remain substantially high and may not substantially deteriorate over time, compi-
`lation of data is relatively easy. and still image data may be copied into a computer. Furthermore, such use is believed
`to increase in the future.
`
`When taking photographs with an electronic still camera, an operator may wish to store audio data together with
`the still image data. Such audio data may include a narration pertaining to the circumstances of the respective photo—
`graph or photographs. Further, an operator may wish to record characters which provide information pertaining to the
`photograph(s). For example. such character(s) may describe the circumstances, places andfor dates of the photo-
`graphs. Furthermore, an operator may wish to provide a framing or ornamental pattern(s) with the photographed image.
`Additionally, an operator may wish to increase or decrease the size or scale of a still image(s) or deform such image(s).
`In accordance with an aspect of the present invention, a recording apparatus is provided which comprises a video
`entry device for introducing video data; image memory for storing the video data introduced by the video entry device;
`an image compressing device tor compressing the video data introduced by the video entry device; a switching device
`for selectively choosing between the compressed video data and uncompressed video data from the video entry device;
`and a record device tor recording the compressed video data and uncompressed video data.
`In accordance with another aspect of the present invention, a camera apparatus tor recording video and audio
`data to a recording medium having a management area and a program area is provided. The camera apparatus com—
`prises a video entry device for introducing video data; a compression device for compressing the video data from the
`video entry device; a video memory device for storing the compressed video data from the compression device; an
`audio entry device tor introducing audio data; an audio compression device for compressing the audio data from the
`audio entry device; and a recording device for recording the compressed video data and the compressed audio data
`to the program area of recording medium, and for recording file management data for managing the compressed video
`data and the compressed audio data to the management area of the recording medium.
`In accordance with still another aspect of the present invention, a camera apparatus for reproducing video and
`audio data from a recording medium having a management area and a program area is provided. The camera apparatus
`comprises a reproducing device for reproducing compressed video and audio data in accordance with file management
`data stored in the management area of the recording medium; a video memory device for storing the reproduced
`compressed video data from the reproducing device; an expanding device for expanding the compressed video data
`from the video memory device; an audio memory device for storing the reproduced compressed audio data from the
`reproducing device; and an expanding device for expanding the compressed audio data from the audio memory device.
`Recording or reproducing apparatus embodying the invention may record andror reproduce still images and audio
`data and may include an image compressingfexpanding device for compressingrexpanding video data and an audio
`compressingr'expanding device for compressingr’expanding audio data.
`Further, apparatus embodying the invention may utilize a common buffer memory for video data and audio data.
`Such use of a common buffer memory may resuit in an increase in processing speed and may reduce the complexity
`or scaie of the circuit.
`
`2
`
`HTC Exhibit 1032
`
`HTC Exhibit 1032
`
`

`

`EP 0 755162 A2
`
`Furthermore, apparatus embodying the invention may comprise a device for graphic processing of video data so
`that images with frames and characters may be recorded.
`A preferred form of implementation of the invention described hereinbelow provides:
`
`a recordingrreproducing apparatus for recording andror reproducing still image data and audio data;
`a recording/”reproducing apparatus as aforesaid which may record andfor reproduce characters which may de—
`scribe circumstances. places andfor dates of a respective photograph image(s);
`a recordinglreproducing apparatus as aforesaid which may enable a desired frame or ornamental patter(s) to be
`arranged on a photographed image; and
`a recordingi’reproducing apparatus as aforesaid in which a photographed still image(s) may be relatively easily
`modified or increased or decreased in size or scale.
`
`The invention will now be further described, by way of illustrative and nonlimiting example. with reference to the
`accompanying drawings, in which corresponding components are identified by the same reference signs. and in which:
`
`Figs. 1A and 1B are perspective views of an electronic still camera according to an embodiment of the present
`invenflon
`
`Fig. 1C is a diagram of a magneto—optical disk cartridge which may be used with the electronic still camera of Figs.
`1A and 1 B;
`
`Fig. 2 is a diagram to which reference will be made in explaining the dispiay of patterns and characters;
`Fig. 3 is a diagram of the electronic still camera of Figs. 1A and 1 B;
`Fig. 4 is a diagram to which reference will be made in explaining an image memory in the electronic still camera
`of Figs. 1A and 13;
`Fig. 5 is another diagram to which reference will be made in explaining the image memory in the electronic still
`camera of Figs. 1A and 18;
`Figs. 6A and BB are other diagrams to which reference will be made in explaining the image memory in the electronic
`still camera of Figs. 1A and 18;
`Fig. 7 is another diagram to which reference will be made in explaining the image memory in the electronic still
`camera of Figs. 1A and 18;
`Figs. BA. BB and BC are other diagrams to which reference will be made in explaining the image memory in the
`electronic still camera of Figs. 1A and 18;
`Figs 9A. QB and QC are other diagrams to which reference will be made in explaining the image memory in the
`electronic still camera of Figs. 1A and 18;
`Figs. 10A and 108 are other diagrams to which reference will be made in explaining the image memory in the
`electronic still camera of Figs. 1A and 18;
`Fig. 11 is a diagram of a tilefheaderl'table structure;
`Fig. 12 is a diagram of a narration table;
`Fig. 13 is a diagram of a directory structure; and
`Fig. 14 is a flow chart.
`
`A preferred embodiment of the present invention will now be described with reference to the accompanying draw-
`ings.
`Figs. 1A and 18 illustrate a digital type electronic still camera. Such electronic still camera is adapted to compress
`a digital still image video signal in accordance with a JPEG technique and to record the compressed signal on a
`magneto-optical disk which may be similar to a MD (minidisk) and to reproduce a recorded signal from such MD, as
`hereinafter more fully described.
`PCT application No. JP95rO1 912 filed entitled “Still Picture System" is hereby incorporated by reference.
`As shown in Figs. 1A and 1B, the present electronic still camera inciudes a main camera body 1 having a front
`surface 1A. a back surface 18, a top surface 10 and side surfaces 1 D and 1E. A lens 2 is arranged on the front surface
`1A. The lens 2 is adapted to receive an image or light rays from an object to be photographed. A microphone 11 adapted
`to receive or collect external sounds is also arranged on the front surface 1A. A liquid crystal display 3 is arranged on
`the back surface 18. The liquid crystal display 3 is adapted to display an image to be photographed or a reproduced
`image. Such liquid crystal display 3 may be utilized as a viewfinder. A shutter switch 4 and other various switches 5
`are arranged on the top surface 10. A video output terminal 6 and audio output terminals 10A and 103 are arranged
`on the side surface 1D. A disk loading aperture 8 is arranged on the other side surface 1 E. Such disk loading aperture
`8 is adapted to receive a recording medium such as a cartridge 9 containing a magneto-optical disk 51 shown in Fig. 1C.
`The magneto—optical disk 51 may have a diameter of approximately 64 mm. The magneto—optical diskicartridge
`arrangement may be similar to a musical or audio MD (minidisk). such as that previously described. Additional details
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`3
`
`HTC Exhibit 1032
`
`HTC Exhibit 1032
`
`

`

`EP 0 755162 A2
`
`pertaining to the magneto—optical disk 51 are provided in PCT application No. JP95r01912, which has been incorporated
`by reference herein.
`In operation, the lens 2 is oriented to a desired object when the electronic still camera is used to take a photograph.
`An image of such object is supplied through the lens 2 and is opto-electrically converted by a CCD photographic device
`22 (Fig. 3) included in the main camera body 1 so as to form an image signal which is stored in an image memory 31
`(Fig. 3) included in the main camera body and which is displayed on the liquid crystal display 3. When the shutter
`button 4 is activated or depressed, a still image corresponding to the image received through the lens 2 is recorded
`on the disk 51 in the cartridge 9.
`A still image recorded on the magneto—optical disk 51 may be reproduced and displayed on the liquid crystal display
`3. The still image recorded on the magneto—optical disk 51 may also be displayed on an external display screen, such
`as that of a television, if the video output terminal 6 of the main camera body 1
`is coupled to a video input terminal of
`such television. Additionally, the still image recorded on the magneto-optical disk 51 may be retrieved or provided to
`a computer, such as a personal computer. and may be compiled therein with other data by utilizing an image compiling
`application program.
`Therefore, a currently photographed image may be displayed on the liquid crystal display 3. Additionally, as shown
`in Fig. 2, the liquid crystal display 3 may display characters 102 and a pattern or patterns 101. The characters 102
`may describe information pertaining to the camera or the respective image, such as, the current mode of operation,
`place and date of the photograph. and so forth. The patterns 101 may provide a frame or ornamentation for the display.
`These characters andror patterns may be recorded on the magneto-optical disk 51 together with the image(s) by use
`of the keys 29.
`Sound collected by the microphone 11 may be recorded on the magneto—optical disk 51 in the cartridge 9. Audio
`signals reproduced from the magneto-optical disk 51 may be outputted from the audio output terminals 10A and 108.
`The present electronic still camera will now be more fully described with reference to Fig. 3A.
`The present electronic still camera generally inctudes the lens 2, the CCD device 22, a sample and hold and
`automatic gain control (AGO) circuit 32, analog-to-digital (ND) converters 33 and 45, a camera signal processing circuit
`34, a memory controller 28, an image memory 31, digital-to-analog (DEA) converters 35 and 44, a video signal process-
`ing circuit 36. a liquid crystal driving circuit 37, the liquid crystal display 3, a computer processing unit (CPU) 23, a
`ROM 25, a random access memory (RAM) 26, an image compressingi’expanding circuit 27. input key(s) 29. an intertace
`30, an audio compressioni'expanding circuit 41 , a dynamic random access memory (DRAM) 42, and a magnetooptical
`disk drive circuit 21 which are connected as shown in Fig. 3A. The magneto-optical disk drive circuit 21 generally
`includes a motor 52. an optical pick—up 53, a magnetic head 54, a servo circuit 55. a thread mechanism 56, an encoder
`57, a driver 58, a RF circuit 59. a decoder 60. and an address decoder 61 which are connected as shown in Fig. 3A.
`The CPU 23 may control recordfreproduce processing of the camera. For example, the CPU 23 may control the
`processing for recording video signals captured by the CCD photographic device 22 on the magneto-optical disk 51
`in a compressed form. processing for expansion and reproduction of signals read from the magneto-optical disk 51,
`and so forth.
`
`A CPU bus 23 connects the CPU 23, the ROM 25, the RAM 26, the image compressionfexpansion circuit 27, the
`memory controller 28, input keys 29, the audio compressionrexpansion circuit 41, the DRAM 42 and the magneto—
`optical disk drive 21 through the interface 30.
`The input keys 29 may enable an operator to input a desired command or function. One of the input keys 29 may
`be the shutter switch 4.
`
`The ROM 25 and the RAM 26 may be utilized to store programs andfor information for use in the operation of the
`present camera.
`The magneto-optical disk (or optical disk) 51 contained in a cartridge 9 may be loaded into the magneto-optical
`disk drive 21. A digital video signal compressed by a JPEG technique or a digital audio signal may be recorded on and
`reproduced trom the magneto—optical disk 51. Data stored on the magneto—optical disk 51 may be accessed by use of
`respective addresses. Such addresses may be provided or recorded in accordance in a socalled Wobble format.
`The magneto—optical disk 51 is rotated by the spindle motor 52. The optical pick—up 53 and the magnetic head 54
`are arranged so as to be adjacent to the magneto—optical disk 51 and are adapted to move in a radial direction across
`the disk 51 by the thread mechanism 56. The servo circuit 55 receives a focus and tracking error signal from the RF
`circuit 59 and, in response thereto, generates a control signal(s) which is supplied to the spindle motor 52 and the
`thread mechanism 56. As a result, the spindle motor 52 and the thread mechanism 56 are controlled which,
`in turn
`provides focus and tracking control of a double-shaft or two-axes device of the optical pick-up 53.
`As hereinafter more fully described, data to be recorded is supplied through the interface 30 to the encoder 57 so
`as to encoded in a predetermined manner. An encoded signal from the encoder 57 is supplied to the magnetic head
`54 by way 01 the driver 58. As a result, a laser beam from the optical pick-up 53 and a modulated magnetic field from
`the magnetic head 54 are applied to the magnetic disk 51.
`During reproduction, a laser beam from the optical pick—up 53 is irradiated onto the magneto—optical disk 51 and
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`4
`
`HTC Exhibit 1032
`
`HTC Exhibit 1032
`
`

`

`EP 0 755162 A2
`
`reflected light therefrom is supplied to the RF circuit 59. wherein a reproduced signal is obtained. Such reproduced
`signal is supplied tothe decoder 60 and the address decoder 61. The address decoder decodes or detects the Wobble
`addresses and provides a output to the decoder 60. As a result. a decoded signal is formed and supplied from the
`decoder 60 to the interface 30.
`
`The lens 2 is disposed in front of the CCD photographic device 22. During recording, light from an object to be
`photographed is supplied through the lens 2 and focused onto a light detecting plane of the CCD photographic device
`22 so as to be photo-electrically converted to an image signal. Such image signal is supplied through the sampie and
`hold andror AGC circuit 32 to the ND converter 33 so as to be converted into digital form. The digital image signal
`from the ND converter 33 is supplied to the camera signal processing circuit 34 so as to form component video signals,
`such as a luminance signal Y and chromatic difference signals Fi—Y (Fted — Y) and B—Y (Blue — Y).
`The data capacity or sampling rate of the Y, Ft-Y and B-Y signals from the camera signal processing circuit 34 may
`be expressed as a ratio, such as a ratio of the luminance information Y to the chromatic information Ft-Y to the chromatic
`information B—Y. More than one video signal ratio or mode may be utilized. For example, video modes or ratios of 4:2:
`0 (Main profile at main level) and 4:212 (Option) may be utilized.
`Accordingto ITU-P. (lTU-Fiadio communication Sector) recommendation BT,601 , the luminance signal Y is sampled
`at 13.5 MHz, and the chromatic signals are each sampled at 6.75 MHz (13.5r’2 MHZ). Such sampling rates may provide
`the 4:2:2 ratio.
`
`On the other hand, the ratio of 420 may not always be fixed. That is, such ratio may change between 42:0 and
`40:2 depending upon the respective line of a field. More specifically, on an odd line of a field. the ratio of Y:Fi-Y:B-Y
`may be 4:0:2. On the other hand. on an even line of the field. the ratio of Y; Ft—Y: B—Y may be 4:02. Thus, the ratio 4:2:
`0 and 4:02 is dependent upon the respective line and provides an indication or difference between the odd or even
`line of a field.
`
`The camera signal processing circuit 34 may also perform additional processing, such as that pertaining to gamma
`correction, aperture correction. shading processing, and so forth.
`Under control of the memory controller 28, the video signal from the camera signal processing circuit 34 is supplied
`to the image memory 31 and then to the BIA converter 35 so as to be converted into analog form. An analog output
`signal from the D/A converter 35 is supplied to the video signal processing circuit 36. An output from the video signal
`processing circuit 36 may be supplied through the liquid crystal driver 37 to the liquid display 3. Such liquid display 3
`may be used as a view finder during photographing. The video signal processing circuit 36 may also form a composite
`video signal from the received analog signal. Such composite signal may have a predetermined format, such as that
`corresponding to an NTSC (national television system committee) format. The composite signal may be outputted from
`an analog video signal output terminal 38.
`When the shutter button 4 (Fig. 1) is pressed during recording, a video signal of an image may be supplied to the
`image memory 31. That is, the video signal supplied to the image memory 31 may be first supplied to the image
`compressionfexpansion circuit 27 by way of the CPU bus 27. The image compressionrexpansion circuit 2? is adapted
`to compress and expand a digital video signal in accordance with a JPEG technique, wherein such JPEG compression
`technique may involve DCT conversion and variable-length coding of the digital video signal. The compressed video
`signal from the image compressionlexpansion circuit 27 may be supplied by way of the controller 28 to the image
`memory 31.
`The compressed video signal from the image compressioni’expansion circuit 27 may be further supplied to the
`encoder 57 of the magneto-optical disk drive 21 by way of the CPU bus 24 and interface 30. The encoder 57 is adapted
`to perform error correction coding, such as that in accordance with ACIFiC (Advanced Cross interleaved Reed Soiomon
`Coding), and to modulate the received signal in accordance with a predetermined modulation technique. such as a
`so-called eight-to-fourteen modulation technique. An output of the encoder 57 is supplied through the driver 58 to the
`magnetic head 54. The optical pick-up 53 directs a laser beam onto the magneto-optical disk 51, and a magnetic field
`modulated by an output of the encoder 57 is applied to the magnetic head 54. As a result. a video signal in compressed
`form may be recorded on the magneto—optical disk 51 .
`Alternatively, a video signal to be recorded on the magneto—optical disk 51 may be selectively processed so as to
`be in either compressed or uncompressed form. That is.
`it it is desired to record an uncompressed video signal. the
`video signal from the camera signal processing circuit 34 may be provided to the encoder 57 by way of the memory
`controller 28. the CPU bus 24 and the interface 30 without being compressed by the image compressionfexpansion
`circuit 27. On the other hand, if it is desired to record a compressed video signal. the video signal from the camera
`signal processing circuit 34 may be provided to the image compressioni'expansion circuit 27 so as to be compressed
`prior to being supplied to the encoder 57.
`in a manner similar to that previously described. The routing of signals or
`selection as to whether a video signal to be recorded is compressed or not may be controlled by the CPU 23. Such
`selection operation may be performed by a switching device 99 which is controlled by the CPU 23.
`During recording, the video signal stored in the image memory 31 is supplied tothe DIA converter 35 and an output
`therefrom is supplied to the video signal processing circuit 36. An output of the video signal processing circuit 36 is
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`5
`
`HTC Exhibit 1032
`
`HTC Exhibit 1032
`
`

`

`EPO755162A2
`
`supplied through the liquid crystal driver 37 to the liquid crystal display 3. As a result, the photographed image is
`displayed on the liquid crystal display 3.
`As hereinafter more fully described, the image memory 31 includes a luminance signal data area, a chromatic
`signal data area, a pattern data area and a character data area. Pattern data and character data may be respectively
`supplied to the pattern data area and character data area. The pattern data and character data may be combined with
`the luminance signal data and chromatic signal data. The video data incorporating the pattern data and the character
`data may be displayed on the liquid crystal display 3 and recorded on the magneto-optical disk 51.
`During reproduction, an image to be reproduced is identified or designated by use of the input keys 29. Upon such
`designation, the optical pick—up 53 may be moved to the location oraddress corresponding to the designated recorded
`image, and compressed video signals representative of the designated image may be retrieved from the magneto—
`optical disk 51. In a manner similar to that previously described, such retrieved or reproduced signal is supplied to the
`decoder 60 by way of the RF amplifier 59 so as to be decoded or processed thereat. For example, such processing
`may involve data demodulation, error correction, and so forth. An output of the decoder 60 is supplied to the DRAM
`42 by way of the interface 30 and the CPU bus 24 and stored therein. Data from the DRAM 42 is supplied to the image
`compressionrexpansion circuit 27 by way of the CPU bus 24. The image compression/expansion circuit 27 expands
`the received JPEG-compressed video signal which may be stored in the image memory 31 under the control of the
`memory controller 28. The stored video signal from the image memory 31 is supplied to the DEA converter 35 so as to
`be converted into analog form which is supptied to the video signal processing circuit 36. An output of the video signal
`processing circuit 36 is supplied to the liquid crystal display 3 by way of the liquid crystal driver 37. The video signal
`processing circuit 36 may form a composite video signal having a predetermined or NTSC format. Such composite
`video signal may be outputted at the analog signal output terminal 38.
`The present electronic still camera may record andfor reproduce still image data and audio data. When audio data
`is recorded, audio signals are supplied through the input terminal 45 to the AID converter 43 so as to be converted
`into digital form. A digital audio output signal from the ND converter 43 is supplied to the audio compressionrexpansion
`circuit 41 and compressed thereat. The compressed audio data is once stored in the DRAM 42, and then supplied to
`the encoder 57 of the magneto-optical disk drive 21 through the interface 30. After the encoder 57 executes error
`correction coding and modulation, the compressed audio signals are recorded.
`When audio data is reproduced, compressed audio data from the magnetooptical disk 51 is reproduced therefrom
`in a manner similar tothat previously described with regard to the image data. The reproduced compressed audio data
`is supplied to the decoder 60 by way of the RF amplifier 59. A decoded compressed audio signal from the decoder 60
`is supplied by way of the interface 30 and the CPU bus 24 to the DRAM 42 so as to be stored therein. Such stored
`audio signal is supplied from the DRAM 42 to the audio compressionr’expansion circuit 41 and expanded thereat. The
`audio signal is then supplied to the WA converter 44 and converted to analog form and outputted from the output
`terminal 46.
`
`The method used for compressing andror recording the audio signal may be similar to that used for compressing
`andi’or recording musical—type MD‘s. Accordingly, a musical MD may be inserted into the magneto—optical disk drive
`21, whereupon the present electronic still camera may be used as a musical MD player.
`Audio information corresponding to video information may be recordedlreproduced toffrom the recording medium
`51 by utilizing a predetermined file structure. Such file structure may provide a socalled management area wherein
`management data may be provided for controlling predetermined operations. The file structure may further provide a
`so-called program area wherein data such as video and audio data may be provided. Accordingly, by utilizing such file
`structure, the medium 51 may have a management area and a program area. Details pertaining to one type of such
`file structure are presented below.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`File structure:
`
`File names conform to MS—DOS format as shown below:
`
`50
`
`PMF: management file
`PMP: video data file
`PMX: Index video data file
`PMA: Audio data file
`PMO: other data file
`PMA File
`
`PMA file used as audio data file.
`
`File name: NR*nnnnn. PMA
`
`This file name presents narration data file (An audio data file corresponding to a video image file).
`
`6
`
`HTC Exhibit 1032
`
`HTC Exhibit 1032
`
`

`

`
`The nnnnn means number.
`
`The video image file corresponding to the audio data file is discriminated by the number tnnnnn).
`
`EP0755162A2
`
`PMA file
`Audio data file
`NRA nnnnnPMA
`
`This file is mandatorily read and written in equipment which has a narration function.
`The content of this file is tree.
`nnnnn '. number
`NHB nnnnnPMA
`
`This file is optical in equipment which has a narration function. No read and write function is allowed. The content
`of this file is free.
`nnnnn:number
`NRC-NRGnnnnn. PMA
`
`This file is optional in equipment which has a narration tunction. No read and write function is allowed. This file is
`for multi—Iingual applications.
`nnnnn:number
`MSCnnnPMA file
`
`This file is a BGM data file tor slide shows using multiple images.
`nnn:number
`
`See Fig. 11, for an illustration of a file structure. header structure and table structure.
`Types of tables -
`
`-_:
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`HTC Exhibit 1032
`
`HTC Exhibit 1032
`
`

`

`EP 0 755162 A2
`
`_
`
`table
`
`
`
`h
`
`12h
`
`
` Copyright information
`
`
`
`é—-
`
`
`i-—
`
`Color management
`2
`1
`
`
`parameter table
`L
` imanagement table
`
`.
`
`
`
`
`
`
`
`I table
`‘
`
`
`
`HTC Exhibit 1032
`
`2h
`
`_Divided-picture
`
`23h
`
`T
`
`i
`
`I
`
`l Camera information table
`
`Scanner Information
`
`25h
`
`-table
`
`Appearance information
`
`
`
`Narration table
`
`| '
`
`5
`
`I
`
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`HTC Exhibit 1032
`
`

`

`EP 0 755162 A2
`
`Laboratory information
`
`
`
`
`
`
`itable
`
`
`
`i 1
`
`Optional table
`
`90h
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`Format version
`
`File form : Sort of file torm
`20h : NR*nnnnn.PMF tile Narration data file
`21h : MSCnnnPMA tile BGM data file
`
`See Fig. 12—
`
`Mode
`
`Total time
`
`Start time
`
`Effective time
`
`Character set code
`
`Name is described by Character set code.
`
`Audio mode is indicated in b0 to b3.
`
`Total time of narration in 12 second units
`Not definediFFFFH
`
`Actual start time in 112 second units
`Not defineszFFFh
`Actual start time to actual end time in 12 second units
`Not defined1FFFFh
`
`OOh:ASC|I
`01h:ISO-8859-1
`02h:Shifted JIS
`Otherzfieserved
`
`In addition to a narration mode. other modes are also available. For example, a so-calied BGM or background
`music mode may also be provided. Such mode may be utilized for providing background music. The narration mode
`and BGM mode may have similar arrangements or structures.
`Fig. 13 illustrates an example of a directory structure.
`An operational flow chart is provided in Fig. 14. An explanation of such flow chart is provided below.
`It a user wishes to reproduce a still image, the user operates the operation key(s} such that the system accesses
`a U—TOC (user Table of Content) information and reads the PIC—MD as a directory management file. A system controller
`controls the optical pick—up so as to access the still image data file and the narration data file corresponding to the
`image data tile in accordance with the PICnnnngninumberi directory data which is managing the image data and nar-
`
`ration data. The Narration data tile is managed by the PMA file of the PlCnnnnn directory data and the lmage data file
`
`is managed by the PMX tile of the PlCnnnnn directory data. The system controller controls the display means so as
`to display the running time, remaining time etc. in accordance with Total time. Start time. and Effective time of the
`Narration Table data. Further. the system controller also controls the display means so as to display atitle corresponding
`to name, data etc. in accordance with Title and Character Identification Code 01 the Narration Table data.
`
`End of File Structure Description
`
`In addi