`
`
`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`ZTE CORPORATION, and ZTE (USA), Inc.,
`
`
`Petitioner
`
`v.
`
`HITACHI MAXELL, LTD
`Patent Owner
`
`
`
`
`
`
`
`U.S. PATENT NO. 8,339,493
`Case IPR No.: To Be Assigned
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`DECLARATION OF DR. BARMAK MANSOORIAN IN SUPPORT OF
`PETITIONS FOR INTER PARTES REVIEW OF U.S. PATENT NO. 8,339,493.
`
`
`
`
`
`
`
`
`
`
`
`ZTE Exhibit 1002
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 1 of 52
`
`
`
`
`
`Table of Contents
`
`Page
`
`INTRODUCTION .......................................................................................... 3
`I.
`QUALIFICATIONS ....................................................................................... 4
`II.
`SCOPE OF OPINION .................................................................................... 7
`III.
`IV. MATERIALS REVIEWED AND CONSIDERED ....................................... 7
`V.
`LEVEL OF ORDINARY SKILL IN THE ART ............................................ 8
`VI. LEGAL PRINCIPLES .................................................................................... 9
`VII. TECHNOLOGY BACKGROUND OF THE ‘493 Patent ........................... 11
`A.
`Evolution of Digital Camera .............................................................. 11
`B.
`Image Processing in Digital Cameras ................................................ 12
`C.
`Image Stabilization Technology ......................................................... 13
`D.
`Evolution of Camera Phone ............................................................... 14
`VIII. OVERVIEW OF THE U.S. PATENT NO. 8,339,493 (“‘493 Patent”) ....... 15
`IX. OVERVIEW OF THE PRIOR ART REFERENCES .................................. 18
`A. U.S. Patent No. 5,493,335 (“Parulski ‘335”) (EX. 1003) .................. 18
`B.
`U.S. Patent No. 5,440,343 (“Parulski ‘343”) (EX. 1004) .................. 19
`C.
`U.S. Patent No. 5,497,192 (“Ishizuka ‘192”) (EX. 1005) .................. 20
`D. U.S. Patent No. 5,828,406 (“Parulski ‘406”) (EX. 1006) .................. 21
`E.
`U.S. Patent No. 6,512,541 (“Dunton ‘541”) (EX. 1007) ................... 22
`CLAIM CONSTRUCTION ......................................................................... 23
`X.
`XI. SPECIFIC GROUNDS OF CHALLENGE .................................................. 25
`A. Ground A: Under 35 U.S.C. § 103, Parulski ‘335 (Ex. 1003) in
`view of Parulski ‘343 (Ex. 1004) renders independent claim 5
`obvious. .............................................................................................. 25
`Ground B: Under 35 U.S.C. § 103, Parulski ‘335 (Ex. 1003) in
`view of Parulski ‘343 (Ex. 1004) and Ishizuka ‘192 (Ex. 1005),
`renders dependent claim 6 obvious. ................................................... 33
`
`B.
`
`1
`
`ZTE Exhibit 1002 - 2
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 2 of 52
`
`
`
`
`
`
`
`
`C.
`
`Ground C: Under 35 U.S.C. § 103, Parulski ‘406 (Ex. 1006) in
`view of Dunton ‘541 (Ex. 1007) renders independent claim 5
`obvious. .............................................................................................. 36
`D. Ground D: Under 35 U.S.C. § 103, Parulski ‘335 (Ex. 1003) in
`view of Parulski ‘343 (Ex. 1004) and Ishizuka ‘192 (Ex. 1005),
`renders dependent claim 6 obvious. ................................................... 47
`
`2
`
`ZTE Exhibit 1002 - 3
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 3 of 52
`
`
`
`
`
`I.
`
`INTRODUCTION
`
`My name is Barmak Mansoorian, and I have been retained by counsel
`
`for ZTE (USA) as an expert witness to opine on certain issues relating to U.S.
`
`Patent No. 8,339,493 titled “ELECTRIC CAMERA” (“the ‘493 Patent) in ZTE’s
`
`Petition for Inter Partes Review of the ‘493 Patent (“ZTE IPR Petition”) which
`
`requests the Patent Trial and Appeal Board (“PTAB”) to review and cancel Claims
`
`5 and 6, which based on my knowledge, are all the claims that are currently being
`
`asserted in a patent litigation against ZTE.
`
`In this declaration, I will discuss the technology related to the ‘493
`
`Patent, including an overview of the technology as it was known prior to, and up to
`
`the time of the filing of the applications. The overview of the relevant technology
`
`provides some of the basis for my opinions with respect to the ‘493 Patent.
`
`My opinions are based on my years of education, research and
`
`experience, as well as my investigation and study of relevant materials. In forming
`
`my opinion, I have relied on information and evidence identified in this
`
`declaration, including the ‘493 Patent, the prosecution history of the ‘493 Patent,
`
`and prior art references listed as Exhibits to the Petition for Inter Partes Review of
`
`the ‘493 Patent.
`
`I may rely upon these materials, my knowledge and experience,
`
`and/or additional materials to rebut arguments raised by the patent owner. Further,
`
`3
`
`ZTE Exhibit 1002 - 4
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 4 of 52
`
`
`
`
`
`I may also consider additional documents and information in forming any
`
`necessary opinions, including documents that may not yet have been provided to
`
`me.
`
`My analysis of the materials produced in this investigation is ongoing
`
`and I will continue to review any new material as it is provided. This declaration
`
`represents only those opinions I have formed to date. I reserve the right to revise,
`
`supplement, and/or amend my opinions stated herein based on new information
`
`and on my continuing analysis of the materials already provided.
`
`I am being compensated on a per hour basis for my time spent
`
`working on issues in this case. My compensation does not depend on the outcome
`
`of this matter or the opinions I express.
`
`II. QUALIFICATIONS
`Attached hereto as Appendix A is a true and correct copy of my
`
`curriculum vitae. I have summarized by educational background, work
`
`experience, and relevant qualifications in this section.
`
`I am the founder and president of Forza Silicon Corporation and one
`
`of the world’s leading experts in CMOS image sensors.
`
`I have been involved in image sensor design for over 20 years as
`
`scientist, product developer, entrepreneur and mentor. My focus was in mixed-
`
`signal integrated circuit design, semiconductor device physics and device micro-
`
`4
`
`ZTE Exhibit 1002 - 5
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 5 of 52
`
`
`
`
`
`fabrication with specialization in active pixel sensors (APS), infrared focal plane
`
`array technology and high-speed communication. I have summarized in this
`
`section my educational background, work experience, and other relevant
`
`qualifications
`
`I received my Bachelor of Science degree and Master of Science
`
`degree in Electrical Engineering from University of California, San Diego in 1988
`
`and 1990, respectively. In 1994, I received my Ph.D. degree in Applied Physics
`
`from University of California, San Diego. My dissertation was on on-chip optical
`
`interconnections using Lead Lanthanum Zirconium Titanate material.
`
`After receiving my Ph.D. degree in 1994, I worked at Jet Propulsion
`
`Laboratory for one year as a member of technical staff. I was responsible for the
`
`development of large format APS sensors. This work resulted in a 1Kx1K pixel
`
`sensor with on-chip analog-to-digital converters – at the time the highest resolution
`
`image sensor with integrated ADC and digital interface.
`
`While at Jet Propulsion Laboratory, I also worked on research on APS
`
`imagers also led to the development of CMOS image sensor arrays with a record
`
`low noise performance that was not improved upon by the industry until 2003.
`
`While at Jet Propulsion Laboratory, I was the recipient of the NASA
`
`Group Achievement Award, along with the Active Pixel Image Sensor team.
`
`5
`
`ZTE Exhibit 1002 - 6
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 6 of 52
`
`
`
`
`
`From 1995 to 1999, I worked at Photobit Corporation as senior
`
`scientist and director of technical marketing. I was responsible for new image
`
`sensor product development, technical interface with customers and fabrication
`
`facilities, and business development in Japan and Korea.
`
`While at Photobit Corporation, I was the lead designer responsible for
`
`a series of high resolution, high-speed image sensors that, successively, held the
`
`resolution/speed performance records for CMOS image sensors.
`
`While at Photobit Corporation, I was also responsible for the
`
`development of a very high dynamic range image sensor capable of “moonlight to
`
`sunlight” imaging (0.01 lux to 20000 lux) targeted for security and machine vision
`
`applications.
`
`From 1999-2001, I worked at Optical Micro Machines Corporation as
`
`director of hardware engineering. I was responsible for the development of
`
`electronics hardware for MEM’s based optical switches. I managed the design of
`
`96-channel, 300 volt, 14-bit amplifier IC’s and the activities of 20+ engineers in
`
`designing the components for switch network products.
`
`In 2001, I started Forza Silicon Corporation. The corporation is fully
`
`dedicated to the development of high-performance mixed-signal integrated circuits
`
`for imaging and high-speed communication.
`
`6
`
`ZTE Exhibit 1002 - 7
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 7 of 52
`
`
`
`
`
`I hold 21 patents in image sensor design and have contributed to 12
`
`articles in imaging and high-speed communication.
`
`A complete list of publication is provided in my curriculum vitae,
`
`which is attached as Appendix A.
`
`III. SCOPE OF OPINION
`I have been asked to provide my opinions regarding whether claims 5
`
`and 6 of the U.S. Patent No. 8,339,493 (“the ‘493 Patent”) would have been
`
`obvious to one of ordinary skill in art at the time of the alleged invention in view of
`
`U.S. Patent No. 5,493,335 (“Parulski ‘335,” Ex. 1003), U.S. Patent No. 5,440,343
`
`(“Parulski ‘343,” Ex. 1004), U.S. Patent No. 5,497,192 (“Ishizuka ‘192,” Ex.
`
`1005), U.S. Patent No. 5,828,406 (“Parulski ‘406,” Ex. 1006), and U.S. Patent No.
`
`6,512,541 (“Dunton ‘541,” Ex. 1007).
`
`This declaration, including the exhibits hereto, sets forth my opinion
`
`on this topic.
`
`IV. MATERIALS REVIEWED AND CONSIDERED
`In connection with my work on this matter, I have reviewed and
`
`considered the following documents:
`
`7
`
`ZTE Exhibit 1002 - 8
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 8 of 52
`
`
`
`
`
`Exhibit
`Exhibit No.
`Ex.1001 U.S. Patent No. 8,339,493 (“the ‘493 Patent”)
`Ex.1003 U.S. Patent No. 5,493,335 (“Parulski ‘335”)
`Ex.1004 U.S. Patent No. 5,440,343 (“Parulski ‘343”)
`Ex.1005 U.S. Patent No. 5,497,192 (“Ishizuka ‘192”)
`Ex.1006 U.S. Patent No. 5,828,406 (“Parulski ‘406”)
`Ex.1007 U.S. Patent No. 6,512,541 (“Dunton ‘541”)
`Prosecution History of U.S. Patent No. 8,339,493 (“the ‘493 file
`Ex.1008
`history”)
`
`I also have relied on my academic and professional experience in
`
`reaching the opinions expressed in this declaration.
`
`V. LEVEL OF ORDINARY SKILL IN THE ART
`In rendering the opinions set forth in this declaration, I was asked to
`
`consider the patent claims and the prior art through the eyes of a person of ordinary
`
`skill in the art. I considered factors such as the educational level and years of
`
`experience of those working in the pertinent art; the types of problems encountered
`
`in the art; the teachings of the prior art; patents and publications of other persons or
`
`companies; and the sophistication of the technology. I understand that a person
`
`ordinary skill in the art is not a specific real individual, but rather a hypothetical
`
`individual having the qualities reflected by the factors discussed above.
`
`In my opinion, a person ordinary skill in the art, at the time of the
`
`‘493 Patent, would have been aware of electric camera generating still and moving
`
`images using different operating modes. Such person ordinary skill in the art
`
`would have a Bachelor’s Degree in Electrical Engineering, Computer Engineering
`
`8
`
`ZTE Exhibit 1002 - 9
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 9 of 52
`
`
`
`
`
`and/or Computer Science with 3 years industry experience working with imaging
`
`systems. Extensive experience and technical training may substitute for
`
`educational requirements, while advanced education such as a relevant M.S. or
`
`Ph.D. might substitute for experience.
`
`VI. LEGAL PRINCIPLES
`I understand that, when construing claim terms, a claim subject to
`
`inter partes review receives the “broadest reasonable construction in light of the
`
`specification of the patent in which it appears.” I further understand that the
`
`broadest reasonable construction is the broadest reasonable interpretation of the
`
`claim language, and that any term that lacks a definition in the specification is also
`
`given a broad interpretation.
`
`I understand that there are two ways in which prior art may render a
`
`patent claim unpatentable. First, the prior art can be shown to “anticipate” the
`
`claim. Second, the prior art can be shown to have made the claim “obvious” to a
`
`POSITA.
`
`I understand that in order for a patent claim to be valid, the claimed
`
`invention must be novel. In order for the invention to be anticipated, every
`
`element of the claimed invention, as arranged in the claim, must be disclosed either
`
`specifically or inherently by a single prior art reference. Every element of the
`
`challenged claim need not be expressly defined in a single prior art reference, but
`
`9
`
`ZTE Exhibit 1002 - 10
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 10 of 52
`
`
`
`
`
`may be inherently disclosed by prior art if “the prior art necessarily functions in
`
`accordance with the limitations” of the challenged claim. I also understand that a
`
`prior art reference must be enabling in order to anticipate a patent claim.
`
`I understand where a prior art reference discloses less than all of the
`
`limitations of a given patent claim, that patent claim is invalid if the differences
`
`between the claimed subject matter and the prior art reference are such that the
`
`claimed subject matter as a whole would have been obvious at the time the
`
`invention was made to a person having ordinary skill in the relevant art. I further
`
`understand that an obviousness analysis takes into consideration factual inquiries
`
`such as the level of ordinary skill in the art, the scope and content of the prior art,
`
`and the differences between the prior art and the patent claim.
`
`I understand that the U.S. Supreme Court has recognized several
`
`rationales for combining references and for modifying a reference as part of an
`
`obviousness analysis. These rationales include combining prior art elements
`
`according to known methods to yield predictable results, simple substitution of a
`
`known element for another to obtain predictable results, a predictable use of prior
`
`art elements in accordance with their established functions, applying a known
`
`technique to improve a known device (or process) and yield predictable results,
`
`and choosing from a finite number of known predictable solutions with a
`
`reasonable expectation of success. It is further my understanding that an
`
`10
`
`ZTE Exhibit 1002 - 11
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 11 of 52
`
`
`
`
`
`obviousness analysis takes into consideration whether the prior art provides a
`
`teaching, suggestion or motivation to combine teachings of multiple prior art
`
`references to arrive at the patent claim.
`
`I also understand that the earliest possible priority date for the ‘493
`
`Patent is July 28, 2010. I have therefore analyzed obviousness as of that date or
`
`somewhat before that date.
`
`VII. TECHNOLOGY BACKGROUND OF THE ‘493 Patent
`A. Evolution of Digital Camera
`The history of the digital camera began with Eugene F. Lally of the
`
`Jet Propulsion Laboratory, who was thinking about how to use a mosaic
`
`photosensor to capture digital images.
`
`The camera generally recognized as the first digital camera was
`
`designed and developed by Eastman Kodak engineer Steven Sasson in 1975. This
`
`work lead to U.S. Patent No. 4,131,919, titled “Electronic still camera,” and issued
`
`to Lloyd and Sasson.
`
`The Sasson prototype digital camera comprised of a lens from an
`
`8mm film camera, an analog-to-digital converter from a Motorola digital
`
`voltmeter, and a digital-data cassette recorder for storing image data. The
`
`prototype camera captured and stored black and white still images on to a cassette
`
`tape and it took 23 seconds to capture and store each image.
`
`11
`
`ZTE Exhibit 1002 - 12
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 12 of 52
`
`
`
`
`
`Canon was the first company to sell electronic still cameras in the
`
`U.S. The Canon RC-701 electronic camera was introduced in 1986. By 1989,
`
`many other companies, including Fuji, Konica, Minolta, Nikon, Olympus, Sony
`
`and Panasonic were selling electronic still cameras
`
`In 1986, Japanese company Nikon introduced the first digital single-
`
`lens reflex (DSLR) camera, the Nikon SVC. In the mid-to-late 1990s, DSLR
`
`cameras became common among consumers. By the mid-2000s, DSLR cameras
`
`had largely replaced film cameras.
`
`Almost all of the digital cameras include an image sensing device to
`
`capture light coming through the lens to form image signals, an image signal
`
`processing device to process the signal, and a display device to display captured
`
`images. Additionally, most cameras would have a mode selector that the user can
`
`select to record still images or videos.
`
`B.
`
`Image Processing in Digital Cameras
`
`Digital image processing is the use of computer algorithms to perform
`
`image processing on digital images. Many of the techniques of digital image
`
`processing, or digital picture processing as it often was called, were developed in
`
`the 1960s at the Jet Propulsion Laboratory, Massachusetts Institute of Technology,
`
`Bell Laboratories, University of Maryland, and a few other research facilities. An
`
`12
`
`ZTE Exhibit 1002 - 13
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 13 of 52
`
`
`
`
`
`image processor is a specialized digital signal processor (DSP) used for image
`
`processing in digital cameras, mobile phones or other devices.
`
`Digital cameras included a software programmable processor which
`
`controlled the camera hardware in order to capture, store and retrieve images.
`
`Every digital camera also has a device called a sensor to capture light coming
`
`through the lens to form an image.
`
`A digital camera uses an array of millions of tiny light cavities
`
`photosites to record an image. To capture color images, a filter has to be placed
`
`over each cavity that permits only particular colors of light. The most common
`
`type of color filter array is called a “Bayer array,” which is a mosaic of filters used
`
`to determine color. The filter pattern is 50% green, 25% red and 25% blue, hence
`
`is also called BGGR, RGBG, GRGB, or RGGB. The image processor then
`
`evaluates the color and brightness data of a given pixel, compares them with the
`
`data from neighboring pixels and then uses a demosaicing algorithm to produce an
`
`appropriate color and brightness value for the pixel.
`
`C.
`
`Image Stabilization Technology
`
`As digital cameras become smaller, pictures are increasingly prong to
`
`blurring from shaky hands.
`
`Image stabilization was first introduced by Canon in 1995. Canon
`
`published the idea of stabilized zoom lens in the U.S. in a 1976 in a patent titled
`
`13
`
`ZTE Exhibit 1002 - 14
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 14 of 52
`
`
`
`
`
`“Image stabilizing optical system having a variable prism,” U.S. Patent No.
`
`3,942,862. Since its introduction, image stabilization has appeared in products
`
`such as digital single lens reflex cameras (DSLR), video cameras, camera phones
`
`and binoculars.
`
`Different companies have different names for image stabilization
`
`technology; for example, Nikon uses Vibration Reduction (VR), Canon uses Image
`
`Stabilizer (IS), Minolta and Konica Minolta uses Anti-Shake (AS), Olympus uses
`
`In Body Image Stabilization (IBIS), Sony uses Optical SteadyShot (OSS) and HTC
`
`uses UltraPixel.
`
`There are two types of implementation of stabilization: lens-based or
`
`body-based. The advantage of lens-based stabilization is that each stabilization
`
`hardware is dedicated to a single lens; it stabilizes both the image on the sensor and
`
`the image in the viewfinder. The advantage of body-based stabilization is that it is
`
`operational with every lens mounted on the camera, which is cost effective to
`
`consumers.
`
`D. Evolution of Camera Phone
`The camera phone is the result of converging and enabling
`
`technologies. In May 1999, Kyocera Corporation release of the VP-210
`
`VisualPhone, the world’s first mobile color videophone that also doubled as a
`
`camera phone for still photos. By the mid-2000s, higher-end cell phones had an
`
`14
`
`ZTE Exhibit 1002 - 15
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 15 of 52
`
`
`
`
`
`integrated digital camera. By the beginning of the 2010s, almost all smartphones
`
`had an integrated digital camera.
`
`First U.S. camera phone was Sanyo SCP-5300, released in November
`
`2002. Sprint’s PM8920 reached U.S. shores in July 2004, delivering market-
`
`leading 1.3 megapixel images that could be shared wirelessly or even printed.
`
`From 2004 to 2008, Nokia and Sony fought for control of the camera phone
`
`market, Samsung stormed the market in 2007. Today, camera phones have strong
`
`photography capabilities and the consumer market ranges from 20 to 40
`
`megapixels.
`
`VIII. OVERVIEW OF THE U.S. PATENT NO. 8,339,493 (“‘493 Patent”)
`The ‘493 Patent relates to an electric camera using imaging sensing
`
`device with a large number of pixels. Ex. 1001 at 2:57-62. The ‘493 Patent is
`
`directed to the use of camera elements and algorithms in the generation of images
`
`and videos and such imaging device has a sufficient number of pixels to capture
`
`highly detailed still images that use all pixel lines and to capture reduced quality of
`
`moving video image that use mixed or culled pixel lines. Id. at 3:9-13. The ‘493
`
`Patent further relates to use of an image-instability detector to detect and correct
`
`image instability. Id. at 6:61-7:3.
`
`The block diagram in Figure 1 below shows the configuration of an
`
`electric camera according to the invention.
`
`15
`
`ZTE Exhibit 1002 - 16
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 16 of 52
`
`
`
`
`
`
`
`The camera invention includes an image sensing device 3 which the
`
`pixels are arranged horizontally and vertically in a grid format. Id. at 4:37-41. The
`
`grid-arranged pixels include color filters that are capable of passing yellow (Ye),
`
`green (G) and cyan (Cy), respectively, and the process is repeated horizontally
`
`every three pixels, as shown in FIG. 2. Id. at 4:42-46.
`
`
`
`16
`
`ZTE Exhibit 1002 - 17
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 17 of 52
`
`
`
`
`
`The color sensitive filters are further supported in FIGs. 13A and 13B
`
`that “[t]hese color filters in both examples are arranged in vertical stripes and,
`
`regardless of the number of pixels to be vertically mixed or culled, the R, G, B
`
`primary color signals can be generated from one line of output signals.” Id. at
`
`15:26 – 15:30.
`
`The camera invention also includes a signal processing circuit 7 that
`
`has a function of using output signals from the image sensing device 3 to generate
`
`image signals. Id. at 3:30-31. The signal processing circuit performs color signal
`
`processing and luminance signal processing, such as process of “color signals,
`
`gamma correction, white balance processing and outline enhancement.” Id. at
`
`6:11-15.
`
`Additionally, the camera invention is designed to produce output
`
`signals conforming to a television system. Id. at Abstract. It requires a display unit
`
`that is capable of displaying industry standard television signals such as NTSC or
`
`PAL. Id. at 1:30-34.
`
`Furthermore, ‘493 Patent realizes the image stabilizing function. The
`
`gyro sensors 16a, 16b detect vertical and horizontal image instabilities and the
`
`image instability decision circuit 17 checks and converts the instability information
`
`into the number of pixels in vertical and horizontal directions. Id. at 7:10-16.
`
`17
`
`ZTE Exhibit 1002 - 18
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 18 of 52
`
`
`
`
`
`Based on the converted pixel numbers, the position of the effective pixel area is
`
`shifted in a direction that cancels the image instability. Id. at 7:16-21.
`
`The ‘493 Patent proposes static image mode and video mode. When
`
`the camera is in static image mode, all signal charges in the pixel sensor element
`
`are used to produce high resolution images. Id. at 16:42-46.When monitoring and
`
`not recording, the image is formed using pixel lines that have been formed as a
`
`mixture of other pixel lines. Id. at 16:47-53. The image only includes pixel lines
`
`that are separated from each other by a certain distance; the rest are not used. Id.
`
`When the camera is in video mode, the images are also formed by mixing or
`
`culling pixels lines from other lines and that the video image only contains pixel
`
`lines separated by a different distance. Id. at 16:54-60.
`
`The electric camera disclosed in the ‘493 Patent was well know prior
`
`to the invention of the ‘493 Patent. As discussed below, the cited references teach
`
`all of the claimed features.
`
`IX. OVERVIEW OF THE PRIOR ART REFERENCES
`A. U.S. Patent No. 5,493,335 (“Parulski ‘335”) (EX. 1003)
`Parulski ‘335 is directed to an electronic camera for processing
`
`images of different resolution to provide a user selectable image record size. The
`
`resolution options include a full resolution mode, and at least one reduced
`
`resolution mode. Ex. 1003 at Abstract.
`
`18
`
`ZTE Exhibit 1002 - 19
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 19 of 52
`
`
`
`
`
`The electronic camera includes an image sensor for generating a
`
`baseband image signal. Id. at 2:22-27. The color image pixels of the image signal
`
`are arranged in vertical and horizontal direction covered by a pattern of luminance
`
`and chrominance color filter. Id. The electronic camera also includes a resolution
`
`mode switch that allows the user to select the image record size. Id. at 2:32-38.
`
`When the full resolution mode is activated, all color image pixels are selected and
`
`when the reduced resolution mode is activated, a fewer number of color image
`
`pixels are selected. Id.
`
`Additionally, in order to form the low resolution images, a suitable
`
`“subsampling” pattern is required. Id. at 6:4-22. Subsampling rate can be, for
`
`example, at every second pixel of every second line. Id. Subsampling is done to
`
`reduce the amount of data that needs to be transmitted or stored. Id.
`
`Furthermore, the electronic camera includes a display unit capable of
`
`displaying image and video. The diagram of Figure 1 shows a display section for
`
`user interface with the camera. Id. at 3:25-39.
`
`B. U.S. Patent No. 5,440,343 (“Parulski ‘343”) (EX. 1004)
`Parulski ‘343 is directed to an electronic imaging system that records
`
`both motion and still video images. The imaging system records NTSC resolution
`
`images in a motion mode operation and records high resolution images in a still
`
`mode operation. Ex. 1004 at Abstract.
`
`19
`
`ZTE Exhibit 1002 - 20
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 20 of 52
`
`
`
`
`
`The electronic imaging system utilizes an image sensor that includes
`
`an array of pixel image signal. Id. at 2:10-15. In order to generate high resolution
`
`image signals, the electronic imaging system is placed in the still mode of
`
`operation and all of the pixels are selected. Id. at 2:14-15. However, in the motion
`
`mode of operation, in order to generate images in accordance with NTSC standard,
`
`which is a standard video rate of thirty frames per second, image signals generated
`
`from certain selected pixels are discarded or combined with nearby signals. Id. at
`
`2:15-22.
`
`Additionally, the electronic image sensor incorporates “charge
`
`clearing” structures and “charge parking” structures. Id. at 3:44-51. “The charge
`
`clearing structures are used to selectively discard [i.e., cull] the signal charge from
`
`certain pixels, while the charge parking structures are used to add the charge from
`
`non-adjacent vertical pixels [i.e., mix].” Id. “An NTSC resolution image is
`
`obtained in a motion mode of operation by selectively activating the charge
`
`clearing structures.” Id. at 5:32-59.
`
`C. U.S. Patent No. 5,497,192 (“Ishizuka ‘192”) (EX. 1005)
`Ishizuka ‘192 is directed to a video signal process apparatus for
`
`correcting vibration effects in a video camera. Defective pixels in the image are
`
`compensated by storing the address of the defective pixels and interpolating at
`
`20
`
`ZTE Exhibit 1002 - 21
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 21 of 52
`
`
`
`
`
`those positions. During vibration correction, the defective pixels are shifted to
`
`correspond to the amount of corrections. Ex. 1005 at Abstract.
`
`Ishizuka ‘192 teaches that shaking in the vertical direction can be
`
`detected by the pitch angular velocity speed sensor and the output of the pitch
`
`angular velocity speed sensor is supplied to a converter through an amplifier, then
`
`to the vibration correcting controller. Id. at 7:12-24
`
`Ishizuka ‘192 further teaches that shaking in the horizontal direction
`
`can be detected by the yaw angular velocity sensor and an output of the yaw
`
`angular velocity sensor is supplied to a converter through an amplifier, then to the
`
`vibration correcting controller. Id.
`
`D. U.S. Patent No. 5,828,406 (“Parulski ‘406”) (EX. 1006)
`Parulski ‘406 is directed to an electronic camera that produces high
`
`quality still images using complex digital image processing technique and
`
`acceptable quality of preview images using simple image processing technique.
`
`Ex. 1006 at Abstract.
`
`The electronic camera includes two modes that can be tailored for a
`
`low quality motion mode and a high quality still mode. Id. at 6:22-45. The motion
`
`mode corresponds to a “line skipping” mode which the timing and control section
`
`of the device controls the fast dump structure to eliminate two or more consecutive
`
`lines of the image charge from the image sensor. Id. The still mode corresponds
`
`21
`
`ZTE Exhibit 1002 - 22
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 22 of 52
`
`
`
`
`
`to a high quality still image mode wherein all rows of image pixel charge are
`
`readout during a single scan. Id.
`
`Additionally, the electronic camera includes an electronic color
`
`display wherein a number of user control buttons, such as zoom buttons, preview
`
`button and a capture button, are available. Id. at 3:20-24.
`
`E. U.S. Patent No. 6,512,541 (“Dunton ‘541”) (EX. 1007)
`Dunton ‘541 is directed to an imaging apparatus that is configured to
`
`operate in at least still image capture mode and video image capture mode. The
`
`imaging data in the video image mode is smaller and with lower resolution than the
`
`still image mode. The reduction is accomplished by ways of digital scaling or
`
`cropping, or a combination of digital scaling and cropping. Ex. 1007 at Abstract.
`
`Dunton ‘541 teaches that the signal processing unit can include
`
`scaling and compression logic to perform image scaling and compression prior to
`
`transmission and storage. Id. at 6:33-36. The scaling and compression logic can
`
`be used for both still and video images by selecting the appropriate scaling ratio.
`
`Id. at 6:66-7:16. Scaling ratio can be a 4:1 sub-sampling of the corrected image
`
`that 16 pixels from the corrected image data are averaged together to produce 1
`
`pixel in the scaled image data. Id. Lower scaling ratios such as 2:1 may also be
`
`used, where 4 pixels are averaged to generate a single pixel in the scaled image
`
`data. Id.
`
`22
`
`ZTE Exhibit 1002 - 23
`
`Apple v. Maxell
`IPR2020-00597
`Maxell Ex. 2026
`
`Page 23 of 52
`
`
`
`
`
`X. CLAIM CONSTRUCTION
`I understand that, when construing claim terms, a claim subject to
`
`inter partes review receives the “broadest reasonable construction in light of the
`
`specification of the patent in which it appears.” See 37 C.F.R. § 42.100(b). I
`
`further understand that the broadest reasonable construction is the broadest
`
`reasonable interpretation of the claim language, and that any term that lacks a
`
`definition in the specification is also given a broad interpretation.
`
`I understand that the