throbber
(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2011/0025879 A1
`(43) Pub. Date:
`Feb. 3, 2011
`DRADER et al.
`
`US 2011 0025879A1
`
`(54) METHOD AND APPARATUS FOR
`CONTROLLING A CAMERAMODULE TO
`COMPENSATE FOR THE LIGHT LEVEL OF
`A WHTE LED
`
`Publication Classification
`
`(51) Int. Cl.
`HO)4N 9/73
`
`(2006.01)
`
`(75) Inventors:
`
`Marc DRADER, Kitchener (CA);
`Ken WU, Burlington (CA);
`Michael PURDY, Kitchener (CA)
`Correspondence Address:
`Borden Ladner Gervais LLP
`1100-100 Queen Street
`Ottawa, ON K1P 1J9 (CA)
`(73) Assignee:
`RESEARCH IN MOTION
`LIMITED, Waterloo (CA)
`12/903,732
`Oct. 13, 2010
`Related U.S. Application Data
`(63) Continuation of application No. 1 1/626,883, filed on
`Jan. 25, 2007, now Pat. No. 7,825,958.
`
`(21) Appl. No.:
`(22) Filed:
`
`(52) U.S. Cl. .............................. 348/223.1; 348/E09.051
`
`ABSTRACT
`(57)
`A method and an apparatus enabling use of a light source
`emitting a light of changing intensity and changing spectrum
`as a flash with a camera module having a white-balance
`routine and an exposure routine, wherein an initial value
`representative of a color spectrum emitted by the light Source
`is transmitted to the camera module, the light source is turned
`on, and the camera module is signaled to scan a plurality of
`images of the scene while the light source is turned on, allow
`ing the white-balance and exposure algorithms to be
`employed with each image scanned to refine the first initial
`value to refine the degree of compensation employed in cor
`recting a color and a light level in the last one of the images of
`the plurality of images scanned.
`
`
`
`1
`
`APPLE 1009
`
`

`

`Patent Application Publication
`
`Feb. 3, 2011 Sheet 1 of 5
`
`US 2011/0025879 A1
`
`
`
`FIG. 1
`
`PRIOR ART
`
`2
`
`

`

`Patent Application Publication
`
`Feb. 3, 2011 Sheet 2 of 5
`
`US 2011/0025879 A1
`
`
`
`205
`
`FIG. 2
`
`3
`
`

`

`Patent Application Publication
`
`Feb. 3, 2011 Sheet 3 of 5
`
`US 2011/0025879 A1
`
`200 -
`
`a
`
`processor
`210
`
`"put
`2O4
`
`input interface
`234
`
`to Output
`device
`2O5
`
`type
`2O7
`
`output interface
`235
`
`LED interface
`237
`
`control program
`222
`
`white-balance patch
`225
`
`
`
`
`
`Storage
`220
`
`&S y
`
`
`
`processor
`26O)
`
`exposure
`Control
`element
`282
`
`image
`SCanning
`element
`283
`
`camera module
`250
`
`White-balance routine
`
`parameter data
`273
`
`exposure routine
`274.
`
`storage
`270
`
`FIG. 3
`
`4
`
`

`

`Patent Application Publication
`
`Feb. 3, 2011 Sheet 4 of 5
`
`US 2011/0025879 A1
`
`
`
`5
`
`

`

`Patent Application Publication
`
`Feb. 3, 2011 Sheet 5 of 5
`
`US 2011/0025879 A1
`
`await user indication
`to take a picture
`51O.
`
`
`
`
`
`
`
`
`
`
`
`ls
`White LED flash
`being used?
`520
`
`transmit general
`initial values to
`Camera module
`530
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`transmit White
`balance patch to
`camera device
`540
`
`
`
`transmit initial Values
`for White LED to
`Camera module
`542
`
`signal camera module
`to Scan succession of
`images
`532
`
`
`
`signal camera module
`to Scan succession of
`images
`544
`
`
`
`
`
`
`
`
`
`
`
`undo White
`balance patch
`546
`
`FIG. 5
`
`6
`
`

`

`US 2011/0025879 A1
`
`Feb. 3, 2011
`
`METHOD AND APPARATUS FOR
`CONTROLLING A CAMERAMODULE TO
`COMPENSATE FOR THE LIGHT LEVEL OF
`A WHTE LED
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`0001. The present application is a continuation of U.S.
`application Ser. No. 1 1/626,883 filed Jan. 25, 2007, the con
`tents of which are incorporated herein by reference in their
`entirety.
`
`BACKGROUND
`
`0002 1. Field
`0003. The disclosed and claimed concept relates generally
`to electronic devices and, more particularly, to a method for
`controlling a camera module incorporated into a portable
`electronic device to compensate for the characteristics of a
`white LED used as a flash for taking pictures.
`0004 2. Description of the Related Art
`0005. It is widely known to use a variety of different
`Sources of light for taking a picture with a digital camera
`module, including natural Sunlight, a Xenon strobe, an incan
`descent bulb or a fluorescent bulb. Despite being very differ
`ent light sources using very different processes to emit light,
`a common characteristic of all of these light sources is that the
`spectrums of light emitted by each of them, despite being
`different, provide a range of light frequencies that resemble
`the expected behavior of radiant emissions of a blackbody at
`given temperatures.
`0006. In 1931, an international committee called the Com
`mission Internationale de L'Eclairage (CIE) met in Cam
`bridge, England, and attempted to put forward a graphical
`depiction of the full range of colors of light that the human eye
`can actually perceive. This graphical depiction, namely a
`chromaticity chart, and the resulting standard incorporating
`this chromaticity chart has come to be known as “CIE 1931'
`and is widely used by Scientists and photographers, among
`many others, in working with light in the visible light spec
`trum. FIG. 1 depicts a simplified representation of a chroma
`ticity chart 100 based on the CIE 1931 standard, with all
`visible colors of light specifiable with two dimensional color
`coordinates. As can be seen, towards the center of what is
`frequently called the “horseshoe-shaped visible region 110
`of all that the human eye can perceive is a white region 120 of
`colors of light generally categorized as “white light' and
`Surrounded by other regions generally described as non-white
`light, including a red region 121, a pink region 122 and a
`purple region 123. It should be noted that the exact boundaries
`of these regions 120-123 should be taken as approximations
`and not precise designations of color, since the classification
`of colors is necessarily Subjective.
`0007. The human brain has evolved its own form of white
`balancing capability by which human beings have little
`trouble discerning what color an object should be, even
`though it may be illuminated with light that is only marginally
`white. Such as the reddish hue of the Sun at Sunset, the orange
`glow of campfire, or the bluish tint of a mercury vapor stree
`tlight. It is due to this flexibility of the human brain that a
`number of light sources emitting a variety of different spectra
`of light, and thereby having a variety of differing color coor
`dinates that occupy different points on a chromaticity chart,
`can be classified as “white light sources with the result that
`
`the white region 120 in FIG. 1 occupies a considerable pro
`portion of the visible region 110.
`0008 Passing through the white region 120 is a portion of
`a blackbody curve 130 depicting the set of color coordinates
`of white light Sources that emit a spectrum of light frequen
`cies that substantially follow the spectrum of light frequen
`cies that would be expected to be emitted from theoretically
`ideal blackbody light sources heated to different tempera
`tures. Most commonly used sources of white light have color
`coordinates specifying a point that falls along or Substantially
`close to this blackbody curve 130, including sunlight and
`Xenon flash Strobes, as well as incandescent, fluorescent,
`high-pressure sodium and mercury vapor lamps. As a result of
`so many of the commonly used sources of light used in taking
`pictures having color coordinates representing points that fall
`on or relatively close to the blackbody curve 130, algorithms,
`constants and limit values employed in digital cameras to
`perform automatic exposure control and automatic white
`balancing are commonly chosen and designed with a pre
`sumption that all light sources that will be encountered will be
`ones with Such color coordinates. Indeed, this presumption
`has become so ingrained that it has become commonplace for
`manufacturers of camera modules incorporated into other
`electronic devices to have such choices of algorithms, con
`stants and limit values built into or preprogrammed directly
`into the camera modules, themselves.
`0009. As those skilled in the art of white-balancing algo
`rithms will recognize, a step taken by many known white
`balancing algorithms is attempting to derive a reference white
`color in a given image as an input parameter for determining
`the degree to which the colors in that image are to be adjusted
`to compensate for the lighting in the original Scene so that the
`objects in the resulting picture are presented with their correct
`colors. To do this, white-balancing algorithms typically
`require either that there bean object in the image that actually
`is white (known as the “white world' algorithm) or that the
`average of all the colors of all the pixels in the image be a gray
`(known as the “gray world' algorithm), and either of these
`approaches can provide a basis from which a reference white
`color for that image may be derived. However, it is possible to
`have images that do not provide a white object or that are
`filled with objects of colors that provide a very skewed result
`when averaging to derive a gray. An example of such an image
`is one filled with the tree leaves of a forest of trees such that
`the image is filled with different shades of green and little
`else, thereby providing no white objects and providing an
`average that will necessarily be a green color and not a gray.
`If white-balancing algorithms are allowed to process such an
`image without constraints, the result can be whited-out or
`blackened-out objects in the resulting picture, and So it is
`deemed desirable to specify boundaries for what a reference
`white color may be so as to constrain the degree to which a
`white-balancing algorithm is permitted to adjust colors.
`0010 Given the aforementioned presumption that the
`light Sources to be encountered by a digital camera are likely
`to have color coordinates specifying points falling along or
`quite close to the blackbody curve 130, the format in which
`the boundaries for what a reference white color may be are
`communicated to typical camera modules in a manner that
`comports with this assumption. In this commonly used for
`mat, a pair of color coordinates that define the endpoints of a
`straight segment in a chromaticity chart, Such as a segment
`140 depicted in FIG.1, are communicated to a camera module
`along with an error term (or “locus’) specified in terms of a
`
`7
`
`

`

`US 2011/0025879 A1
`
`Feb. 3, 2011
`
`maximum perpendicular distance away from the segment
`140. These two endpoints and the error term, together, specify
`a rectangular-shaped reference white region 141 within the
`white region 110 that defines these boundaries, thereby defin
`ing a set of acceptable color coordinates within which the
`white-balancing algorithm is permitted to choose a color to be
`a reference white for a given image. This is to allow a short
`segment that should resemble a small portion of the black
`body curve 130 to be specified, such as segment 140, and this
`short segment should be positioned to either largely overlie a
`portion of the blackbody curve 130 or to be relatively close to
`and relatively parallel with a portion of the blackbody curve
`130. No allowance is made in this format for specifying the
`boundaries of a possible reference white with a reference
`white region having any other shape than a rectangular
`region, Such as the reference white region 141 shown.
`0011. Also, given the same aforementioned presumption
`that the light sources to be encountered by a digital camera are
`likely to have color coordinates specifying points falling
`along or quite close to the blackbody curve 130, it is com
`monplace to in some way build minimum and/or maximum
`limits on values used to define the reference white region 141
`such that values defining a reference white region 141 that
`does not substantially overlie the blackbody curve 130, or that
`is not at least substantially close to the blackbody curve 130
`are rejected. The effective result is to create a limit region,
`such as limit region 145 depicted in FIG. 1, into which at least
`a portion of the white region 141 must fall.
`0012. Of those light sources having color coordinates rep
`resenting points falling along or close to the blackbody curve
`130, xenon strobes have become commonplace for use as
`flashes in portable electronic devices used in photography. A
`Xenon strobe is very Small in size while producing an
`extremely bright light that very quickly illuminates a setting
`of which a picture is to be taken. The amount of illumination
`needed from a flash to Sufficiently light a scene for scanning
`its image is a measurable quantity and can be roughly calcu
`lated as the brightness of the flash multiplied by the amount of
`time it must be turned on. The brighter the light source used as
`a flash, the less time it needs to be turned on to sufficiently
`light a scene. Furthermore, the amount of time that a given
`flash needs to be turned on is not necessarily related to the
`amount of time needed for an image scanning element (Such
`as a CCD semiconductor device or a CMOS imaging device)
`to actually scan an image as part of the process of capturing
`that image. In other words, where a bright flash is used, it is
`not unheard of to actually turn off the flash before the image
`scanning element has completed Scanning the image, because
`a sufficient amount of illumination has been Supplied and
`leaving the flash on any longer would result in too high an
`amount of illumination and portions of the image being
`whited out. However, where a dimmer light source is used as
`a flash, the flash must be turned on for a longer period of time
`to achieve the same amount of illumination as a brighter light
`Source, and it is often necessary to delay the start of scanning
`an image until a high enough amount of illumination has been
`achieved.
`0013 Recently, a new artificial source of white light, the
`so-called white LED, has been introduced, providing the
`opportunity to create a flash for use in digital photography
`that requires less power than other light sources. Unfortu
`nately, the white LEDs have a range of color coordinates
`specifying a range of points that fall Substantially distant from
`the blackbody curve 130, and furthermore, at least partly fall
`
`outside the white region 120 and into the pink region 122.
`This deviation of white LEDs from the blackbody curve 130
`is largely due to the manner in which white LEDs produce
`light. White LEDs are in truth, blue LEDs that are partially
`covered with a yellowish phosphor that converts part of the
`blue light into yellow light. The result is a blending of blue
`and yellow light frequencies that approximates white light
`well enough for the human eye and the human brain to accept
`it as a source of white light. In essence, two different non
`white light emissions, each having its own spectrum of light
`frequencies, are being blended to approximate white light and
`Sucha mixing of two non-white spectra is not characteristic of
`blackbody sources of radiant energy.
`0014. Also, white LEDs, though brighter than incandes
`cent lamps of comparable size, are far dimmer than Xenon
`strobes of comparable size. As a result, to achieve a desirable
`amount of illumination of a scene when used as a flash, a
`white LED must be kept on far longer than a xenon strobe
`used as a flash, and a white LED must also be supplied with a
`very high amount of electric power that would actually dam
`age internal components of the white LED if that amount of
`power were maintained for more than a very brief period of
`time. In using a white LED as a flash, the amount of time
`during which the white LED is actually turned on can be kept
`short enough to prevent this damage. Unfortunately, even
`during the brief period in which the white LED is turned on,
`the light emitting semiconductor components of the white
`LED respond to the very high amount of power by converting
`an ever increasing proportion of that power into heat as time
`passes from the moment at which that power is first Supplied
`to the moment when that power is removed. Correspondingly,
`as time passes the proportion of that power converted to
`visible light decreases such that the white LED is initially
`very bright when that power is first applied, but that bright
`ness level almost immediately begins fading more and more
`as time passes. With this quickly fading brightness, the color
`spectrum output by a white LED also changes quickly as time
`passes from the moment that it is turned on. This changing
`light level and this changing color spectrum must be taken
`into account in both calculating the amount of time a white
`LED is to be turned on to provide a sufficient total amount of
`illumination to serve as an effective flash and in compensating
`for its changing spectrum of light output in performing white
`balancing.
`(0015. Another feature of white LEDs not exhibited by
`artificial light sources long used in photography, including
`xenon strobes and incandescent bulbs, is the high variability
`in the color spectra of each of the blue and yellow elements of
`the light emitted by white LEDs. White LEDs and the tech
`nology to manufacture them are still Sufficiently new that only
`slow progress has been made in exerting tighter control over
`the manufacture of white LEDs to achieve sufficient consis
`tency to avoid having two white LEDs from the very same
`production run emit light that is of perceptibly different hues.
`For this reason, unlike other artificial light sources that have
`far higher consistency in the spectra of their emitted light, the
`size of the region that the “white light emitted by LEDs may
`fall within is considerably larger than for other light sources.
`As a result of these various issues, current practices in con
`trolling a camera module's built-in white-balancing algo
`rithm are insufficient to accommodate the very unique char
`acteristics of white LEDs.
`BRIEF DESCRIPTION OF THE DRAWINGS
`0016 A full understanding of the disclosed and claimed
`concept can be gained from the following Description when
`read in conjunction with the accompanying drawings in
`which:
`
`8
`
`

`

`US 2011/0025879 A1
`
`Feb. 3, 2011
`
`0017 FIG. 1 is a simplified depiction of a CIE 1931 chro
`maticity chart depicting the black body curve and a PRIOR
`ART approach to specifying a reference white region within
`which a reference white color is constrained;
`0018 FIG. 2 is a depiction of an improved handheld elec
`tronic device in accordance with the disclosed and claimed
`concept;
`0019 FIG. 3 is a schematic depiction of the improved
`handheld electronic device of FIG. 2;
`0020 FIG. 4 is another simplified depiction of a CIE 1931
`chromaticity chart depicting the black body curve and an
`approach to specifying a reference white region within which
`a reference white color is constrained in accordance with the
`disclosed and claimed concept; and
`0021
`FIG. 5 is a flowchart depicting an embodiment of an
`improved method in accordance with the disclosed and
`claimed concept.
`
`DESCRIPTION
`0022. The accompanying figures and the description that
`follows set forth the disclosed and claimed concept in its
`preferred embodiments. It is, however, contemplated that per
`sons generally familiar with handheld electronic devices will
`be able to apply the novel characteristics of the structures and
`methods illustrated and described herein in other contexts by
`modification of certain details. Accordingly, the figures and
`description are not to be taken as restrictive on the scope of the
`disclosed and claimed concept, but are to be understood as
`broad and general teachings.
`0023 For purposes of the description hereinafter, the
`terms “upper”, “lower”, “right”, “left”, “vertical”, “horizon
`tal', “top”, “bottom', and derivatives thereof shall relate to
`the disclosed and claimed concept as it is oriented in the
`figures.
`0024. An improved electronic device 200 is depicted gen
`erally in FIG. 2 and is depicted schematically in FIG. 3. The
`electronic device 200 may be a handheld or other portable
`electronic device (e.g. and without limitation, a digital cam
`era, a PDA, a cell phone, a digital watch, or a laptop com
`puter). The electronic device 200 incorporates a housing 202
`on which are disposed a white LED 207 serving as a flash for
`taking pictures and a camera module 250. The housing 202
`may additionally have disposed thereon an input device 204
`and/or an output device 205. The electronic device 200 also
`incorporates a processor 210 connected to a storage 220, and
`a LED interface 237 controlling the LED 207. The processor
`210 may additionally be connected to one or more of an input
`interface 234 receiving input from the input device 204, an
`output interface providing output to the output device 205,
`and a media storage device 240 capable of interacting with a
`storage medium 241 (which may or may not be of removable
`form). The camera module 250 incorporates a processor 260
`connected to a storage 270, an exposure control element 282
`and an image scanning element 283. Although described and
`depicted as being disposed on the housing 202 of the elec
`tronic device 200, the white LED 207 and/or the camera
`module 250 may alternatively be physically separate from the
`housing 202, but linked to other components of the electronic
`device 200 through a suitable electrical, optical, radio fre
`quency or other linkage.
`0025. The processors 210 and 260 may be of any of a wide
`variety of processing devices, including and without limita
`tion, microcontrollers, microprocessors, sequencers, digital
`signal processors or state machines implemented in hardware
`
`logic. In some embodiments, one or both of the processors
`210 and 260 may be one of a number of commercially avail
`able processors executing at least a portion of the widely
`known and used "X86’ instruction set and/or another instruc
`tion set.
`(0026. The media device 240 and the storages 220 and 270
`may be of any of a wide variety of types of storage devices,
`including and without limitation, disk drives (e.g. and without
`limitation, hard drives, floppy drives, magneto-optical drives,
`magnetic tape drives or CD-ROM drives), solid state memory
`(e.g. and without limitation, static RAM, dynamic RAM,
`ROM, EEPROM or FLASH) and memory card readers. How
`ever, in preferred practice, the storages 220 and 270 are gen
`erally more capable of Supporting speedy random accesses
`than the media device 240, and the media device 240 is
`capable of Supporting removable media while the storages
`220 and 270 are not meant to be removable. In preferred
`practice, it is generally intended that the removable media
`device 240 support the exchange of data and/or software
`between the electronic device 200 and another electronic
`device (not shown) through the storage medium 241.
`(0027. The white LED 207 may be any of a variety of
`semiconductor-based light emitting diodes capable of emit
`ting light that Substantially approximates white light. The
`white LED 207 may be fabricated by applying a coating to a
`blue LED that converts at least some of the emitted blue light
`into a yellow light such that a combination of blue and yellow
`light is produced that approximates white light to the percep
`tion of the human eye. Alternatively, the white LED 207 may
`be fabricated in other ways as those skilled in the art will
`readily recognize, including, but not limited to, adding or
`applying red and green phosphors to a blue LED. The LED
`interface 237 allows the processor 210 to control when the
`white LED 207 is turned on and may allow the processor 210
`to control the intensity of the light emitted by the white LED
`207.
`0028. The camera module 250 may be any of a variety of
`commercially available camera modules fabricated by a vari
`ety of manufacturers for the purpose of being incorporated
`into other devices, such as the electronic device 200. The
`image scanning element 283 may be one of a variety of
`available charge-coupled devices (CCD) or CMOS imaging
`devices, or may be another suitable form of device capable of
`scanning an image of objects in its view. The exposure control
`element 282 provides an aperture of controllable dimensions
`through which the light from the objects in the view of the
`image scanning element 283 passes to reach the image scan
`ning element 283. Alternatively, the exposure control element
`282 may control the amount of light reaching the image
`scanning element 283 in other ways known to those skilled in
`the art.
`0029. The input device 204 may be of any of a variety of
`input devices capable of accepting input from a user of the
`electronic device 200, including without limitation switches,
`a keypad, a joystick, a rollerball, or a touchpad. In embodi
`ments that incorporate the input device 204, the input inter
`face 234 couples the processor 210 to the input device 204 to
`receive input therefrom. The output device 205 may be of any
`of a variety of output devices capable of providing informa
`tion to a user of the electronic device 200, including without
`limitation lights, a display device, an audible indicator, or a
`tactile device Such as a vibrator mechanism causing the elec
`tronic device 200 to vibrate such that a user of the electronic
`device 200 is able to feel the vibration. In embodiments that
`
`9
`
`

`

`US 2011/0025879 A1
`
`Feb. 3, 2011
`
`incorporate the output device 205, the output interface 235
`couples the processor 210 to the input device 205 to provide
`output thereto.
`0030. When the electronic device 200 is used to take a
`picture, the processor 210 accesses the storage 220 to retrieve
`and execute a sequence of instructions of a control program
`222, thereby causing the processor 210 to transmit sequences
`of instructions and/or data to the camera module 250 and to
`operate the camera module to Scan one or more images as will
`shortly be explained. In turn, the processor 260 accesses the
`storage 270 to retrieve and execute sequences of instructions
`from a white-balance routine 272, an exposure routine 274
`and/or another sequence of instructions provided by the pro
`cessor 210, thereby causing the processor 260 to operate the
`exposure control element 282 and the image scanning ele
`ment 283 to carry out the Scanning of one or more images. The
`processors 210 and 260 are caused to interact to transfer the
`data representing the resulting picture from the camera mod
`ule 250 to be stored in the storage 220, or perhaps the media
`storage device 240 if present. Where the taking of a picture
`entails the use of the white LED 207 as a flash, the processors
`210 and 260 may be caused to further interact in controlling
`the timing and intensity of the lighting Supplied by the white
`LED 207 through the LED interface 237.
`0031. In embodiments of the electronic device 200 having
`the input device 204 and/or the output device 205, the pro
`cessor 210 is further caused by the control program 222 to
`operate the input interface 234 and/or the output interface 235
`to interact with the user of the electronic device 200 through
`one or both of the input device 204 and the output device 205.
`Where the input device 204 includes a relatively small num
`ber of switches providing the user with the ability to control
`various aspects of the process of taking a picture (e.g. without
`limitation, the focus, the landscape or portrait mode, and
`whether or not to use a flash), the processor 210 receives such
`input from the user and carries out the taking of a picture,
`accordingly. Where the input device 204 includes a keypad or
`other device providing greater flexibility of input, the user
`may be provided with the ability to enter data concerning the
`picture to be taken, such as a time, place or name of the Subject
`of the picture. Where the output device 205 includes a graphi
`cal display, the processor 210 may be caused by the control
`program 222 to present the user with a view of what the image
`scanning element 283 sees before the picture is taken and/or
`a view of the resulting picture on the output device 205.
`0032. In embodiments of the electronic device 200 having
`the media storage device 240, the processor 210 may be
`further caused to store pictures taken by the user on the
`storage medium 241 for the user to transfer to another elec
`tronic device (not shown) for display, archiving and/or print
`ing. Where such embodiments also incorporate a form of both
`the input device 204 and the output device 205 of sufficient
`ability, the processor 210 may be further caused to provide the
`user of the electronic device 200 with the ability to use the
`input device 204 and the output device 205 to view and select
`pictures to be stored on the storage medium 241, as well as to
`select pictures to be deleted. Alternatively, or in addition to
`the media storage device 240, the electronic device 200 may
`further incorporate a communications interface (not shown)
`allowing the electronic device 200 to be directly connected to
`another electronic device for the transferring of pictures,
`other data and/or Software (e.g. without limitation, a digital
`serial interface such as IEEE 1394).
`
`0033. As previously described, the camera module 250
`may be any one of a variety of commercially available camera
`modules from a variety of manufacturers for incorporation
`into various electronic devices, including the electronic
`device 200. The white-balance routine 272 may be based on
`any of a variety of widely known white-balancing algorithms
`(including the earlier-described gray world and white world
`algorithms) to derive a reference white color for a given
`image that is used to determine the degree to which the
`white-balance routine 272 is to be used to modify that image
`to compensate for the lighting used. However, as was also
`previously described, it is common practice to impose con
`straints on white-balancing algorithms to prevent overcom
`pensation for lighting that can result where the colors in an
`image do not provide white-balancing algorithms with the
`reference colors needed to function, correctly.
`0034. Unfortunately, the commonplace manner of
`describing the reference white region of color coordinates to
`which the point representing a reference white color is to be
`constrained as a rectangular region that is Substantially adja
`cent to or that substantially overlies a portion of a blackbody
`curve on a chromaticity chart is based on the assumption that
`whatever source of light is used to illuminate an image will
`exhibit characteristics largely conforming to what would be
`expected of a corresponding blackbody source of radiation.
`This same assumption has also resulted in the commonplace
`practice of incorporating into parameter data 273 within the
`storage 270 a set of minimum and maximum value limits that
`will be accepted for specifying the color coordinates defining
`the segment that partly defines that rectangular region. In
`effect, these minimum and maximum value limits describe a
`limit region into which at least a portion of the white reference
`region must fall. Unfortunately, to describe a rectangular
`region within which the color coordinates of the white LED
`207 are likely to fall requires specifying color coordinates that
`are outside such minimum and maximum value limits.
`0035. As part of the earlier-described process of taking a
`picture where the white LED 207 is employed as a flash, the
`processor 210 is caused by the control program 222 to provide
`the camera module 250 with a pair of color coordinates (i.e.,
`the pair of points defining a segment) and an error term (or
`“locus') that define a rectangularly-shaped reference white
`region to which the point defined by the color coordinates of
`the reference white color derived by the white-balance rou
`tine 272 are to be constrained. However, to overcome the
`commonplace limitations imposed by the minimum and
`maximum value limits stored within the parameter data 273,
`the processor 210 is first caused by the control program 222 to
`transmit to the camera module 250 a white-balance patch 225
`retrieved by the processor 210 from the storage 220. In some
`embodiments, the white-balance patch 225 provides at least
`one alternate minimum and/or maximum value that the pro
`cessor 260 uses in place of at least one minimum and/or
`maximum value of the parameter data 273 when executing a
`sequence of instructions of the white-balance routine 272. In
`other embodiments, the white-balance patch 225 provides an
`alternate sequence of instructions to be executed by the pro
`cessor 260 in place of at least a portion of a sequence of
`instructions of the white-balance routine 272. In still other

This document is available on Docket Alarm but you must sign up to view it.


Or .

Accessing this document will incur an additional charge of $.

After purchase, you can access this document again without charge.

Accept $ Charge
throbber

Still Working On It

This document is taking longer than usual to download. This can happen if we need to contact the court directly to obtain the document and their servers are running slowly.

Give it another minute or two to complete, and then try the refresh button.

throbber

A few More Minutes ... Still Working

It can take up to 5 minutes for us to download a document if the court servers are running slowly.

Thank you for your continued patience.

This document could not be displayed.

We could not find this document within its docket. Please go back to the docket page and check the link. If that does not work, go back to the docket and refresh it to pull the newest information.

Your account does not support viewing this document.

You need a Paid Account to view this document. Click here to change your account type.

Your account does not support viewing this document.

Set your membership status to view this document.

With a Docket Alarm membership, you'll get a whole lot more, including:

  • Up-to-date information for this case.
  • Email alerts whenever there is an update.
  • Full text search for other cases.
  • Get email alerts whenever a new case matches your search.

Become a Member

One Moment Please

The filing “” is large (MB) and is being downloaded.

Please refresh this page in a few minutes to see if the filing has been downloaded. The filing will also be emailed to you when the download completes.

Your document is on its way!

If you do not receive the document in five minutes, contact support at support@docketalarm.com.

Sealed Document

We are unable to display this document, it may be under a court ordered seal.

If you have proper credentials to access the file, you may proceed directly to the court's system using your government issued username and password.


Access Government Site

We are redirecting you
to a mobile optimized page.





Document Unreadable or Corrupt

Refresh this Document
Go to the Docket

We are unable to display this document.

Refresh this Document
Go to the Docket