(12) United States Patent
`Lennon
`
`USOO6624.843B2
`(10) Patent No.:
`US 6,624,843 B2
`(45) Date of Patent:
`Sep. 23, 2003
`
`(54) CUSTOMER IMAGE CAPTURE AND USE
`THEREOF IN A RETALING SYSTEM
`
`(*) Notice:
`
`(76) Inventor: Jerry W. Lennon, 7719 Butternut Ct.,
`Woodridge, IL (US) 60517
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 384 day
`
`a --
`
`WS.
`
`(65)
`
`(21) Appl. No.: 09/733,197
`(22)
`led
`Dec. 8, 2000
`22) Filled:
`eC.
`9
`Prior Publication Data
`US 2002/0073077 A1 Jun. 13, 2002
`Related U.S. Application Data
`(60) Provisional application No. 60/170,057, filed on Dec. 10,
`1999.
`7
`(51) Int. Cl. ............................. HO)4N 9/47; HO)4N 7/18
`
`(52) U.S. C. - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 348/61
`
`(58) Field of Search .............................. 348/61, 63, 64,
`348/78, 86, 96; H04N 9/47, 7/18
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`4,467,349 A 8/1984 Maloomian
`4,539,585 A * 9/1985 Spackova et al. ........... 382/100
`4,991,005 A 2/1991 Smith
`5,053,956 A 10/1991 Donald et al.
`5,515,268 A 5/1996 Yoda
`5,551,021 A 8/1996 Harada et al.
`5,592.248 A
`1/1997 Norton et al.
`5,771,778 A * 6/1998 MacLean, IV ............. 99/323.6
`
`104
`
`IMAGE CAPTURE
`SYSTEM
`
`WWWSerVIceS1.landsend.com/landsend/menu.htmlSIC=
`
`5,930,769 A 7/1999 Rose
`5,983.201. A 11/1999 Fay
`6,236,319 B1 * 5/2001 Pitzer et al. ............. 340/573.4
`6,298,218 B1 10/2001 Lowe et al. .................. 455/66
`OTHER PUBLICATIONS
`PCT International Search Report, pp. 1-4.
`“Welcome to My Virtual Model” website located at http://
`iceS1.landsend
`/landsend/
`html?sid
`0975533902029, printed on Nov. 29, 2000.
`Written Opinion for International Application No. PCT/
`USOO/42703 dated Dec. 5, 2001.
`* cited by examiner
`Primary Examiner Nhon Diep
`(74) Attorney, Agent, or Firm-Banner & Witcoff, Ltd.
`(57)
`ABSTRACT
`-
`In a retailing System, an image capture System is provided
`and used to capture reference images of models wearing
`apparel items. At a retailer's place of business,
`image
`
`capture System substantially identical tO that used tO capture
`
`the reference images is also provided. A customer has his or
`her image captured by the image capture System at the
`retailer's place of business. Subsequently, when the cus
`tomer is in close proximity to an image display area within
`the retailer's place of business, a composite image compris
`ing the customer's captured image and one of the reference
`images may be provided. The composite image may com
`prise full motion video or Still images. In this manner, the
`customer is given the opportunity to virtually assess the
`Selected merchandise without actually having to try on the
`apparel.
`
`20 Claims, 4 Drawing Sheets
`
`
`
`
`
`
`
`110
`
`
`
`
`
`114
`
`108
`
`102
`
`CUSTOMER
`
`IMAGE DISPLAY
`SYSTEM
`
`TRIGGER(S)
`
`
`
`
`
`CONTROLLER
`
`PUBLIC
`COMMUNICATION
`NETWORK
`
`
`
`PRVATE
`COMMUNICATION
`NETWORK
`
`1 OO
`
`112
`
`106
`
`d
`DAABASES
`
`PERFECT CORP. EXH. 1001
`
`

`

`U.S. Patent
`
`Sep. 23, 2003
`
`Sheet 1 of 4
`
`US 6,624,843 B2
`
`90 ||
`
`<~: (C
`
`
`
`SEISVEV LVCI
`
`ZO !
`
`HETTIOHINOO
`9 || || - -----
`
`WELSÅSHE WOLSTIO
`
`0 || ||
`
`Z || ||
`
`00||
`
`XIHONN LEN
`
`WELSÅS
`
`
`
`
`
`
`
`PERFECT CORP. EXH. 1001
`
`

`

`U.S. Patent
`
`Sep. 23, 2003
`
`Sheet 2 of 4
`
`US 6,624,843 B2
`
`START
`
`CAPTURE
`2O2
`REFERENCE -1
`IMAGE(S)
`
`204
`1
`
`206
`
`CAPTURE USER
`IMAGE(S)
`
`DISPLAY
`COMPOSITE
`IMAGE(S)
`
`FIG. 2
`
`
`
`
`
`YES
`
`PROVIDE
`3O2
`N- CONTROLLED
`ENVIRONMENT
`
`OBTAN
`304
`N REFERENCE
`IMAGE
`
`
`
`
`
`306
`
`ADDITIONAL
`IMAGES
`
`
`
`NO
`308 - V
`NJ EDT
`REFERENCE
`IMAGE(S)
`
`STORE
`310
`N- REFERENCE
`IMAGE(S)
`
`FG. 3
`
`PERFECT CORP. EXH. 1001
`
`

`

`U.S. Patent
`
`Sep. 23, 2003
`
`Sheet 3 of 4
`
`US 6,624,843 B2
`
`START
`
`402
`
`
`
`
`
`PROVIDE
`CONTROLLED
`ENVIRONMENT
`
`404
`
`4O6
`
`CUSTOMERENTERS
`IMAGE CAPTURE AREA
`
`OBTAIN CUSTOMER
`IMAGE(S)
`
`
`
`408
`
`NO
`
`VALID
`
`YES
`
`STORE CUSTOMER
`IMAGE(S)
`
`ASSIGN BODY
`TYPE
`
`
`
`41 O
`
`
`
`412
`
`FIG. 4
`
`PERFECT CORP. EXH. 1001
`
`

`

`U.S. Patent
`
`Sep. 23, 2003
`
`Sheet 4 of 4
`
`US 6,624,843 B2
`
`
`
`5O2
`
`CUSTOMERENTERS
`IMAGE DISPLAY AREA
`
`504
`
`506
`
`510
`
`512
`
`514
`
`
`
`516
`
`
`
`
`
`TRIGGER
`DISPLAY
`
`YES
`
`
`
`NO
`
`VALD2
`
`NO
`
`NFORM
`CUSTOMER
`
`w
`
`
`
`PROMPT CUSTOMER
`
`RESPONSE . YES
`
`RECEIVE
`CUSTOMER
`
`GENERATE
`COMPOSITE
`MAGE
`
`
`
`DISPLAY
`COMPOSITE
`IMAGE
`
`FIG. 5
`
`PERFECT CORP. EXH. 1001
`
`

`

`1
`CUSTOMER IMAGE CAPTURE AND USE
`THEREOF IN A RETALING SYSTEM
`
`US 6,624,843 B2
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`The present application claims priority from U.S. patent
`application Ser. No. 60/170,057 entitled “AMETHOD AND
`APPARATUS FOR CAPTURING IMAGE FORMS AND
`CHANGING CLOTHING TYPES ON THE IMAGE
`FORM filed on Dec. 10, 1999.
`TECHNICAL FIELD
`The present invention is generally related to commercial
`Systems and, in particular, to method and apparatus for
`capturing a person's image and using the captured image in
`a retailing System.
`
`1O
`
`15
`
`BACKGROUND OF THE INVENTION
`"Putting the pants on the customer is a long-standing
`term used in the fashion industry to explain to Salespeople
`the need to show potential customers how they will look in
`various clothing Styles. Tailors often said that a Sale was not
`made until the customer “puts on the pants.” When a
`customer tries on various clothing Styles and colors, the
`proceSS is very time consuming. The need exists for the
`customer to See a variety of clothing Styles and colors
`applied to his/her body type to form an idea of how a
`particular clothing Style or color will look on that perSon.
`One attempt to address this need has been through the use
`of So-called virtual models. An example of Such a System is
`found at the web site (http://www.landsend.com) for Land's
`End, Inc. By responding to a Series of prompts regarding
`body shape, Skin tone, hairstyle, eye shape, measurements
`etc., a customer is able to generate a computer Simulation that
`approximates the customer's Silhouette. The Simulation or
`Virtual model can be Saved and recalled for later use. Having
`created a virtual model, the customer can Select various
`clothing Styles for display using the Virtual model. In this
`manner, the customer is provided an approximation as to
`appropriate sizes. However, by its very nature, the Virtual
`model provides virtually no detail regarding the customer's
`actual appearance. Additionally, the Virtual model is gener
`ally displayed as a Static image on a generic background.
`That is, the customer is not able to assess the appearance of
`the Selected merchandise as it would appear when the
`customer is actually moving around within a variety of
`background Settings.
`U.S. Pat. No. 5,551,021 issued to Harada et al. (the
`“Harada patent”) also discloses a System in which images of
`customers (captured through the use of a still image camera)
`are electronically Stored. Later, when a customer is contem
`plating additional clothing purchases, a Store clerk operating
`the System is able to recall the customer's image and display
`a composite of the customer's image with clothes that the
`customer has previously tried on or already owns. In this
`manner, the Store clerk may better advise the client in
`coordinating contemplated purchases with clothes previ
`ously considered or owned by the customer. However, the
`Harada patent Suffers from the same limitations as the Virtual
`model system described above. Additionally, the Harada
`patent only displays the customer's image in conjunction
`with clothing already considered or owned, and does not
`allow the customer to See clothing Styles that he or she is
`currently considering applied to his or her image.
`Thus, it would be advantageous to provide a computer
`ized System whereby clothing Styles are applied to an actual
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`image of a customer without the attendant limitations of
`prior art Systems. Such a System would reduce Shopping
`time for the customer because the customer does not have to
`physically try on articles of clothing. Additionally, there
`would be less likelihood of the customer returning an untried
`article of clothing or deciding that the clothing Style does not
`fit or is unflattering or does not coincide with the fashion
`image the customer desires to portray, thereby Saving mer
`chants the cost of returned items.
`SUMMARY OF THE INVENTION
`The present invention allows apparel retailers and other
`purveyors of Such items an opportunity to virtually "dress'
`the potential customer in featured merchandise as a virtual
`“fitting.” AS used herein, apparel includes clothing, acces
`Sories or any other items for which customer purchase
`decisions are typically based in part upon how the item
`appears when used by the customer. Through manipulation
`of digitized images, an image of the customer in a new
`apparel Style is displayed. In addition, the image of the
`customer wearing the new apparel Style can be shown under
`different lighting and background conditions Such as in the
`evening at a restaurant, in a very dark dance hall, in a
`moderately lit boardroom, or walking along a downtown
`Street during daylight hours. Sound effects and music can
`also be added to offer a fuller, more intense-effect viewing
`environment and enhance the entertainment aspects pro
`vided by the present invention.
`The computer System is capable of merging video or Still
`images of live, ordinary customers with Video or Still images
`of Stored reference model images wearing the apparel. The
`computer System retrieves the Stored reference images from
`a database and applies the stored reference image to the
`digitized image of the customer's body. The potential cus
`tomer is shown in the featured apparel (the stored reference
`image) by displaying the composite image on a video
`display. The composite can be offered as a Still picture or
`animated to a specific Situation. In one embodiment of the
`present invention, routing of Store traffic through a pre
`defined walkway facilitates capture of customer imageS. To
`maximize the quality of the composite image, the walkway
`preferably has the same physical characteristics and lighting
`to that used in obtaining the reference images. Knowledge
`(or estimates) of a potential customer's weight and body
`height helps ensure a close match of the Stored reference
`images to the captured image, creating a more realistic
`Viewing of how the apparel Style or color will look on the
`potential customer. The computer is capable of distinguish
`ing differences between body sizes and is capable of filling
`in variations. A value System or weighting System assigns a
`value to distinguish the various body forms of customers.
`BRIEF DESCRIPTION OF THE DRAWINGS
`In the detailed description of presently preferred embodi
`ments of the present invention which follows, reference will
`be made to the drawings comprised of the following figures,
`wherein like reference numerals refer to like elements in the
`various views and wherein:
`FIG. 1 is a block diagram of a computer-based System in
`accordance with the present invention;
`FIG. 2 is a flowchart illustrating a method in accordance
`with the present invention;
`FIG. 3 is a flowchart illustrating capture of at least one
`reference image in accordance with the present invention;
`FIG. 4 is a flowchart illustrating capture of at least one
`customer image in accordance with the present invention;
`and
`
`PERFECT CORP. EXH. 1001
`
`

`

`US 6,624,843 B2
`
`15
`
`25
`
`35
`
`40
`
`3
`FIG. 5 is a flowchart illustrating display of a composite
`image in accordance with the present invention.
`DETAILED DESCRIPTION OF THE
`INVENTION
`The present invention is more readily described with
`reference to FIGS. 1-5. FIG. 1 illustrates a computer-based
`system 100 in accordance with the present invention. The
`system 100 comprises a controller 102 coupled to an image
`capture System 104, databases 106, an image display System
`108, a public communication network 110, a private com
`munication network 112 and one or more trigger devices
`116. The controller 102 may comprise one or more com
`puters or Servers capable of executing Software instructions
`Stored in memory (e.g., volatile or non-volatile digital Stor
`age devices) via a Suitable processor (e.g., microprocessor,
`microcontroller, digital Signal processor or the like or com
`binations thereof). AS described in greater detail below, the
`image capture System 104 comprises one or more image
`capture devices, Such as at least one full motion video
`camera or at least one Still image camera, or a combination
`thereof. In a preferred embodiment, the image capture
`devices provide a digital Signal output, although an analog
`output that is Subsequently converted to digital form may
`also be used. The controller 102 is coupled to databases 106
`for the Storage of images captured by the image capture
`System 104. Information correlating captured customer
`images to particular customers, as well as other data describ
`ing each customer's body type, etc. may also be Stored in the
`databases 106. Furthermore, the databases 106 preferably
`comprise Stored apparel Style or reference images described
`in greater detail below. Although multiple databases 106 are
`illustrated in FIG. 1 and referred to in this description, those
`having ordinary skill in the art will recognize that a single
`database of Sufficient Storage capacity could be used.
`The image display system 108 preferably comprises at
`least one display Screen capable of displaying high-quality
`video or still images. When deployed in a retail
`environment, Several Such display Screens may be placed
`throughout the busineSS Such that a plurality of customers
`may be simultaneously using the System 100 at any given
`moment. In a distributed computing environment, the image
`display System 108 may also include one or more computers,
`or Similar computing platforms and associated memory,
`capable of performing image manipulations described
`below. The image display system 108 allows composite
`images, comprising one or more captured customer images
`combined with one or more of the Stored reference images,
`to be displayed to a customer in close proximity to one of the
`display Screens. The trigger devices 116, each preferably
`deployed integrally with or in close proximity to the display
`Screens, may be activated through direct customer input or
`automatically. Examples of Suitable trigger devices 116
`include, but are not limited to, keypads, card readers, touch
`Screens, cameras or the like or combinations of Such devices.
`When activated, each trigger device 116 informs the con
`troller 102 of the presence of a customer 114 near a display
`Screen, thereby initiating display of an appropriate compos
`ite image.
`The public communication network 110, such as the
`Internet or World Wide Web, or the private communication
`network 112, Such as a retailers intranet or extranet, allows
`customers 114 to access composite images or other customer
`information (Such as account information, biometric data,
`preferences, etc.) via the controller 102. Conversely, the
`customer 114 can provide data, Such as one or more cus
`tomer images for use in generating composite images or
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`updated customer information) to the controller 102 via
`either or both of the public and private communication
`networks 110, 112. Communications via the either or both of
`the public and private communication networks 110, 112 can
`be implemented using Secure access links, as known in the
`art.
`Using the system 100 described above, the present inven
`tion provides retailers or other providers of apparel the
`opportunity to let customers visually assess the items with
`out having to actually try the item on. To achieve this, the
`present invention provides a three-step process generally
`illustrated in FIG. 2. At step 202, one or more reference
`images are captured. In the context of the present invention,
`a captured image has been edited or modified as necessary
`and Stored for later access. Reference images comprise
`various apparel items as worn by models and edited to
`remove at least Some portions of the image other than the
`apparel item being worn, i.e., the models face, hair, hands,
`legs, etc. At Step 204, one more customer images are
`captured. Note that both the reference images and the
`customer images may comprise full motion video or Still
`imageS. In contrast to the reference images, the customer
`images, when edited, may include only the customers’ face,
`hair, hands, etc. Then, at Step 206, a composite image
`comprising any one of the reference images and any one of
`the customer images is generated and displayed. In effect,
`the composite image combines each customer's actual
`appearance (as dictated by his or her facial features, hair
`color, etc.) with an image of the desired apparel item as it
`would appear when worn by a perSon having a similar body
`shape to the customer. In this manner, the customer is able
`to more accurately assess the appearance of the item when
`worn by the customer without having to actually try on the
`item. Each of the steps illustrated in FIG. 2 are more fully
`described with reference to FIGS. 3-5 below. As those
`having ordinary skill in the art will recognize, certain Steps
`described relative to FIGS. 3-5 may be implemented as
`Stored Software instructions executed by a Suitable proces
`SO.
`Referring now to FIG.3, a process for obtaining reference
`images is described in greater detail. At Step 302, a con
`trolled environment for obtaining images of the apparel
`items, as worn by models, is provided. AS used herein, the
`phrase “controlled environment' encompasses a environ
`ment that is reproducible, particularly as part of the image
`capture system 104 of FIG. 1. To this end, the controlled
`environment preferably comprises at least one CCD digital
`video camera (e.g. DNE 11 or EditGam) capable of recording
`digital images to the memory of a computer. Any computer
`capable of Storing and processing large amounts of digital
`images may be used for this purpose. Because of the data
`Storage requirements inherent in digital Video, large memory
`Storage Systems are typically required, particular for high
`quality images. A runway is provided of Sufficient length
`Such that up to twenty Seconds of Video data could be
`obtained of a model traversing the runway at a normal
`walking pace. Physical layouts other than a runway are
`possible. In a preferred embodiment, one or more fixed,
`Vertical posts are erected at the end of or along the runway
`with a camera array or lens array mounted at 62 inches (1.57
`meters), 64 inches (1.63 meters), 66 inches (1.68 meters), 68
`inches (1.73 meters) and 70 inches (1.78 meters). Of course,
`other mounting heights can be Selected as a matter of design
`choice. Similarly equipped posts at forty-five degree angles
`relative to the end post(s) are also preferably provided in
`order to capture a full 180 view, although other ranges are
`possible. Selection and positioning of lighting elements are
`
`PERFECT CORP. EXH. 1001
`
`

`

`S
`preferably determined according to well-understood lighting
`principles in order to best capture the image of the Selected
`apparel and to achieve the desired effect of Shadows, etc.
`Additional lighting effects can be added or modified during
`editing to add background or fine tune the image transfor
`mation prior to archiving the reference images.
`Preferably, the merchant who desires to market fashion
`merchandise using the present invention Selects the desired
`range of body sizes for each Selected apparel Style. The
`merchant Selects the background to match the garment's
`VAT (Value, Attitude and Trend) to the potential customer,
`as envisioned by the merchant. Subsequently, at steps 304
`and 306, reference images are obtained. To this end, video
`or Still images of models, having a variety of body sizes
`typical to the majority of potential customer body forms
`and wearing corresponding sizes of the Selected apparel
`item, are taken within the controlled environment, i.e.,
`walking down the runway. Techniques Such as retrolooping
`may be employed to minimize the number models needed to
`capture imageS for each of the desired sizes and body types.
`Prior to recording, a Visual reference may be referred to
`gauge apparel sizes. Preferably, the images of the models are
`captured before a blank background, Such as a uniformly
`blue or green Screen, depending on the color of the apparel
`being worn. Additionally, the models preferably wear a hood
`or cowl, gloves, leggings etc of the Same color. This facili
`tates the process of editing out the extremities of the models
`(e.g., head, hair, hands, legs etc) as well as the addition of
`Suitable background images. AS the images are obtained,
`they are preferably Stored directly to memory residing in a
`computer or Similar device. Alternatively, the imageS could
`be stored within the one or more cameras for Subsequent
`downloading. Steps 304 and 306 are repeated until the
`desired range of images is obtained.
`When a sufficient number of body sizes and types are
`recorded for a given apparel item, the images are edited at
`step 308 to remove the parts of the image other than the
`apparel Style, i.e., the models face, hair, hands, legs, etc.
`Such editing can be accomplished using existing Software
`such as Avid Softlmage or Adobe After Effects. Using these
`programs, the editor makes creative choices regarding
`diminishment of these elements, or adding shoes or fashion
`accessories to enhance the overall effect to accommodate
`different styles of the apparel item. To this end, the editor
`may rely on Special instructions that allow for a low-cut
`garments, replacing long or Short sleeve lengths, add or
`eliminate certain areas in order to obtain a best fit, etc.
`Lighting or Shadows can be added or eliminated and Suitable
`background images matted into the images. Further Still,
`additional effects Such as Sound effects or background music
`can be added to the references images.
`At Step 310, the edited reference images are Stored, for
`example, in the database 106 shown in FIG. 1. Storage
`programs and Visual pattern recognition programs are used
`to create the database of edited apparel Styles. The edited
`apparel Styles may be Stored Separately or combined with
`other meta information, i.e., information that describes each
`reference image in Some manner, Such as identification of
`each apparel Style, body type, etc. Once the edited apparel
`Style data is stored, the client (merchant) has the opportunity
`to approve, and request further edits of, the Stored reference
`images. At this point, the Stored reference images are ready
`to be combined with customer images. The merchant pref
`erably identifies potential customers based, for example, on
`mailing or customer lists, Surveys or using any other means
`known in the art. Once the potential customers are identified,
`a flyer or incentive notice can be mailed to the customer or
`
`15
`
`25
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`US 6,624,843 B2
`
`6
`otherwise published in order to give the potential customer
`Sufficient incentive to use the commercial System of the
`present invention. The mailing can be a cooperative effort
`between the merchant implementing the retailing System and
`Some other organization, Such as a apparel designer. The
`process of capturing customer images is further described
`with reference to FIG. 4.
`Referring now to FIG. 4, a process for obtaining customer
`images is described in greater detail. At Step 402, a con
`trolled environment as closely identical as practicable to that
`used to capture the reference images (described above
`relative to FIG. 3) is provided within the image capture
`System 104. In particular, the physical construction of the
`runway, the lighting angles, color and intensities, etc. are
`Substantially similar to those used to capture the reference
`images. The construction of the image capture area is
`preferably flexible in design, portable and lightweight, and
`Strong enough to Support equipment Such as display moni
`tors and cameras. Several alternative placements of the
`controlled environment are described below.
`At step 404, a customer enters the controlled environment
`of the image capture System 104 and activates image cap
`ture. Using known techniques (e.g., motion detection or
`pattern recognition), the activation of image capture is
`preferably performed automatically. However, in an alter
`nate embodiment, an operator may be provided to assist the
`customer and manually activate image capture, Such an
`implementation may be preferable in Some instances in
`order to personalize the experience. In order to capture the
`customer's image at Step 406, the customer walks along the
`runway of the controlled environment. Preferably, an initial
`reference point is provided within the controlled environ
`ment to properly align the customer at the same starting
`point used by the models during capture of the reference
`images. Because of the Similarity of the controlled environ
`ments used, the same camera angles and heights are used
`when acquiring the customer's body image. The Similarity
`of the resulting customer images to the Stored reference
`images allows a more accurate determination of the custom
`er's biometrics, i.e., body size and shape.
`At step 408, it is determined whether the image(s) cap
`tured at step 406 is valid. Using existing biometrics identi
`fication software such as Imagis ID 2000, a valid event
`occurs when a full face comprising eyes, a nose, mouth, etc.
`is detected. Where a camera array or lens array is used, the
`camera or lens with the greatest approximate validity (i.e.,
`most of the face) would be used as the recording camera. A
`minimum of Seven to ten Seconds is considered Sufficient to
`capture a valid event. In this time, eye-level, height, weight
`and body type can be identified. Two additional posts could
`be erected at forty-five degree angles to the main post.
`Camera array or lense arrayS can be mounted to the other
`posts and activated according to their relationship to the
`camera determined to be the recording camera on the main
`post. Although this is not necessary, this arrangement can be
`used to obtain a full 180 degrees or more of image. If the
`image captured at Step 406 is not valid, the process of
`obtaining the customer's image (i.e., Step 406) is repeated
`until a valid image is obtained.
`At Step 410, the valid customer image(s) is stored in
`memory, for example, the database 106 of FIG. 1. In one
`embodiment of the present invention, Storage may be long
`term, thereby allowing the customer's image to be accessed
`at any time, or may be short term, i.e., for the duration of a
`Single event. Storage preferably occurs after the customer
`has manifested his or her approval of the process. For
`example, where the customer was sent a promotion (Such as
`
`PERFECT CORP. EXH. 1001
`
`

`

`US 6,624,843 B2
`
`15
`
`35
`
`40
`
`25
`
`7
`a piece of die cut cardboard or the like) that uniquely
`identifies that customer (e.g., through the use of a bar code
`or other data), the customer can cause the image capture
`System to accept the customer's information encoded
`therein. In this manner, the customer identification informa
`tion can be associated with the customer's image.
`Alternatively, an input device (keypad, touch Screen, etc.)
`can be provided as part of the image capture System Such
`that the user is able to approve of the captured image and
`enter his or her identification information. Regardless,
`assuming that the customer's image is Stored, along with
`information identifying the customer, a body type value is
`assigned to the customer's image at Step 412. This is
`preferably done by an operator of the system. Standard body
`and garment measurements are defined in FashionDeX's
`“ Apparel Design and Production Handbook”, the teachings
`of which are incorporated herein by this reference. Suitable
`body types include, but are not necessarily limited to, Small,
`medium and large and Subsets of petite and full size as
`established by Fashion Dex. Once stored, the customer's
`image may be made available to the customer via the public
`or private networks 110, 112. Additionally, the customer's
`image may be made available for use with other retailers
`having access to the databases 106. Further still, a code is
`assigned to the customer's Stored body image, which code is
`given to the potential customer for use in any of the
`participating merchant Stores, as described in greater detail
`below.
`Referring now to FIG. 5, a process for displaying com
`posite images is described in greater detail. At Step 502, a
`customer enters an image display area (e.g., approaches a
`display Screen) of the image display System 108. In a retail
`other merchandising environment, the image display areas
`are preferably positioned throughout the environment in
`close proximity to certain apparel items for which Stored
`reference images are available. In another embodiment, the
`display area may be completely separate from a retailer's
`place of business, i.e., within another place of business or
`even the customer's home.
`At step 504, it is determined whether a trigger device 116
`has been activated. In the context of the present invention,
`activation of a trigger device at a minimum indicates that a
`customer is in close proximity to an image display area
`because the trigger devices are preferably integral with or in
`close proximity to the device used for display purposes. A
`45
`variety of trigger implementations are possible. In one
`embodiment of the present invention, the trigger device 116
`comprises a camera positioned to detect the presence of a
`perSon in Viewing position relative to the image display area.
`In this case, a trigger event occurs, for example, if the
`customer remains within the image display area for at least
`a predetermine amount of time, e.g., 7 or more Seconds.
`Suitable cameras for this purpose include any charge
`coupled device (CCD) three chip color video camera Such as
`the Sony TRV 900 operating in conjunction with suitable
`pattern recognition programs Such as Imagis Cascade ID
`2000. The camera provides video or still image data to
`Software, executed by either the controller 102 or a distrib
`uted computing platform included in the image display
`System 108, capable of pattern recognition. The pattern
`recognition Software, Such as that found in the Virage
`Videologger with Image Recognition retrieval, tags and
`retrieves the customer's image from the image display area
`with known reference points corresponding to the Stored
`customer images. By comparing the features of the custom
`er's face, as captured by the camera at the image display
`area, with the Stored customer images, the recognition
`
`50
`
`55
`
`60
`
`65
`
`8
`Software provides an indication whether the customer cur
`rently within the image display area is represented within the
`Stored customer images. If a Sufficiently similar match is
`found, the trigger event is deemed valid at step 506. If a
`Sufficiently similar match is not found, but Several candidate
`matches are identified, the customer may be provided with
`information (i.e., names) associated with the candidate
`images and asked to provide data (e.g., a password or the
`code previously associated with the customer's Stored
`image) Sufficient to correlate the customer with one of the
`candidate images.
`In another embodiment, rather than using camera and
`recognition Software, the trigger device 116 comprises a data
`entry device, Such as a keypad, touch Screen, Voice recog
`nition interface or other similar device that allows a cus
`tomer to input data uniquely associated with them. For
`example, when a customer encounters an image display area
`and wishes to View of composite image of themselves in a
`given apparel item, he or she can enter the code previously
`provided when the customer's image was captured (see
`discussion regarding FIG. 4 above). Other information
`capable of uniquely identifying individual customers
`includes, but is not limited to, account numbers, passwords
`and biometric information (e.g., voice prints, fingerprints,
`retinal Scans, etc.). Regardless, if the data input by the
`customer matches data associated with any of the Stored
`customer images, then it is determined at Step 506 that a
`valid event has occurred.
`If a valid event is not identified at step 5