US007478323B2
`
`US 7,478,323 B2
`(10) Patent No.:
`(12) United States Patent
`
` Dowdy (45) Date of Patent: Jan. 13, 2009
`
`
`(54) AUTOMATED CREATION OF MEDIA ASSET
`ILLUSTRATION COLLAGE
`
`2004/0164991 A1
`2005/0031197 A1 *
`2005/0141771 A1*
`
`8/2004 Rose
`2/2005 Knopp ....................... 382/154
`6/2005 Yamakado et a1.
`.......... 382/232
`
`(75)
`
`InVemori Thomas DOWdys Sunnyvale, CA (US)
`
`2006/0066627 A1*
`
`3/2006 Gerhard et a1. .............. 345/593
`
`(73) Assignee: Apple Inc., Cupertino, CA (US)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 462 days.
`
`(21) Appl.No.: 11/078,583
`
`(22)
`
`Filed:
`
`Mar. 11, 2005
`
`(65)
`
`Prior Publication Data
`US 2006/0206811 A1
`Sep. 14, 2006
`
`OTHER PUBLICATIONS
`
`Miser et a1., iPod+ iTunes Starter Kit, Publisher: Que, Pub Date: Dec.
`1, 2004, pp. 1—12.*
`Chopde, Avinash, CD/DVD Inserts and Envelopes, Nov. 2003,
`cdlablegen, version 3.0.0, pp. 1-5.*
`
`(Continued)
`Primary ExamineriDoug Hutton
`Assistant ExamineriNathan Hillery
`
`Related US. Application Data
`
`(57)
`
`ABSTRACT
`
`(51)
`
`(60) Provisional application No. 60/622,280, filed on Oct.
`25 2004.
`’
`Int. C1.
`(2006.01)
`G06F 15/00
`(2006.01)
`G06F 17/00
`715/253. 715/243. 715/273.
`(52) U S Cl
`iiiiiiiiiiiiiiiiiiiii 715/274 715/275’. 715/277’
`I
`I
`I
`(58) Field of Classification Search
`’
`5715/526
`715/527, 528; 382/162, 168; 345/5897598
`See application file for complete search history.
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`............... 345/593
`5,459,824 A * 10/1995 Kashiwazaki
`2002/0027561 A1*
`3/2002 Wu ............................ 345/593
`2002/0054079 A1*
`5/2002 Russel ........................ 345/738
`2002/0193895 A1* 12/2002 Qian et a1.
`....... 700/94
`
`6/2003 Samuelson .................. 345/629
`2003/0107585 A1*
`2003/0174882 A1*
`9/2003 Turpin et a1.
`................ 382/162
`. 704/500
`2004/0054542 A1 *
`3/2004 Foote et a1.
`.........
`
`............. 428/43
`
`4/2004 McCarthy et a1.
`
`2004/0071922 A1 *
`
`Techniques for producing a media asset illustration collage
`are disclosed. These techniques involve, for instance, obtain-
`ing a media asset list containing media asset information,
`obtaining one or more media asset illustrations associated
`with the media asset list, determining a color scheme based on
`the one or more media asset illustrations, and producing a
`media asset
`illustration collage according to the color
`scheme. Further, these techniques involve analyzing the one
`or more media asset illustrations, determining, based on the
`analysis, one or more dominant colors for each of the media
`asset illustrations, determining, based on one or more of the
`dominant colors, one or more alternate colors for each of the
`media asset illustrations, prioritizing the one or more media
`asset illustrations based on the media asset list, selecting one
`or more the ofthe determined dominant colors from the media
`
`asset illustration having the highest priority, and creating the
`color scheme for the media asset illustration collage based on
`the selected dominant color.
`
`34 Claims, 15 Drawing Sheets
`(2 of 15 Drawing Sheet(s) Filed in Color)
`
`
`
`Apple Exhibit 4224
`
`Apple V. SightSound Technologies
`CBM2013-00020
`
`Page 00001
`
`Apple Exhibit 4224
`Apple v. SightSound Technologies
`CBM2013-00020
`Page 00001
`
`

`

`US 7,478,323 B2
`Page 2
`
`OTHER PUBLICATIONS
`
`Obrador, Pere, Automatic color scheme picker for document tem-
`plates based on image analysis and dual problem, Jan. 19, 2006,
`Hewlett-Packard Laboratories, pp. 1-10.*
`“Color Terminology,” Carnright Design, 2004, downloaded from
`www.carnrightdesign.com/color4business/speakingicolorhtm on
`Jan. 13, 2005.
`“Color Wheel,” downloaded from http://hort.ifas.ufl.edu/TEACH/
`floral/color.htm on Jan. 13, 2005.
`
`77
`
`downloaded from w.
`“Complimentary Chromatic Colors,
`smartpixel.net/chromoweb/uks/indexgb.htrnl on Nov. 22, 2004.
`“Color and Vision Questions and Answers,” Color Vision FAQ,
`downloaded from www.cis.rit.edu/mcsl/faq/faql.shtrnl on Nov. 22,
`2004.
`Moretti, et al., “Tools for the Selection of Colour Palettes,” Institute
`of Information Sciences and Technology Massey University, New
`Zealand.
`
`* cited by examiner
`
`Page 00002
`
`Page 00002
`
`

`

`U.S. Patent
`
`Jan. 13, 2009
`
`Sheet 1 of 15
`
`US 7,478,323 B2
`
`[100
`
`Obtain Media Asset
`List
`
`Obtain Media Asset
`
`|llustration(s)
`Associated with the
`Media Asset List
`
`Determine Color
`Scheme Based on
`
`lllustration(s)
`
`Illustration Collage
`
`Produce a Media
`Asset Illustration
`
`Collage According to
`the Color Scheme
`
`Print the Media Asset
`
`Figure 1
`
`Page 00003
`
`Page 00003
`
`

`

`US. Patent
`
`Jan. 13, 2009
`
`Sheet 2 of 15
`
`US 7,478,323 B2
`
`204
`I I|Iustration
`
`200
`
`f
`
`Media
`
`Content
`
`Media_info
`
`208
`
`Figure 2A
`
`{ 220
`
`Figure 23
`
`Page 00004
`
`Page 00004
`
`

`

`US. Patent
`
`Jan. 13, 2009
`
`Sheet 3 of 15
`
`US 7,478,323 B2
`
`242
`
`244
`
`
`
`Track List
`
`
`
`
`
`song_1 - album_1
`song_2 - album_2
`song_3 - album_3
`
`song_4 - album_4
`,
`
`
`204
`
`Figure 20
`
`262
`
`264
`
`246
`
`268
`
`246
`
`Figure 20
`
`204
`
`260
`
`f
`
`204
`
`Page 00005
`
`Page 00005
`
`

`

`U.S. Patent
`
`Jan. 13, 2009
`
`Sheet 4 of 15
`
`US 7,478,323 B2
`
`I 300
`
`Acquire Media Asset
`Illustrations
`
`Determine the
`
`Dominant Colors of
`
`the Media Asset
`
`Illustrations
`
`302
`
`304
`
`304
`
`306
`
`308
`
`Prioritize Media Asset
`
`Illustrations
`
`Select One or More of
`
`the Determined
`
`Dominant Colors from
`
`the Highest Priority
`Media Asset
`
`Illustration
`
`Create a Color
`
`Scheme Based on the
`
`Selected Dominant
`
`Color(s)
`
`Figure 3
`
`Page 00006
`
`Page 00006
`
`

`

`US. Patent
`
`Jan. 13, 2009
`
`Sheet 5 of 15
`
`US 7,478,323 B2
`
`f 400
`
`404
`
`406
`
`402
`
`406
`
`
`
`Dominance
`
` Color
`
`Color
`
`Figure 4
`
`Page 00007
`
`Page 00007
`
`

`

`US. Patent
`
`Jan. 13, 2009
`
`Sheet 6 of 15
`
`US 7,478,323 B2
`
`502
`
`504
`
`506
`
`
`
`Select First/Next
`Analyze the Media
`Dominance for Each
`
`Media Asset
`Asset Illustration
`Color in the Media
`Illustration
`Asset Illustration
`
`Calculate the Color
`
`
`
`
`
`
`Media Asset
`Illustration
`
`'
`NO
`
`510
`
`512
`
`[ 500
`
`Prioritize Media Asset
`
`Calculate Color
`Priority for Each Color
`Based on Color
`Dominance and
`
`Ilustration Priority
`
`Illustrations
`Colors
`
`514
`
`Select One or More
`
`Colors having the
`Highest Color Priority
`
`516
`
`Determine One or
`More Alternate Colors
`Based on the Selected
`
`518
`
`Create Color Scheme
`
`
`
`Based on the Selected
`Colors and
`
`
`Determined Alternate
`Colors
`
`
`End
`
`Figure 5
`
`Page 00008
`
`Page 00008
`
`

`

`US. Patent
`
`Jan. 13, 2009
`
`Sheet 7 of 15
`
`US 7,478,323 B2
`
`
`
`Figure 6A
`
`Page 00009
`
`Page 00009
`
`

`

`US. Patent
`
`Jan. 13, 2009
`
`Sheet 8 of 15
`
`US 7,478,323 B2
`
`[ 600
`
`
` Color
`Priority
`
`Color
`
`Color
`
`
`
`ColorDominance
`
`(C) \620
`
`622j
`
`(d) g
`
`
`
`Priority
`
` Color
`
`Color
`
`624 /
`
`604'
`
` Color
`
`ColorDominance
`
`Priority
`
`(0)
`
`K52“
`
`((0
`
`Figure GB
`
`Page 00010
`
`Page 00010
`
`

`

`US. Patent
`
`Jan. 13, 2009
`
`Sheet 9 of 15
`
`US 7,478,323 B2
`
`[ 700
`
`708
`
`704'
`
`(a)
`
`706
`
`706
`
`
`
`Figure 7A
`
`Page 00011
`
`Page 00011
`
`

`

`US. Patent
`
`Jan. 13, 2009
`
`Sheet 10 of 15
`
`US 7,478,323 B2
`
`[750
`
`
`
`740
`
`760
`
`720
`
`Figure 78
`
`Page 00012
`
`Page 00012
`
`

`

`U.S. Patent
`
`Jan. 13 2009
`
`Sheet 11 of 15
`
`US 7,4
`
`78,323 B2
`
`
`
`Page 00013
`
`

`

`US 7,478,323 B2
`
`
`
`Page 00014
`
`

`

`US. Patent
`
`Jan. 13, 2009
`
`Sheet 13 of 15
`
`US 7,478,323 B2
`
`Iaiylfist ppiibirary, Us?
`
`singéa ,pwgrfmm 1h? wag? _
`
`'
`
`FIG. 9
`
`Page 00015
`
`Page 00015
`
`

`

`US. Patent
`
`Jan. 13, 2009
`
`Sheet 14 of 15
`
`US 7,478,323 B2
`
`"
`
`IPrintafliage-pf avaiiapll album‘ariwgrkfl
`frc'im‘ .thé' 'sghgé In Wu: selébiéd. flaws
`,iibraryflhe pack also {gamma magnum sj
`1 amorkiprints'infmlmto'r: --
`-
`
`-‘
`
`.
`
`.
`.-
`
`‘
`
`F56. 10
`
`Page 00016
`
`Page 00016
`
`

`

`US. Patent
`
`Jan. 13, 2009
`
`Sheet 15 of 15
`
`US 7,478,323 B2
`
`FIG. 11
`
`Page 00017
`
`Page 00017
`
`

`

`US 7,478,323 B2
`
`1
`AUTOMATED CREATION OF MEDIA ASSET
`ILLUSTRATION COLLAGE
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`This application is related to US. Provisional Patent Appli-
`cation No. 60/622,280, filed on Oct. 25, 2004 and entitled
`“Online Purchase of Digital Media Bundles”, and hereby
`incorporated herein by refererence.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`In general, the invention relates to media management
`applications, and, more particularly, to using a media man-
`agement application to create and print illustrated labels for
`media asset collections.
`
`2. Description of the Related Art
`Traditionally, music has been purchased at music stores or
`music departments of larger stores. A consumer will visit the
`music store or department and manually browse for albums or
`compact discs (CDs) ofinterest. After the consumer selects an
`album or CD of interest, the consumer proceeds to a checkout
`register to pay for the album or CD being purchased.
`In recent years music delivery or distribution over the Inter-
`net has become popular. Due to the advances in efficient file
`formats, such as MP3 and MPEG4, the size of media files has
`become small enough to make their download via the Internet
`practical. Also, technological advances have led to higher-
`speed Internet connections and lower cost of memory. The
`combination of these advances make downloading media
`files, such as for music and videos, manageable and not too
`time consuming.
`One popular approach to online music distribution is Apple
`Computer’s iTunes® online music store. Consumers may use
`the iTunes® online music store to purchase music either as
`individual music tracks or in albums of songs. Other music
`stores such as RhapsodyTM and NapsterTM have also been
`employed to purchase music online.
`In many instances, consumers who have purchased music
`using an online media store are given permission under a
`purchase or license agreement to create (burn) CDs, DVDs, or
`other removable media that contain the music they have pur-
`chased from the online music store for personal use. Gener-
`ally, buming is performed using a removable media drive
`(e. g., CD-RW) in conjunction with an application running on
`a client computer. For example, if a consumer has a personal
`computer with a CD burner, the iTunes® client application
`allows the consumer to burn a CD. For example, the consumer
`may purchase a media asset collection or compilation online.
`Generally speaking, a media asset collection/compilation is
`typically a grouping of one or more media assets, selected by
`a user (e.g., a custom playlist) or a media publisher (e.g.,
`album, boxset, video collection, etc.).
`Ifthe consumer decides to burn a collection/compilation to
`a removable medium such as a CD, DVD, or MiniDiskTM, that
`user might also desire an attractive illustrated label to go
`along with it. Some media management applications, such as
`MusicMatch JukeboxTM and Apple Computer’ s iTunes®,
`allow the user to create labels for the media they have burned
`(or intend to burn), which can then be printed using a printer.
`For example, a label can be an insert for a CD jewel case that
`includes one or more media asset illustrations associated with
`
`the songs that have been burned to the CD as well as a list of
`songs that have been burned to the CD.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`
`Unfortunately, a user generally has few options in the
`selection of the colors that will be used to create jewel case in
`for a media asset collection/compilation. Typically, the user is
`not given a choice as to the colors used in the creation of the
`illustrated label. However, giving the user too much control
`over color selection may not be desirable to many users who
`are not interested in “eyeballing” or estimating which colors
`will be aesthetically pleasing. Thus, there is a need for tech-
`niques to automate color selection in the creation of CD jewel
`cases and other color labels that can be created to accompany
`burned media.
`
`SUMMARY OF THE INVENTION
`
`The invention pertains to techniques for creating and/or
`printing a media asset illustration collage that can be used as
`a label to adorn a removable media or a removable media
`
`storage container, for example a CD or CD jewel case, respec-
`tively. These techniques use color selection techniques to
`automatically select colors based on one or more media asset
`illustrations. Further, the color selection is performed in such
`a way as to present an aesthetically pleasing color combina-
`tion (color scheme) for a media asset illustration collage. The
`invention can be implemented in numerous ways, including
`as a method, system, device, apparatus, graphical user inter-
`face, or computer readable medium. Several embodiments of
`the invention are discussed below.
`In one embodiment of the invention, a media asset illustra-
`tion collage is produced by first obtaining a media asset list
`containing media asset information, obtaining one or more
`media asset illustrations associated with the media asset list,
`determining a color scheme based on the one or more media
`asset illustrations, and then producing a media asset illustra-
`tion collage according to the color scheme. The media asset
`illustrations canbe album cover art or other images associated
`with a media asset, such as promotional photographs or logos.
`These illustrations may be contained within individual media
`assets (e. g., a graphic file contained in the headers of a music
`file) or may be separate from the associated media assets.
`In another embodiment of the invention, the production of
`the media as set illustration collage further involves producing
`a track listing including media asset information (e.g., title,
`artist information, etc.) and incorporating it into the media
`asset collage.
`In some embodiments of the invention, the media asset
`collage incorporates a front (first) and rear (second) panel,
`where the front panel contains one or more of the media asset
`illustrations and the rear panel contains the track listing. In
`one implementation, the front panel is a mosaic of one or
`more of the media asset illustrations and the rear panel is a
`reproduction of the front panel using a monochromatic color
`scheme based on a dominant color.
`
`Still another embodiment of the invention, further involves
`determining the color scheme by analyzing the one or more
`media asset illustrations, determining, based on the analysis,
`one or more dominant colors for each of the media asset
`
`illustrations, determining, based on one or more of the domi-
`nant colors, one or more alternate colors for each ofthe media
`asset illustrations, prioritizing the one or more media asset
`illustrations based on the list of media asset information,
`selecting one or more the of the determined dominant colors
`from the media asset illustration having the highest priority,
`and creating the color scheme for the media asset illustration
`collage based on the selected dominant color.
`One embodiment of the invention prioritizes the media
`asset illustrations by counting the number of media assets on
`the media asset list that are associated with each illustration
`
`Page 00018
`
`Page 00018
`
`

`

`US 7,478,323 B2
`
`3
`and assigning the highest priority to the media asset illustra-
`tions with the greatest number of associated media assets.
`In one embodiment of the invention, a media asset illustra-
`tion collages is produced by obtaining a media asset list
`containing media asset information, obtaining one or more
`media asset illustrations associated with the media asset list,
`analyzing the one or media asset illustrations, determining,
`based on the analysis, one or more dominant colors for each
`of the media asset illustrations, determining, based on one or
`more of the dominant colors, one or more alternate colors for
`each of the media asset illustrations, prioritizing the one or
`more media asset illustrations based on the list of media asset
`
`information, selecting one or more the of the determined
`dominant colors from the media asset illustration having the
`highest priority, creating a color scheme for the media asset
`illustration collage based on the selected dominant color,
`producing a media asset illustration collage according to the
`color scheme, and printing the media asset illustration col-
`lage.
`Other aspects and advantages ofthe invention will become
`apparent from the following detailed description taken in
`conjunction with the accompanying drawings which illus-
`trate, by way of example, the principles of the invention.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The patent or application file contains at least one drawing
`executed in color. Copies of this patent or patent application
`publication with color drawing(s) will be provided by the
`Office upon request and payment of the necessary fee.
`The invention will be readily understood by the following
`detailed description in conjunction with the accompanying
`drawings, wherein like reference numerals designate like
`structural elements, and in which:
`FIG. 1 is a flow diagram of a media asset illustration col-
`lage creation process according to one embodiment of the
`invention.
`
`FIG. 2A is a diagram of a media asset according to one
`embodiment of the invention.
`
`FIGS. 2B-2D are diagrams of media asset illustration col-
`lages according to various embodiment of the invention.
`FIG. 3 is a flow diagram of a color scheme determination
`process according to one embodiment of the invention.
`FIG. 4 illustrates an example of a dominant color analysis
`of a media asset illustration according to one embodiment of
`the invention.
`
`FIG. 5 is a flow diagram of a color scheme determination
`process according to one embodiment of the invention.
`FIGS. 6A and 6B illustrate a color scheme determination
`
`example according to one embodiment of the invention.
`FIGS. 7A-7B are media asset illustration collage produc-
`tion examples according to various embodiments of the
`invention.
`FIGS. 8A-8F are illustrations of color selection methods
`
`according to several embodiments of the invention.
`FIG. 9 is a screenshot of an iTunes® dialog window show-
`ing a user interface for printing a media asset illustration
`collage (e.g., a CD jewel case insert) using four media asset
`illustrations.
`
`FIG. 10 is a screenshot of an iTunes® dialog window
`showing a user interface for printing a media asset illustration
`collage (e.g., a CD jewel case insert) using four media asset
`illustrations.
`
`FIG. 11 shows an exemplary computer system suitable for
`use with the invention.
`
`4
`DETAILED DESCRIPTION OF THE INVENTION
`
`Broadly speaking, the invention pertains to techniques for
`creating and/or printing a media asset illustration collage that
`can be used as a label to adorn a removable media or a
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`removable media storage container, for example, a CD or CD
`jewel case, respectively. These techniques use color selection
`techniques to automatically select colors based on one or
`more media asset illustrations. Further, the color selection is
`performed in such a way as to present an aesthetically pleas-
`ing color combination (color scheme) for a media asset illus-
`tration collage.
`Generally, a media asset illustration collage is an illustrated
`label that accompanies a media asset collection or compila-
`tion, such as a CD jewel case insert, DVD case insert, MiniD-
`iskTM case insert, or a label that is applied directly to the media
`(typically on a non-playable surface). Typically, the media
`asset illustration collage is formed from one or more media
`asset illustrations (e.g., album cover graphics) combined into
`a single illustration. Possible arrangements include mosaics,
`grids, and overlays, as well as other patterns. The media asset
`illustrations in the collage can all be the same size or size can
`be adjusted according to a user or application determined
`media asset illustration priority.
`FIG. 1 is a flow diagram of a media asset illustration col-
`lage creation process 100 according to one embodiment ofthe
`invention. The media asset illustration collage creation pro-
`cess is performed, for example, using a media management
`application. One example of a music management program is
`iTunes®, produced by Apple Computer, Inc. of Cupertino,
`Calif.
`
`The media asset illustration collage creation process 100
`begins with obtaining 102 a media asset list. The media asset
`list contains information relating to media assets (e.g., songs)
`on the media asset list. Such information can include, but not
`limited to, media asset title (e.g., song title), media asset
`composer (e.g., artist name), and media asset compilation
`(e.g., album name). Next, any media asset illustrations asso-
`ciated with the media asset list are obtained 104. These media
`
`asset illustrations can include, for example, album cover art or
`photographs associated with a particular media asset. In some
`embodiments of the invention, the aforementioned media
`asset
`illustrations are contained within individual media
`assets. In these embodiments, media asset illustrations can be
`stored in the file headers of a particular media asset.
`Once the media asset illustrations associated with the
`media asset list have been obtained 104, a color scheme is
`determined 106 based on the illustrations. This determination
`
`50
`
`106 is typically some form of weighted color analysis, one
`embodiment ofwhich is described below in reference to FIG.
`3.
`
`55
`
`60
`
`65
`
`Next, a media asset illustration collage is produced 108
`according to the color scheme. In one embodiment of the
`invention, the media asset illustration collage is produced by
`arranging one or more of the media asset illustrations associ-
`ated with the media asset list in a tiled pattern (e.g., in a grid
`or mosaic). Finally, the media asset illustration collage can be
`printed 110. Once printed, the media asset illustration collage
`is available for use as a jewel case insert or label.
`FIG. 2A is a diagram ofa media asset 200 according to one
`embodiment ofthe invention. The media asset 200 shown is a
`
`song file, for example an MP3 or AAC file, although any
`media file type may be used.
`The media asset 200 contains one or more data segments
`including a data segment containing media content 206, a
`data segment containing media information 208, and a data
`segment containing a media asset illustration 204. In one
`
`Page 00019
`
`Page 00019
`
`

`

`US 7,478,323 B2
`
`5
`embodiment ofthe invention, the media content 206 is a song,
`and the media information 208 is song information, which
`typically includes song name, artist name, and album name,
`as well as other publication information. Further, in some
`embodiments of the invention, the media asset illustration
`204 is an image of an album cover associated with the media
`asset 200. In other embodiments, the media asset illustration
`204 can be an image of a poster, photograph, or promotional
`material associated with the media asset 200.
`
`FIG. 2B is a diagram of a media asset illustration collage
`220 according to one embodiment of the invention. The
`media asset illustration collage 220 shown contains four
`media asset
`illustrations 204 arranged in a two-by-two
`mosaic pattern, although any number of media assets 204
`may be used. In one embodiment of the invention, the mosaic
`pattern consists of up to 25 rectangular illustrations 204
`arranged in a five-by-five tiled pattern. Although the media
`asset illustration collage 220 is shown having a media asset
`illustration 204 in every position of the mosaic, in some
`embodiments, one or more positions in the mosaic do not
`contain media asset illustrations 204 and are instead left
`
`blank. In some embodiments, these blank spaces are filled
`with one or more colors from the color scheme determined in
`
`step 106 of FIG. 1. Further, although the mosaic pattern
`shown employs rectangular tiles arranged in a grid, other
`patterns and illustration shapes are possible (e.g., hexago-
`nally-shaped illustrations).
`FIG. 2C is a diagram of a media asset illustration collage
`240 according to another embodiment of the invention.
`According to some embodiments of the invention, the media
`asset illustration collage 240 shown is a media asset compi-
`lation case insert or label such as a CD jewel case insert or
`DVD case insert as described above. Generally, in the case of
`a media asset compilation case insert or label, the media asset
`illustration collage 240 indicates to the viewer of the media
`asset illustration collage which media assets are included on
`the media (e.g., CD) associated with the media asset compi-
`lation label.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`The media asset illustration collage 240 includes two pan-
`els. The first panel 242 incorporates a track list 246, indicating
`the titles of the media assets that are contained in the media
`
`40
`
`asset list upon which the media asset illustration collage 240
`is based. The second panel 244 is a media asset illustration
`collage containing four media asset illustrations 204. Each
`media asset illustration is associated with a media asset dis-
`
`played on the track list 246 on the first panel 242. According
`to some embodiments of the invention, the second panel 244
`is the media asset illustration collage 220 of FIG. 2B.
`FIG. 2D is a diagram of a media asset illustration collage
`260 according to still another embodiment of the invention.
`Like the media asset illustration collage 240 above, the media
`asset illustration collage 260 shown includes two panels. A
`first panel 262 includes a media asset list 246 superimposed
`over a patterned background 268. In some embodiments of
`the invention, the patterned background 268 incorporates
`substantially the same media asset illustrations 204 (arranged
`in the same pattern) as are visible on a second panel 264. In
`other embodiments ofthe invention, the first panel 262 incor-
`porates different media asset illustrations 204 or a different
`arrangement of media asset illustrations 204 than those vis-
`ible on the second panel 264. Further, in some embodiments,
`the patterned background 268 of first panel 262 is a mono-
`chromatic version of the second panel 264, i.e., displayed
`using only shades and tints of a single color (e. g., one or more
`colors from the color scheme determined in step 106 of FIG.
`1). Also, as discussed in reference to FIG. 2C, the media asset
`illustration collage 260 includes the track listing 246.
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`FIG. 3 is a flow diagram of a color scheme determination
`process 300 according to one embodiment of the invention.
`The color scheme determination process 300 determines a
`color scheme. As an example, the color scheme is used in the
`production 108 of the media asset illustration collage of FIG.
`1.
`
`The color scheme determination process 300 begins by
`acquiring 302 of one or more media asset
`illustrations.
`According to one embodiment of the invention, the media
`asset illustrations that are acquired 302 are the media asset
`illustrations associated with a media asset list, such as the
`media asset list discussed above in reference to operation 102
`FIG. 1. Next, the acquired media asset illustrations are ana-
`lyzed to determine 304 the dominant colors associated with
`each media asset illustration. Subsequently, the media asset
`illustrations are prioritized 304 according to some predeter-
`mined criteria.
`In one embodiment of the invention, the media asset illus-
`trations are prioritized 304 according to the number of media
`assets on a media asset list that are associated with a particular
`media asset illustration. For example, a sample media asset
`list might contain five media assets, a, b, and c, that are
`associated with a first media asset illustration A, and two
`media assets, d and e, that are associated with a second media
`asset illustration B. In this embodiment, illustration A is
`assigned a higher priority (three associated media assets) than
`Illustration B (two associated media assets). Of course, other
`prioritization schemes are possible. For example, by giving
`priority to media asset illustrations associated with media
`assets having higher user ratings (e.g., media assets that have
`been rated by a user using ratings scale in a media manage-
`ment application).
`The color scheme determination process 300 continues by
`selecting 306 one or more dominant colors from the highest
`priority media asset illustration. The one or more dominant
`colors are then used to create 308 a color scheme.
`
`FIG. 4 illustrates a simplified example of a dominant color
`analysis 400 of a media asset illustration 402 according to one
`embodiment of the invention. The analysis is accomplished
`by creating a histogram of all the colors contained in the
`media asset illustration 402, where the intensity/dominance
`of a color is indicated by the size of a color peak. In this
`example, there are three colors, indicated in the figure as color
`404, color 406, and color 408. Below the media asset illus-
`tration 402, a histogram 430 is shown, indicating that color
`406 is the dominant color in the media asset illustration 402.
`
`It will be understood by those familiar with the art that the
`histogram 420 is a highly simplified diagram and that a real
`illustration and corresponding histogram can include sub-
`stantially more colors.
`FIG. 5 is a flow diagram of a color scheme determination
`process 500 according to another embodiment of the inven-
`tion. The color scheme determination process 500 determines
`a color scheme. As an example, the color scheme is used in the
`production 108 of a media asset illustration collage of FIG. 1.
`The color scheme determination process 500 typically oper-
`ates on one or more media asset illustrations associated with
`a media asset list such as the media asset list 246 ofFIG. 2C.
`
`The color scheme determination process 500 begins by
`selecting 502 a media asset illustration. The media asset illus-
`tration is then analyzed 504, for example by taking a histo-
`gram of all the colors in the media asset illustration as shown
`in FIG. 4. Next, color dominance is calculated 506 for each of
`the colors in the media asset illustration. In some embodi-
`
`ments of the invention, the color dominance can correspond
`to a height of a histogram peak. Next, decision 508 deter-
`mines if there are more media asset illustrations to be ana-
`
`Page 00020
`
`Page 00020
`
`

`

`US 7,478,323 B2
`
`7
`lyzed. If so, the decision 508 returns to repeat block 502 and
`subsequent blocks. If, on the other hand, there are no more
`media asset illustrations to be analyzed 504, the color scheme
`determination process 500 continues, to block 510, where the
`analyzed media asset illustrations are prioritized. The priori-
`tization 510 occurs, for example, according to operation 304
`as described above with reference to FIG. 3. However, various
`other prioritization schemes are possible.
`Next, the color priority for each color in the analyzed media
`asset illustrations is calculated 512 based on the color domi-
`
`nance and the illustration priority as determined inblocks 506
`and 510. In some embodiments of the invention, the color
`priority is calculated only for the most dominant colors in
`each media asset illustration, for example the top five most
`dominant colors of each media asset illustration. Next, one or
`more colors having the highest color priority are selected 514.
`The number of colors selected can be determined by user
`input (e.g., a user dialog), by an aesthetic determination made
`using a software program, or by other methods. In one
`embodiment of the invention, the color with the highest color
`priority is selected.
`Once the one or more highest-priority colors have been
`selected 514, one or more alternate colors are determined 516
`using well-known color theory principles (described below
`with reference to FIGS. 8A-8F.) In one implementation, the
`alternate colors that are determined 516 include one or more
`
`shades or tints ofthe selected highest-priority color/colors. In
`another implementation, one or more complements of the
`selected highest-priority colors are determined 516 as the
`alternate colors.
`
`Upon determining 516 the one or more alternate colors, the
`color scheme determination process creates 518 a color
`scheme based on the selected highest-priority colors and
`determined alternate colors.
`FIGS. 6A and 6B illustrate a color scheme determination
`
`example 600 according to one embodiment of the invention.
`This color scheme determination example 600 can,
`for
`example, correspond to the color scheme determination pro-
`cess 500 of FIG. 5 above.
`
`The color scheme determination example 600 begins with
`an illustration of a media database 602 at step (a). The media
`database 602 contains media assets 608, such as music or
`video files. This particular media database 602 contains four
`media asset collections 612, (designatedAlbum_1,Album_2,
`etc.). Each media asset collection 612 contains four media
`assets 608 (designated Song_1, Song_2, etc.) and a single
`media asset illustration 604. In the embodiment shown, the
`media assets 608 are music files (i.e., songs) and the media
`asset illustrations 604 are album cover graphics. Further, in
`some embodiments of the invention, the media assets 608
`within media asset collections 612 are music albums by a
`single artist, music compilat