`
`(12) Ulllted States Patent
`Chaudhri
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,032,565 B2
`*Oct. 4, 2011
`
`(54) AUTOMATED CREATION OF MEDIA ASSET
`ILLUSTRATIONS
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`(75)
`
`Inventor:
`
`Imran Chaudhri, San Francisco, CA
`(US)
`
`,
`,
`(73) Asslgneei Apple Inc» C11PeIT1I10s CA (US)
`
`( * ) Notice:
`
`Subject. to any disclaimer, the term of this
`patent is extended or adjusted under 35
`USC 15409) by 0 days
`-
`-
`-
`-
`-
`This patent is subject to a terminal dis-
`C1aimer~
`
`(21) Appl.No.: 12/694,170
`
`6,748,382 B1 *
`7,213,036 B2
`7,305,436 B2
`7,346,668 B2
`7,370,276 B2
`7,478,323 B2*
`20057/b628758s
`2006/0089949 A1
`2006/0123052 A1
`2006/0155914 A1
`2006/0206811 A1
`2006/0247980 A1
`2007/0192818 A1*
`
`6/2004 Mohan et al.
`5/2007 Apparao et al.
`12/2007 Willis
`3/2008 Willis
`5/2008 Willis
`1/2009 Dowdy _. ...................... .. 715/253
`13; i et al
`4/2006 Robbin et 31.
`6/2006 Robbin et al.
`7/2006 Jobs et al.
`9/2006 Dowdy
`11/2006 Mirrashidi et a1.
`8/2007 Bourges-Sevenier
`eta1~ ~~~~~~~~~~~~~~~~~~~~~~~~~~~ ~~ 725/132
`OTHER PUBLICATIONS
`
`....................... .. 1/1
`
`'
`
`(22)
`
`Ffled:
`
`(55)
`
`Jan‘ 26’ 2010
`_
`_
`_
`Pm" P“b11°at1°11 Data
`
`U.S.App1.N0. 11/519,460, entitled “Media Manager with Integrated
`Browsers”, filed Sep. 11, 2006.
`Office Action for U.S. Appl. No. 11/650,857, mailed Mar. 31, 2009.
`
`US 2010/0131833 A1
`
`May 27, 2010
`
`,,. Cited by examiner
`
`Related U_S_ Application Data
`
`Primary Examiner 7 Jean M Corrielus
`
`(63) Continuation of application No. 11/650,857, filed on
`Jan 7: 2007: now P33 N0- 7s685s163-
`
`ABSTRACT
`(57)
`The invention pertains to techniques for creating media asset
`illustrations for media assets are disclosed. The created media
`
`(51)
`
`Int, Cl,
`(2006.01)
`G06F 17/30
`(52) U_S_ CL ...... N 707/804; 715/253; 715/274; 715/275;
`71 5/277
`(58) Field of Classification Search ................ .. 715/253
`715/274, 275, 277; 707/804
`See application file for complete search history.
`
`asset illustrations are useful for media assets that lack asso-
`ciated media asset illustrations. The techniques can analyze
`media asset data or media asset metadata when creating the
`create media asset illustrations. The created media asset illus-
`“.a“°“S. Can’ f°r e."amP1e’ be used While Playing’ bmwsing Or
`displaying associated media assets.
`20 Claims, 10 Drawing Sheets
`
`300
`
`H
`
`Start
`
`v
`Analyze Media
`Asset Meta /\J 302
`Data
`
`Y
`
`Analyze Media
`Asset Data ’\4 3°‘
`
`’\2 306
`
`Alter Proposed
`Media Asset
`Illustration
`
`r\‘’ 310
`
`Proposed
`Media Asset
`Illustration is
`
`U niqua
`7
`
`
`
`
`Apple Exhibit 4451
`
`Apple v. SightS0und Technologies
`CBM2013-00023
`
`Page 00001
`
`Apple Exhibit 4451
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`
`
`U.S. Patent
`
`Oct. 4, 2011
`
`Sheet 1 of 10
`
`US 8,032,565 B2
`
`100
`
`\
`
`102
`
`Select Media
`
`
`
`Illustration
`
`Asset Missing
`
`112
`
`Select Next
`Media Asset
`
`Create'Media'
`Asset
`
`
`Illustration
`
`
`110
`
`Media Asset
`Illustration with
`Media Asset
`
`
`Yes
`
`\ Media Assets
`-\
`?
`
`FIG. 1
`
`Page 00002
`
`Page 00002
`
`
`
`U.S. Patent
`
`Oct. 4, 2011
`
`Sheet 2 of 10
`
`US 8,032,565 B2
`
`200
`
`\.
`
`V
`
`\\
`
`0 N
`// \\
`///5 .
`K —m\\\\
`\\ 0
`L /
`
`\_J/ 202
`
`Media Data
`
`/ J 204
`
`Meta Data
`
`Media Asset
`
`FIG. 2
`
`Page 00003
`
`Page 00003
`
`
`
`U.S. Patent
`
`Oct. 4, 2011
`
`Sheet 3 of 10
`
`US 8,032,565 B2
`
`300
`
`H
`
`Analyze Media
`Asset Meta
`
`302
`
`Data
`
`Analyze Media
`Asset Data
`
`
` Create
`
`\J 306
`
`
`
`Proposed
`Media Asset
`
`Illustration
`
`
`
`
`
`\
`
`Proposed
`Media Asset
`.
`.
`Illustration IS
`.
`
`\
`
`\Unsque'2
`
`
`
`
`
`
`
`\
`
`310
`
`
`
`.
`l\/Eedla Asset
`.
`Illustration
`
`FIG. 3
`
`Page 00004
`
`Page 00004
`
`
`
`U.S. Patent
`
`Oct. 4, 2011
`
`Sheet 4 of 10
`
`US 8,032,565 B2
`
`400
`
`Determine Genre
`
`\“ 402
`
`Determine Artist
`
`404
`
`Determine Title
`
`\” 406
`
`Create" Temntatii/e
`Media Asset
`Illustration
`
`408
`
`
` ropose
`Media Asset
`Iiiustration is
`
`Unique
`
`
`FIG. 4
`
`A|'©[ee“d:"A"’:S:‘:d
`Illustration
`
`/«V 412
`
`Page 00005
`
`Page 00005
`
`
`
`U.S. Patent
`
`Oct. 4, 2011
`
`Sheet 5 of 10
`
`US 8,032,565 B2
`
`500
`
`\.
`
`506
`
`
`
`Media Asset
`
`Metadata
`
`508
`
`Media Asset Analyzer
`
`Media Asset
`
`Data
`
`504
`
`Z
`
`514
`
`512
`
`
`
`_
`Media Asset
`Illustration
`
`Existing
`Media Asset
`Illustrations
`
`_
`_
`Media Asset Illustration
`Creator
`
`510
`
`FIG. 5
`
`Page 00000
`
`Page 00006
`
`
`
`U.S. Patent
`
`Oct. 4, 2011
`
`Sheet 6 of 10
`
`US 8,032,565 B2
`
`600
`
`‘Rb
`
`604
`
`_692 592',602'fj,6o2'"’
`/,««"
`——-—/’
`
`
`
`(a)
`
`Q
`
`.
`692 /692 502"’ 002"”
`
`
`
`604
`
`1‘
`
`604 ‘
`
`FIG. 6A
`
`Page 00007
`
`Page 00007
`
`
`
`U.S. Patent
`
`Oct. 4, 2011
`
`Sheet 7 of 10
`
`US 8,032,565 B2
`
`(3)
`
`([3)
`
`(0)
`
`
`
`660
`
`'
`
`9 <,‘:::>
`I
`
`Media Data
`"""""""""""""""""""""""""""""""""""""""""
`
`...........................................................
`
`'
`
`'
`
`Meta Data;
`Media Asset:
`
`650
`
`L’
`
`
`
`Media Data
`
`(d)
`
`Meta Data
`
`Media Asset
`
`FIG. 6B
`
`656
`
`(9)
`
`Page 00003
`
`Page 00008
`
`
`
`U.S. Patent
`
`Oct. 4, 2011
`
`Sheet 8 of 10
`
`US 8,032,565 B2
`
`700
`
`Page 00009
`
`702
`
` M
`
`/«X, 704
`Artist_Name
`Album_TEt|e
`
`FIG. 7
`
`Page 00009
`
`
`
`U.S. Patent
`
`Oct. 4, 2011
`
`Sheet 9 of 10
`
`US 8,032,565 B2
`
`N
`o
`m
`
`*0
`o
`m
`
`2:252”.W
`
`u_:nEm_m_
`
`u_:n:uum_
`
`UEEfim_m_H
`
`n_:Etmm_
`
`u_.:Efimm_
`
`u_E..umm
`
`u:oLumm_
`
`ucofimm
`
`utobumu
`
`u_Ln_._.tn.E
`
`_u.__E_._m3_._:r__5._.0
`
`EDU_.£..__n.£n.
`
`FDU3353.u.
`
`£0
`
`n_m.
`
`#3..
`
`gnu...
`
`..$._.u_u_E:oz
`
`Ln.:Jn_/__
`
`
`
`W2.....UHEn.r_
`
`
`
`._0U_U_D_=a_..L
`
`_D_4_u_n__._nE
`
`
`
`x_._m.¢.E._u_.__..._
`
`xn_m..a..E._u__.__.,_.
`
`E9;,o8m__.EmE9".18&3
`_.,:$;$8m__.+:m.
`
`
`
`n.2:.3.533.835_£__a_.2355miucammm.
`
`,__$
`
`Ezusflaoz
`
`umfiumon
`
`:m._.—u_..__u=......z
`
`amas.Er.M:.___umm._..
`
`am.
`
`
`
`ac_E_._m3_”_:n,..}.50
`
`u__m.
`
`Lw___u_tL_.m.2
`
`_EU_§_._m.z
`
`£mu_u_fi.5mz
`
`
`
`En$1..¢.._au__..:
`
`E$0£_E._..3.
`
`EE3m8m.__.:m
`
`Lmcuzflzmzu
`
`In21¢.m_H.m:.:.m.
`
`___E_uuE:Ein?_"._._.u..._Emm:2.mm
`
`
`
`E92.m.?_mEmu
`
`LHEUILEE2
`
`EEucmnH
`
`Eu3:.m8u.___,:_o
`
`E23.m8m._..:._u_.
`
`
` Lmsunuosufimu_}_n2n._.E.9:53P_.a..35
`
`Em2,_..uo§.r:
`
`_.Em:..on_u_u.__..:w.
`
`_}m2.:.no§..E
`
`Eot¢o8N___.:n.
`
`
`
`_>n_2.2“033.11».
`
`
`
`
`
`m_.,_mum::9.___:_53%mm
`
`tau9.:m:_:n.__,mm
`
`:u>:Em|_IcmEs
`
`
`
`m_u._mfm._._}m%_mm
`
`mc0u_mn_EB
`
`
`_..:nz$nsm._:._.
`
`
`2.9.,Smd....£w__bmt_.__Emm
`
`_H_Emm
`
`mow
`
`Page 00010
`
`Page 00010
`
`
`
`
`
`
`
`
`U.S. Patent
`
`Oct. 4, 2011
`
`Sheet 10 of 10
`
`US 8,032,565 B2
`
`
`
`/7/T X
`
`:;:::j 930
`
`B /928
`
`900
`
`/940
`
`x~\_/1000
`
`FIG. 10
`
`Page 00011
`
`Page 00011
`
`
`
`US 8,032,565 B2
`
`1
`AUTOMATED CREATION OF MEDIA ASSET
`ILLUSTRATIONS
`
`CROSS-REFERENCE TO RELATED
`APPLICATION
`
`This application is a continuation of U.S. application Ser.
`No. 11/650,857, filed Jan. 7, 2007now U.S. Pat. No. 7,685,
`163, and entitled “Automated Creation of Media Asset Illus-
`trations,” which is hereby incorporated herein by reference.
`
`COPYRIGHT NOTICE
`
`A portion of the disclosure of this patent document con-
`tains material which is subject to copyright protection. The
`copyright owner has no objection to the facsimile reproduc-
`tion by anyone ofthe patent document or the patent disclosure
`as it appears in the U.S. Patent and Trademark Office patent
`file or records, but otherwise reserves all copyright rights
`whatsoever.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`In general, the invention relates to media management
`applications, and, more particularly, to using a media man-
`agement application to create media asset illustrations for
`media assets.
`
`2. Description of the Related Art
`Traditionally, music has been purchased at music stores or
`music departments of larger stores. A consumer will visit the
`music store or department and manually browse for albums or
`compact discs (CDs) ofinterest. After the consumer selects an
`album or CD of interest, the consumer proceeds to a checkout
`register to pay for the album or CD being purchased.
`In recent years music delivery or distribution over the Inter-
`net has become popular. Due to the advances in efficient file
`formats, such as MP3 and MPEG4, the size of media files has
`become small enough to make their download via the Internet
`practical. Also, technological advances have led to higher-
`speed Internet connections and lower cost of memory. The
`combination of these advances make downloading media
`files, such as for music and videos, manageable and not too
`time consuming.
`One popular approach to online music distribution is Apple
`Computer’s iTunes® online music store. Consumers may use
`the iTunes® online music store to purchase music either as
`individual music tracks or in albums of songs.
`Often, when a consumer purchases a media asset such as a
`music track, the media asset includes a media asset illustra-
`tion (e.g., a computer graphic representing an album cover).
`Traditionally, album cover art has been used by music listen-
`ers to identify music albums by sight. The media asset illus-
`tration can be displayed while the media asset is playing, for
`instance, on the display screen of a music player. For
`example, the iPod®, produced by Apple Computer of Cuper-
`tino, Calif., allows a user to display a media asset illustration
`(e.g., album cover art) associated with a particular audio track
`while the track is playing.
`Unfortunately, not all media assets have associated media
`asset illustrations. The reason for a missing media asset illus-
`tration can vary, but can include unavailability, file corrup-
`tion, or accidental deletion. Alternately, a media illustration
`can be missing if the media asset is taken from a user’s
`personal music collection (e.g., ‘ripped’ from a Compact Disk
`(CD).) Also, although it is sometimes possible to download
`
`2
`media asset illustrations online, if a user does not have a
`network connection available, media asset illustrations will
`not be available.
`
`Thus, there is a need to obtain media asset illustrations for
`those media assets that do not have associated media asset
`illustrations.
`
`SUMMARY OF THE INVENTION
`
`The invention pertains to techniques for creating media
`asset illustrations for media assets. These created media asset
`illustrations are useful for media assets that lack associated
`
`media asset illustrations. For example, the created media
`asset illustrations can serve as substitute media asset illustra-
`
`tions that are used in place of a missing or unavailable media
`asset illustrations. These techniques can analyze media asset
`data or media asset metadata when creating the create media
`asset illustrations. The created media asset illustrations can,
`for example, be used while playing, browsing or displaying
`associated media assets.
`
`The invention can be implemented in numerous ways,
`including as a method, system, device, apparatus, graphical
`user
`interface, or computer
`readable medium. Several
`embodiments of the invention are discussed below.
`In one embodiment of the invention, a media asset illustra-
`tion is produced by determining if a media asset contains a
`media asset illustration, creating a media asset illustration for
`the media asset, and associating the created media asset illus-
`tration with the selected media asset. The media asset illus-
`
`trations can be laid out according to predetermined genre or
`artist classifications and can include text, graphics, album
`cover art or other images associated with a media asset, such
`as promotional photographs or logos. These illustrations may
`be contained within individual media assets (e.g., a graphic
`file contained in the headers of a music file) or may be sepa-
`rate from the associated media assets.
`
`In another embodiment of the invention, the production of
`a media asset illustration can further involve analyzing the
`media asset metadata contained in the media asset (e.g., ID3
`tags). Still another embodiment involves creating a media
`asset illustration based on the analysis ofthe media asset data.
`In yet another embodiment of the invention, production of a
`media asset illustration is deterministic, creating predictable
`illustrations according to set design criteria.
`Other aspects and advantages of the invention will become
`apparent from the following detailed description taken in
`conjunction with the accompanying drawings which illus-
`trate, by way of example, the principles of the invention.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The invention will be readily understood by the following
`detailed description in conjunction with the accompanying
`drawings, wherein like reference numerals designate like
`structural elements, and in which:
`FIG. 1 is a flow diagram of a substitute media asset illus-
`tration creation process according to one embodiment of the
`invention.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`FIG. 2 is a diagram of a media asset according to one
`embodiment of the invention.
`
`FIG. 3 is a flow diagram of a media asset illustration cre-
`ation process according to one embodiment of the invention.
`FIG. 4 is a flow diagram of a media genre-based media
`asset illustration creation process according to one embodi-
`ment of the invention.
`
`65
`
`FIG. 5 illustrates an example of a media asset illustration
`generator according to one embodiment of the invention.
`
`Page 00012
`
`Page 00012
`
`
`
`US 8,032,565 B2
`
`3
`FIG. 6A illustrates an example of a media asset organiza-
`tional scheme based on media asset illustrations according to
`one embodiment of the invention.
`
`FIG. 6B illustrates an example ofadding a substitute media
`asset illustration to a media asset.
`
`5
`
`FIG. 7 illustrates an example of a substitute media asset
`illustration according to one embodiment of the invention.
`FIG. 8 is a screenshot of an iTunes® window showing a
`user interface for browsing media assets using media asset
`illustrations.
`
`FIG. 9 shows an exemplary computer system suitable for
`use with the invention.
`
`FIG. 10 is a diagram of a portable electronic device accord-
`ing to one embodiment of the invention.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`10
`
`15
`
`The invention pertains to techniques for creating media
`asset illustrations for media assets. These created media asset
`illustrations are useful for media assets that lack associated
`
`20
`
`media asset illustrations. For example, the created media
`asset illustrations can serve as substitute media asset illustra-
`
`tions that are used in place of a missing or unavailable media
`asset illustrations. These techniques can analyze media asset
`data or media asset metadata when creating the create media
`asset illustrations. The created media asset illustrations can,
`for example, be used while playing, browsing or displaying
`associated media assets.
`
`Generally, a media asset illustration is a computer graphic
`that is associated with a particular media asset or group of
`media assets. For example, many music files (e.g., MP3 or
`AAC files) have album cover art embedded in the headers of
`the music file. Also, motion picture, television, and music
`video files can have promotional stills or movie poster art
`embedded within the files. In some embodiments of the
`invention, the aforementioned media asset illustrations are
`contained within individual media assets. In these embodi-
`ments, media asset illustrations can be stored in the file head-
`ers of a particular media asset.
`According to one embodiment of the invention, if a media
`asset does not include an associated media asset illustration,
`a media asset illustration can be generated. FIG. 1 is a flow
`diagram of a substitute media asset illustration creation pro-
`cess 100 according to one embodiment of the invention. The
`media asset creation process 100 can be used with media
`management application, such as iTunes® media manage-
`ment program fromApple Computer, Inc., in order to provide
`media asset illustrations for media files that do not already
`have an associated media asset illustration.
`
`The substitute media asset illustration creation process 100
`begins with selecting 102 a media asset from a collection of
`media assets. This collection can be, for example, a collection
`of media assets (e.g., music files). Next, a decision 104 deter-
`mines if the selected media asset has an associated media
`
`asset illustration. For example, in the case ofa music file (e.g.,
`an MP3 or AAC file), the media asset illustration may be
`embedded in the headers of the music file. The media asset
`
`illustration may be a JPEG or other digital graphical format,
`typically a digital image of an album cover, a movie or TV
`show promotional poster, a video game package, or a DVD
`jacket. When the media asset is a music file, the media asset
`illustration can be an image of cover art (e.g., image of CD
`jewel case artwork or LP record jacket sleeve). Ifthe decision
`104 determines that the media asset does not have an associ-
`ated media asset illustration, then the substitute media asset
`illustration process 100 creates 108 a media asset illustration
`and associates 110 the created media asset illustration with
`
`4
`
`that media asset. The association 110 may involve embedding
`the media asset illustration into the media asset (e.g., in the
`ID3 tags of an MP3) or, alternately, can include creating a
`software pointer linking the media asset to the created media
`asset illustration.
`
`Next, a decision 114 determines if there are any more
`media assets to be examined. If so, the substitute media asset
`illustration creation process 100 continues to block 112 and
`subsequent blocks. If not, the substitute media asset illustra-
`tion creation process 100 ends.
`Ifthe decision 104 determines that the selected media asset
`
`already has a media asset illustration, then the substitute
`media asset illustration creation process 100 continues by
`selecting 112 the next media as set in the collection and retum-
`ing to repeat block 104 and subsequent blocks.
`FIG. 2 is a diagram of a media asset 200 according to one
`embodiment of the invention. Media Asset 200 can be any
`digital media asset, including but not limited to, an audio file
`such as an MP3 file or anAAC file, a video file such as anAVI
`or Quicktime® file, a text file, a picture file such as a JPEG or
`GIF file, or an electronic book.
`The media asset 200 shown contains one or more data
`
`25
`
`segments, including a data segment containing metadata 204,
`which includes information about
`the media asset. For
`
`example, a MP3 file has ID3 tags containing information
`about the file including title, artist, and composition (e.g.,
`song) title. The media asset 200 also contains a data segment
`containing media content 202. The media content 202 is the
`actual media file data, containing media in a format that can
`be read by a media player such as a portable media player
`(e.g., an iPod®) or a media management application (e.g.,
`iTunes®). Examples of media data formats are MP3, AAC,
`MP3, Quicktime®, as well as others.
`Further, the media asset 200 has a data segment containing
`a media asset illustration 206. Note that the media asset
`
`illustration 206 can also be a separate file. The media asset
`illustration 206 is an electronic graphic file such as a JPEG or
`GIF file. Further, the media asset illustration 206 can be a
`visual or marketing representation of the media asset 200,
`such as a digital image of an album cover, a promotional
`poster, or DVD jacket. When the media asset 200 is a music
`file (e.g., an MP3 orAAC file), the media asset illustration 206
`can be an image of CD jewel case artwork or LP recordjacket
`sleeve.
`
`FIG. 3 is a flow diagram of a media asset illustration cre-
`ation process 300 according to one embodiment ofthe inven-
`tion. The media asset creation process 300 can, for example,
`occur during the creation 108 of a media asset in the substitute
`media asset creation process 100 in reference to FIG. 1 above.
`The media asset illustration creation process 300 operates on
`a group of one or more media assets, for instance a collection
`of music files stored on a personal computer.
`The media asset creation process 300 begins by analyzing
`302 the metadata of a media asset. The media asset can, for
`example, be a media asset 200 as described above in reference
`to FIG. 2. The analysis 302 can be of metadata embedded in
`a media asset (e.g. ID3 tags).
`The media asset creation process 300 continues with an
`analysis 304 of the media asset data (i.e., the media content
`contained in a file, such as a MP3, AAC, or Quicktime® file)
`within a media asset. According to this embodiment, the
`media asset analysis 304 identifies the media asset by analyz-
`ing the media asset’s media asset data (e.g., the media con-
`tent) and performing media asset identification. For example,
`the media asset analysis 304 may compare the media asset
`data to other previously identified media assets and identify it
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Page 00013
`
`Page 00013
`
`
`
`US 8,032,565 B2
`
`5
`by audio or visual comparisons or signatures. In this way, a
`media asset (even one having no metadata) can be analyzed
`and identified.
`
`6
`a set of predetermined layout rules. In an alternative embodi-
`ment, the creation 408 of a proposed media asset illustration
`can be random.
`
`Altemately, according to one embodiment ofthe invention,
`the analysis 302 of the media asset metadata provides sulfi-
`cient information for identification of the media asset and the
`
`5
`
`analysis 304 of the media asset data need not be performed.
`The proposed media asset creation process 300 continues
`with the creation 306 of a proposed media asset illustration.
`Next a decision 308 determines if the proposed media asset
`illustration is sufficiently unique in appearance. A wide vari-
`ety of uniqueness criteria may be imposed. According to one
`embodiment of the invention, two media asset illustrations
`are unique (to each other) if a typical viewer can tell the two
`illustrations are different at a glance. If the decision 308
`determines that the proposed media asset illustration is not
`unique according to the chosen criteria, then the media asset
`is altered 310 in order to make it sufficiently unique and the
`proposed media asset creation process 300 can return to per-
`form the decision 308 and subsequent blocks.
`If, on the other hand, the proposed media asset creation
`process 300 determines that the proposed media asset illus-
`tration process 300 is sufiiciently unique, then the media asset
`creation process 300 ends.
`FIG. 4 is a flow diagram of a media genre-based media
`asset
`illustration creation process 400 according to one
`embodiment of the invention. The media genre-based media
`asset illustration creation process 400 can correspond, for
`example, to the creation 108 of a media asset as discussed
`above in relation to FIG. 1. According to one embodiment of
`the invention, the media asset illustration produced by the
`media asset illustration creation process 400 gives a viewer of
`the media asset illustration visual cues as to the media genre,
`media artist, media title, and track title of the media asset.
`According to this embodiment, a media asset illustration will
`have a specific, predetermined layout or look depending on a
`set of design rules. For instance, all media asset illustrations
`associated with jazz recordings may have one layout, while
`all media asset illustrations associated with metal recordings
`may have another layout. Other design rules may depend on
`other factors, such as the tempo of a music track (e.g., Beats
`Per Minute (BPM)), or the artist/composer of a music track.
`Layout rules can include font styles and font sizes, color
`palettes, patterns, geometric shapes, among other common
`layout design features. Of course, other layout rules or
`schemes are possible. The design rules can be created such
`that media asset illustrations produced will be identical or
`similar to those generated using another media collection
`(e.g., another user’s music collection).
`According to one embodiment of the invention, the media
`genre-based media asset illustration creation process 400
`uses information and/or data about a particular media asset in
`order to create a media asset illustration. Accordingly, the
`media genre-based media asset illustration creation process
`400 determines 402 the media asset’s genre. In the case of a
`music track, genre can include any music genre, from the
`general (e.g., jazz, classical, rock) to the specific (e.g., gothic
`industrial dance). The determining 402 of the media asset’s
`genre can involve analyzing the metadata of a particular
`media asset. Next, the media genre-based media asset illus-
`tration creation process 400 determines 404 one or more of
`the artists, composers, directors, producers and/or stars of a
`particular media item. Next, the media genre-based media
`asset illustration creation process 400 determines 406 the title
`of the media asset. For example, in the case of a music track,
`the title can be the album title and/or the song title. Next, a
`proposed media asset illustration is created 408 according to
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Once a proposed media asset illustration has been created
`408, a decision 410 determines if the proposed media asset
`illustration is sufiiciently unique.
`In one embodiment,
`uniqueness is desirable since a viewer may want to be able to
`tell which media item he is looking at glance. In one embodi-
`ment, for a proposed media asset illustration to be sufficiently
`unique, it should be apparent to a typical viewer’ s eye that two
`illustrations are different. Uniqueness criteria are formulated
`according to design decisions and may vary according to
`various embodiments of the invention. Uniqueness can, for
`example, be determined by comparing the proposed media
`asset illustration to some subset of a collection of media asset
`
`illustrations, for example, the media asset illustrations con-
`tained in a music collection. Varying degrees of uniqueness
`are possible. For instance, according to one embodiment of
`the invention, all songs on a music album can have the same
`illustration, while different albums by the same artist can have
`different illustrations.
`
`If decision 410 determines that a proposed media asset
`illustration is not sufficiently unique, then the proposed media
`asset is altered 412 according to a predetermined set of layout
`rules. Once the proposed media asset illustration has been
`altered, the media asset illustration returns to decision 410
`and subsequent blocks. On the other hand, if decision 410
`determines that the proposed media asset
`is sufficiently
`unique, then the media genre-based media asset illustration
`creation process 400 ends.
`In another embodiment, the media genre-based asset illus-
`tration creation process 400 can use other bases besides genre
`in creating media asset illustrations. The other bases can
`include artist-based and/or title-based media asset illustration
`creation.
`
`According to one embodiment of the invention, the media
`genre-based media asset illustration process 400 can be deter-
`ministic, that is, for two identical sets of media assets ana-
`lyzed in the same order on different computers, a generated
`media asset will be identical on both computers. Thus, color
`schemes, fonts, patterns, and other features ofa created media
`asset illustration will be predictable based on the analysis of
`the media asset. In embodiments where uniqueness criteria
`have been set, small predictable variations within created
`media asset illustrations may occur.
`According to one embodiment ofthe invention (not shown)
`substitute media asset illustrations, for example, substitute
`media asset illustrations created as described in reference to
`
`FIG. 1, can be stored as text files in a markup language such
`as XML or converted to digital image files (e.g., JPEG or GIF
`files.) Image files can then be downloaded for display on a
`portable media player such as an iPod® media player avail-
`able from Apple Computer, Inc.
`FIG. 5 illustrates an example of a media asset illustration
`generator 500 according to one embodiment of the invention.
`The media asset illustration generator 500 can be used to
`generate media assets as described in reference to FIGS. 1, 3,
`and 4. Media asset illustration generator 500 can be imple-
`mented in hardware or software as needed.
`
`The media asset illustration generator 500 includes a media
`asset analyzer 502, which analyzes a media asset 504 in order
`to determine how to generate a media asset illustration that
`will represent the media asset.
`In order to analyze the media asset 504, the media asset
`analyzer 502 analyzes the media asset 504, including the
`media asset’s 504 metadata 506 (e.g., ID3 tags in an MP3
`file), and/or the media asset’s 504 media asset data 508 (e.g.
`
`Page 00014
`
`Page 00014
`
`
`
`US 8,032,565 B2
`
`7
`media content). The media as set analyzer 502 determines one
`or more ofthe media asset’s 504 genre, title, artist title, genre,
`or other identifying information (e.g., publisher, director,
`writer). According to one embodiment of the invention,
`where the media asset 504 is a music file, the media asset
`analyzer 502, determines the media asset’s 504 genre, title,
`and artist by examining the media asset metadata 506.
`According to another embodiment ofthe invention, the media
`asset analyzer 502 identifies the media asset by analyzing the
`media asset’s 504 media asset data 508 (i.e., the media con-
`tent contained in a media file, and performing media asset
`identification. For example, the media as set analyzer 502 may
`compare the media asset data 508 to other previously identi-
`fied media assets and identify it by audio or visual compari-
`sons or signatures. In this way, a media asset 504 that has no
`metadata 506 can be analyzed and identified.
`Once the media asset 504 has been analyzed by the media
`asset analyzer 506, an media asset illustration creator 510
`creates a media asset illustration 512, taking into account
`other existing media asset illustrations 514. In this way, the
`media asset illustration creator 510 ensures that the created
`
`media asset illustration 512 is not an exact duplicate of a
`previously existing media asset. As noted above in reference
`to FIG. 4, for the media asset illustration 512 to be sufficiently
`unique, it should be apparent to a typical viewer’ s eye that two
`illustrations are different. Uniqueness criteria are formulated
`according to design decisions and may vary according to
`various embodiments of the invention. Uniqueness is deter-
`mined by comparing the media asset 512 illustration to exist-
`ing media asset illustrations 514, for example, the media asset
`illustrations contained in a music collection. Varying degrees
`of uniqueness are possible. For instance, according to one
`embodiment of the invention, all songs on a music album can
`have the same illustration, while different albums by the same
`artist can have different illustrations.
`In one embodiment of the invention, the created media
`asset illustration is the result of a deterministic process, such
`as described above in reference to FIG. 4.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`FIG. 6A illustrates an example of a media asset organiza-
`tional scheme 600 based on media asset illustrations accord-
`
`40
`
`ing to one embodiment ofthe invention. Thus, the media asset
`illustration stack 604 can be browsed by a user. When a user
`of a media asset management program, for example iTunes®,
`wishes to browse through a collection ofmedia assets, he may
`choose to do so by browsing through media asset illustrations.
`This media asset illustration browsing process is analogous to
`flipping through a stack of LP records or CDs in a record
`store.
`
`45
`
`In FIG. 6A, states (a)-(d), a collection of media asset illus-
`trations 602 are shown in a media asset illustration stack 604.
`
`50
`
`In this example, seven media asset illustrations 602 are shown
`in the media asset illustration stack 604, each with a unique
`design. For illustration purposes, four media asset illustra-
`tions 602'-602"" are shown. However, any number of media
`asset illustrations can be included in the media asset illustra-
`tion stack 604. The media asset illustration stack 604 can
`
`represent, for example, a set of album cover illustrations
`associated with a collection of music files as described above
`
`in reference to FIG. 2. This is illustrated by showing four
`different media asset illustrations 602 in states (a)-(d). In state
`(a) a media asset illustration 602' is fully visible. Thus the user
`can see the complete media asset illustration 602', while the
`other media asset illustrations 602 are partially visible. Next,
`in state (b), as the user moves to the next media asset illus-
`tration 602" in the media asset stack 604, the previously
`viewed media asset illustration 602' shifts to the left and
`
`becomes partially visible. In states (c) and (d), the media
`
`55
`
`60
`
`65
`
`8
`assets illustrations 602 are shifted left twice more, this time
`bringing media asset illustrations 602"' and 602"" to the front,
`respectively. Of course, the user may move back and forth in
`the stack as desired, in either direction, sequentially or by
`skipping over one or more media asset illustrations 602.
`The media asset illustration stack 604 can be used, for
`example,
`in a media management application such as
`iTunes® to provide a user with visual cues in order to identify
`a particular