(12) Unlted States Patent
`(10) Patent No.:
`US 7,685,163 B2
`
`Chaudhri
`(45) Date of Patent:
`Mar. 23, 2010
`
`US007685163B2
`
`(54) AUTOMATED CREATION OF MEDIA ASSET
`ILLUSTRATIONS
`
`(75)
`
`Inventor:
`
`Imran Chaudhri, San Francisco, CA
`(Us)
`
`.
`.
`.
`(73) ASSlgnee‘ Apple Inc'scupemHO’CAwS)
`.
`.
`.
`.
`.
`(*) Nome:
`31113130110 any dISCIalmerztheterm 0mm
`Patent IS extended or adJuSted under 35
`U.S.C. 154(b) by 438 days.
`
`(21) Appl.No.: 11/650,857
`
`(22)
`
`Filed:
`
`Jan. 72 2007
`
`(65)
`
`Prior Publication Data
`
`US 2008/0178068 A1
`
`Jul. 24, 2008
`
`(51)
`
`Int. Cl.
`(2006.01)
`G06F 17/30
`(52) U.S.Cl.
`...................... 707/104.1;707/10;715/253;
`_
`_ 715/526; 715/274; 715/275; 715/277
`(58) Fleld 0f Class1ficat10n Search ~~~~~~~~~~~~~~ 707/104'15
`707/19§ 715/253: 526s 274: 275: 277; 725/132
`See appllcatlon file for complete search hlstory.
`References Cited
`
`(56)
`
`US. PATENT DOCUMENTS
`6,748,382 B1 *
`6/2004 Mohan et al.
`................. 707/10
`7,213,036 B2 *
`5/2007 Apparao et al.
`.......... 707/104.1
`
`7,305,436 B2 * 12/2007 Willis ......................... 709/204
`...... 709/219
`7,346,668 132*
`3/2008 Willis ..
`
`
`...... 715/747
`7,370,276 132*
`5/2008 Willis ..
`
`.................... 715/253
`l/2009 Dowdy
`7,478,323 B2 *
`2005/0278377 A1* 12/2005 errashldl et a1.
`....... 707/1041
`1/2006 Mirrashidi et a1.
`2006/0015378 A1*
`............. 705/7
`2006/0089949 A1
`4/2006 Robbin etal.
`2006/0123052 A1*
`6/2006 Robbin etal.
`............ 707/104.1
`2006/0155914 A1*
`7/2006 Jobs etal.
`...... 711/100
`
`2006/0206811 A1*
`9/2006 Dowdy ..............
`715/526
`2006/0247980 A1* 11/2006 Mirrashidi et a1.
`............ 705/26
`2007/0192818 A1*
`8/2007 Bourges-Sevenier et a1.
`..... 725/132
`
`OTHER PUBLICATIONS
`
`U.S.App1. No. 11/519,460, entitled“Media Manager with Integrated
`Browsers”, filed Sep. 11, 2006.
`
`* cited by examiner
`
`Primary Examinerilean M Corrielus
`
`(57)
`
`ABSTRACT
`
`The invention pertains to techniques for creating media asset
`illustrations for media assets are disclosed. The created media
`asset illustrations are useful for media assets that lack asso-
`ciated media asset illustrations. The techniques can analyze
`media asset data or media asset metadata when creating the
`create media asset illustrations. The created media asset illus-
`trations can, for example, be used while playing, browsing or
`displaying associated media assets.
`
`16 Claims, 10 Drawing Sheets
`
`100
`
`k
`
`( Start
`
`)
`
`102
`
`
`
`
`
`
`
`112
`'
`104
`
`Asset Missing
`
`Illustration
`
`
`
`Create Media
`Asset
`
`Illustration l 108
`
`1Associate
`Media Asset N 110
`Illustration with
`Media Asset
`
`114
`
`MediaaAssets Yes
`
`
`
`Apple Exhibit 4438
`
`Apple V. SightSound Technologies
`CBM2013-00023
`
`Page 00001
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`U.S. Patent
`
`Mar. 23, 2010
`
`Sheet 1 of 10
`
`US 7,685,163 B2
`
`100
`
`\
`
`
`
`Select Media
`
`Asset
`
`Media
`
`
`
`
`Select Next
`
`Asset Missing
`Media Asset
`Illustration
`
`
`
`?
`
`112
`
`Create Media
`
`Asset
`
`Illustration
`
`
`
`
`
`
`Associate
`Media Asset
`
`Illustration with
`
`Media Asset
`
`
`
`More
`
`
`
`Media Assets
`
`
`
`? F
`
`IG. 1
`
`Apple Exhibit 4438
`
`Apple V. SightSound Technologies
`Cm099960023
`
`Page 00001
`
`Page 00002
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`US. Patent
`
`Mar. 23, 2010
`
`Sheet 2 of 10
`
`US 7,685,163 B2
`
`200
`
`
`
`206
`
` Media Data
`
`
`
`202
`
`
`
`Meta Data‘
`
`
`Media Asset
`
`204
`
`FIG. 2
`
`Apple Exhibit 4438
`
`Apple V. SightSound Technologies
`CWMQthozs
`
`Page 00001
`
`Page 00003
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`U.S. Patent
`
`Mar. 23, 2010
`
`Sheet 3 0f 10
`
`US 7,685,163 B2
`
`300
`
`I”)
`
` Analyze Media
`
` 302
` Analyze Media
` Create
`
`Asset Meta
`
`Data
`
`
`Asset Data
`
`
`
`
`
`304
`
`Proposed
`Media Asset
`
`
`
`
`
`Illustration
`
` 306
`
`
`
`
`
`
`
`Proposed
`
`
`Media Asset
`
`Illustration is
`
`illustration
`
`
`Unique
`
`7
`
`
`
`
`
`Alter Proposed
`Media Asset
`
`310
`
`
`
`FIG. 3
`
`Apple Exhibit 4438
`
`Apple V. SightSound Technologies
`Claimflflilfoozs
`
`Page 00001
`
`Page 00004
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`US. Patent
`
`Mar. 23, 2010
`
`Sheet 4 of 10
`
`US 7,685,163 B2
`
`400
`
`r}
`
`
`
` Determine Genre
`
`402
`
`404
`
`Determine Artist
`
` l
`
`
`
`
`
`
`Determine Title
`
`
`
`
`
`406
`
`Create Tentative
`Media Asset
`Illustration
`
`
`408
`
`
`
`
`
`ropose o
`
`Media Asset
`A'ter Pmposed
`
`
`
`.
`.
`Media Asset
`
`
`
`.
`Illustration is
`
`.
`Illustration
`
`Unmue
`
`
`
`
`412
`
`F i G. 4
`
`Apple Exhibit 4438
`
`Apple V. SightSound Technologies
`CWMQQfiiozs
`
`Page 00001
`
`Page 00005
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`US. Patent
`
`Mar. 23, 2010
`
`Sheet 5 of 10
`
`US 7,685,163 B2
`
`500
`
`\
`
`506
`
`Media Asset
`
`Metadata
`
`Media Asset
`
`Data
`
`
`
`Media Asset Analyzer
`
`514
`
`512
`
`Existin
`9
`Media Asset
`Illustrations
`
`
`
`Media Asset Illustration
`Creator
`
`Media Asset
`Illustration
`
`FIG. 5
`
`Apple Exhibit 4438
`
`Apple V. SightSound Technologies
`Claimflflilfiiozs
`
`Page 00001
`
`Page 00006
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`US. Patent
`
`Mar. 23, 2010
`
`Sheet 6 0f 10
`
`US 7,685,163 B2
`
`600
`\.
`
`602
`
`602'
`’
`
`V 602'" 602"”
`
`604
`
`
`
`(a)
`
`Q} ,602 602' 602.” 602.,”
`/
`6
`
`604
`
`
`
`602
`,
`( K
`
`602'
`
`,
`
`602
`
`Q (b)
`
`604
`
`(c)
`
`602
`
`602'
`
`602"” g
`
`
`602””
`
`
`
`1(e)
`
`FIG. 6A
`
`Apple Exhibit 4438
`
`Apple V. SightSound Technologies
`CW8991170023
`
`Page 00001
`
`Page 00007
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`US. Patent
`
`Mar. 23, 2010
`
`Sheet 7 of 10
`
`US 7,685,163 B2
`
`650
`
`\
`
`654
`
`660
`
`0
`
`<::>
`
`Media Data
`
`(b)
`
`
`
`Media Asset
`
`
`
`
`
`Media Data
`
`(d) '
`
`
`
`Meta Data
`
`Media Asset
`
`
`
`(8)
`
`FIG. 68
`
`Apple Exhibit 4438
`
`Apple V. SightSound Technologies
`Claimflflilfiiozs
`
`Page 00001
`
`Page 00008
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`US. Patent
`
`Mar. 23, 2010
`
`Sheet 8 of 10
`
`US 7,685,163 B2
`
`700
`
`\
`
`702
`
`704 '
`
`Artist_Name
`
`Album_TitIe
`
`FIG. 7
`
`Apple Exhibit 4438
`
`Apple V. SightSound Technologies
`Cm099%023
`
`Page 00001
`
`Page 00009
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`U.S. Patent
`
`Mar. 23, 2010
`
`Sheet 9 of 10
`
`US 7,685,163 B2
`
`NCw5.9%
`“aimE.m
`
`385.5...3$381am...
`
`23.9.».
`
`
`
`
`
`28”EB.“3E.w.....,955334
`
`
`
`22539302_A35:95.:.m—
`
`wEm$5....Wm
`
`
`
`“35th...rm—
`
`
`
`
`
`.533.32.Ea}.8333“En...ER...3n.8am363..mE3;88.2ww233......ag,E;,.Sum..a._____...ma23.5:9.0.3SEE,Sn9.;«88.13.3.1593..stnP....3a.”“J...3%.QavowBa"226$2%.
`
`
`
`
`
`
`
`
`
`.2...0583:;.2.938.8....3229.Eor.“83:;29..53.3.3.3:c.28a_.mm....H.536newfibres»....o3_2.36m..“at.8589..E0383:...W2.28am.35V
`
`
`
`
`
`.r:3;.@8933.“:9.m99.2..n0.Za,,__Hmum,..53“as$9.355.Ea...£8.25N9:82:nag:A3.3...33.._A
`
`.8“9p2.2....a“galvi0%,.»3%.mme....85628£35222.E9....8333Oz51:....28E;m_....,1_.
`
`
`
`
`
`
`v.,39%a3.25:e.we..85...E3;23:3..082"£23aFa8a_.223“asM553.32E3...0835flu:932356e...3.:aWx.»x!a...I.»Rx
`om;ganbuomam2...2.n...‘Bo:__n_,_.._§_..wz
`
`
`
`
`xowdéficiin01395:?,...>._a.._m_.ov3.25of.325“a_yEmQ,_z_co_<.au_5.2.3.3B1nfiRun.1...0h#3,m."o_2.550“:8323.3
`
`
`
`
`
`
`
`
`
`.gamma:,.,,\was_1w.”Eons—m£8E2.:0:3..250Eu?ufiflotfinBEEficzmm:2.fl.wfin.UHWEEQ..a.\_Izmu..hr..o5.UHMHHUHm.“035£32mm
`
`utObuflDSO
`
`“b
`
`
`
`Apple Exhi it 4438
`Apple V. SightSound Technologies
`CWMQ
`16])
`023
`
`Page 00001
`
`Page 00010
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`
`
`
`
`

`

`US. Patent
`
`Mar. 23, 2010
`
`Sheet 10 of 10
`
`US 7,685,163 B2
`
`/ 900
`
`940
`
`93
`
`o
`
`9
`
`28
`
`938
`
`A
`
`fis
`
`932
`
`-‘
`
`934
`
`F I G. 9
`
`_
`
`1 002
`
`1 000
`
`FIG. 1 0
`
`Apple Exhibit 4438
`Apple V. SightSound Technologies
`CW899100023
`
`Page 00001
`
`Page 00011
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`US 7,685,163 B2
`
`1
`AUTOMATED CREATION OF MEDIA ASSET
`ILLUSTRATIONS
`
`COPYRIGHT NOTICE
`
`2
`Thus, there is a need to obtain media asset illustrations for
`those media assets that do not have associated media asset
`illustrations.
`
`SUMMARY OF THE INVENTION
`
`A portion of the disclosure of this patent document con-
`tains material which is subject to copyright protection. The
`copyright owner has no objection to the facsimile reproduc-
`tion by anyone ofthe patent document or the patent disclosure
`as it appears in the US. Patent and Trademark Office patent
`file or records, but otherwise reserves all copyright rights
`whatsoever.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`In general, the invention relates to media management
`applications, and, more particularly, to using a media man-
`agement application to create media asset illustrations for
`media assets.
`
`2. Description of the Related Art
`Traditionally, music has been purchased at music stores or
`music departments of larger stores. A consumer will visit the
`music store or department and manually browse for albums or
`compact discs (CDs) ofinterest. After the consumer selects an
`album or CD of interest, the consumer proceeds to a checkout
`register to pay for the album or CD being purchased.
`In recent years music delivery or distribution over the Inter-
`net has become popular. Due to the advances in efficient file
`formats, such as MP3 and MPEG4, the size of media files has
`become small enough to make their download via the Internet
`practical. Also, technological advances have led to higher-
`speed Internet connections and lower cost of memory. The
`combination of these advances make downloading media
`files, such as for music and videos, manageable and not too
`time consuming.
`One popular approach to online music distribution is Apple
`Computer’s iTunes® online music store. Consumers may use
`the iTunes® online music store to purchase music either as
`individual music tracks or in albums of songs.
`Often, when a consumer purchases a media asset such as a
`music track, the media asset includes a media asset illustra-
`tion (e.g., a computer graphic representing an album cover).
`Traditionally, album cover art has been used by music listen-
`ers to identify music albums by sight. The media asset illus-
`tration can be displayed while the media asset is playing, for
`instance, on the display screen of a music player. For
`example, the iPod®, produced by Apple Computer of Cuper-
`tino, Calif., allows a user to display a media asset illustration
`(e. g., album cover art) associated with a particular audio track
`while the track is playing.
`Unfortunately, not all media assets have associated media
`asset illustrations. The reason for a missing media asset illus-
`tration can vary, but can include unavailability, file corrup-
`tion, or accidental deletion. Alternately, a media illustration
`can be missing if the media asset is taken from a user’s
`personal music collection (e.g., ‘ripped’ from a Compact Disk
`(CD).) Also, although it is sometimes possible to download
`media asset illustrations online, if a user does not have a
`network connection available, media asset illustrations will
`not be available.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`The invention pertains to techniques for creating media
`asset illustrations for media assets. These created media asset
`illustrations are useful for media assets that lack associated
`
`media asset illustrations. For example, the created media
`asset illustrations can serve as substitute media asset illustra-
`
`tions that are used in place of a missing or unavailable media
`asset illustrations. These techniques can analyze media asset
`data or media asset metadata when creating the create media
`asset illustrations. The created media asset illustrations can,
`for example, be used while playing, browsing or displaying
`associated media assets.
`
`The invention can be implemented in numerous ways,
`including as a method, system, device, apparatus, graphical
`user
`interface, or computer
`readable medium. Several
`embodiments of the invention are discussed below.
`In one embodiment of the invention, a media asset illustra-
`tion is produced by determining if a media asset contains a
`media asset illustration, creating a media asset illustration for
`the media asset, and associating the created media asset illus-
`tration with the selected media asset. The media asset illus-
`
`trations can be laid out according to predetermined genre or
`artist classifications and can include text, graphics, album
`cover art or other images associated with a media asset, such
`as promotional photographs or logos. These illustrations may
`be contained within individual media assets (e.g., a graphic
`file contained in the headers of a music file) or may be sepa-
`rate from the associated media assets.
`
`In another embodiment of the invention, the production of
`a media asset illustration can further involve analyzing the
`media asset metadata contained in the media asset (e. g., ID3
`tags). Still another embodiment involves creating a media
`asset illustration based on the analysis ofthe media asset data.
`In yet another embodiment of the invention, production of a
`media asset illustration is deterministic, creating predictable
`illustrations according to set design criteria.
`Other aspects and advantages of the invention will become
`apparent from the following detailed description taken in
`conjunction with the accompanying drawings which illus-
`trate, by way of example, the principles of the invention.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The invention will be readily understood by the following
`detailed description in conjunction with the accompanying
`drawings, wherein like reference numerals designate like
`structural elements, and in which:
`FIG. 1 is a flow diagram of a substitute media asset illus-
`tration creation process according to one embodiment of the
`invention.
`
`FIG. 2 is a diagram of a media asset according to one
`embodiment of the invention.
`
`FIG. 3 is a flow diagram of a media asset illustration cre-
`ation process according to one embodiment of the invention.
`FIG. 4 is a flow diagram of a media genre-based media
`asset illustration creation process according to one embodi-
`ment of the invention.
`
`FIG. 5 illustrates an example of a media asset illustration
`generator according to one embodiment of the invention.
`FIG. 6A illustrates an example of a media asset organiza-
`tional scheme based on media asset illustraWoEljflgitbit 4438
`one embodiment of thginv tion.
`pp e v. SightSound Technologies
`CW899160023
`
`Page 00001
`
`Page 00012
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`US 7,685,163 B2
`
`3
`FIG. 6B illustrates an example ofadding a substitute media
`asset illustration to a media asset.
`
`FIG. 7 illustrates an example of a substitute media asset
`illustration according to one embodiment of the invention.
`FIG. 8 is a screenshot of an iTunes® window showing a
`user interface for browsing media assets using media asset
`illustrations.
`
`FIG. 9 shows an exemplary computer system suitable for
`use with the invention.
`
`FIG. 10 is a diagram of a portable electronic device accord-
`ing to one embodiment of the invention.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`The invention pertains to techniques for creating media
`asset illustrations for media assets. These created media asset
`illustrations are useful for media assets that lack associated
`
`media asset illustrations. For example, the created media
`asset illustrations can serve as substitute media asset illustra-
`
`tions that are used in place of a missing or unavailable media
`asset illustrations. These techniques can analyze media asset
`data or media asset metadata when creating the create media
`asset illustrations. The created media asset illustrations can,
`for example, be used while playing, browsing or displaying
`associated media assets.
`
`Generally, a media asset illustration is a computer graphic
`that is associated with a particular media asset or group of
`media assets. For example, many music files (e.g., MP3 or
`AAC files) have album cover art embedded in the headers of
`the music file. Also, motion picture, television, and music
`video files can have promotional stills or movie poster art
`embedded within the files. In some embodiments of the
`invention, the aforementioned media asset illustrations are
`contained within individual media assets. In these embodi-
`ments, media asset illustrations can be stored in the file head-
`ers of a particular media asset.
`According to one embodiment of the invention, if a media
`asset does not include an associated media asset illustration,
`a media asset illustration can be generated. FIG. 1 is a flow
`diagram of a substitute media asset illustration creation pro-
`cess 100 according to one embodiment of the invention. The
`media asset creation process 100 can be used with media
`management application, such as iTunes® media manage-
`ment program fromApple Computer, Inc., in order to provide
`media asset illustrations for media files that do not already
`have an associated media asset illustration.
`
`The substitute media asset illustration creation process 100
`begins with selecting 102 a media asset from a collection of
`media assets. This collection can be, for example, a collection
`of media assets (e.g., music files). Next, a decision 104 deter-
`mines if the selected media asset has an associated media
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`asset illustration. For example, in the case ofa music file (e.g.,
`an MP3 or AAC file), the media asset illustration may be
`embedded in the headers of the music file. The media asset
`
`55
`
`illustration may be a JPEG or other digital graphical format,
`typically a digital image of an album cover, a movie or TV
`show promotional poster, a video game package, or a DVD
`jacket. When the media asset is a music file, the media asset
`illustration can be an image of cover art (e.g., image of CD
`jewel case artwork or LP record jacket sleeve). Ifthe decision
`104 determines that the media asset does not have an associ-
`ated media asset illustration, then the substitute media asset
`illustration process 100 creates 108 a media asset illustration
`and associates 110 the created media asset illustration with
`
`60
`
`65
`
`that media asset. The association 110 may involve embedding
`the media asset illustration into the media asset (e.g., in the
`
`4
`
`ID3 tags of an MP3) or, alternately, can include creating a
`software pointer linking the media asset to the created media
`asset illustration.
`
`Next, a decision 114 determines if there are any more
`media assets to be examined. If so, the substitute media asset
`illustration creation process 100 continues to block 112 and
`subsequent blocks. If not, the substitute media asset illustra-
`tion creation process 100 ends.
`Ifthe decision 104 determines that the selected media asset
`
`already has a media asset illustration, then the substitute
`media asset illustration creation process 100 continues by
`selecting 112 the next media as set in the collection and retum-
`ing to repeat block 104 and subsequent blocks.
`FIG. 2 is a diagram of a media asset 200 according to one
`embodiment of the invention. Media Asset 200 can be any
`digital media asset, including but not limited to, an audio file
`such as an MP3 file or anAAC file, a video file such as anAVI
`or Quicktime® file, a text file, a picture file such as a JPEG or
`GIF file, or an electronic book.
`The media asset 200 shown contains one or more data
`
`segments, including a data segment containing metadata 204,
`which includes information about
`the media asset. For
`
`example, a MP3 file has ID3 tags containing information
`about the file including title, artist, and composition (e.g.,
`song) title. The media asset 200 also contains a data segment
`containing media content 202. The media content 202 is the
`actual media file data, containing media in a format that can
`be read by a media player such as a portable media player
`(e.g., an iPod®) or a media management application (e.g.,
`iTunes®). Examples of media data formats are MP3, AAC,
`MP3, Quicktime®, as well as others.
`Further, the media asset 200 has a data segment containing
`a media asset illustration 206. Note that the media asset
`
`illustration 206 can also be a separate file. The media asset
`illustration 206 is an electronic graphic file such as a JPEG or
`GIF file. Further, the media asset illustration 206 can be a
`visual or marketing representation of the media asset 200,
`such as a digital image of an album cover, a promotional
`poster, or DVD jacket. When the media asset 200 is a music
`file (e. g., an MP3 orAAC file), the media asset illustration 206
`can be an image of CD jewel case artwork or LP recordjacket
`sleeve.
`
`FIG. 3 is a flow diagram of a media asset illustration cre-
`ation process 300 according to one embodiment ofthe inven-
`tion. The media asset creation process 300 can, for example,
`occur during the creation 108 of a media asset in the substitute
`media asset creation process 100 in reference to FIG. 1 above.
`The media asset illustration creation process 300 operates on
`a group of one or more media assets, for instance a collection
`of music files stored on a personal computer.
`The media asset creation process 300 begins by analyzing
`302 the metadata of a media asset. The media asset can, for
`example, be a media asset 200 as described above in reference
`to FIG. 2. The analysis 302 can be of metadata embedded in
`a media asset (e.g. ID3 tags).
`The media asset creation process 300 continues with an
`analysis 304 of the media asset data (i.e., the media content
`contained in a file, such as a MP3, AAC, or Quicktime® file)
`within a media asset. According to this embodiment, the
`media asset analysis 304 identifies the media asset by analyz-
`ing the media asset’s media asset data (e.g., the media con-
`tent) and performing media asset identification. For example,
`the media asset analysis 304 may compare the media asset
`data to other previously identified media assets and identify it
`by audio or visual comparisons or signatures. In this way, a
`media asset (even one having no metadataKptpllgmmit 4438
`and identified.
`.
`.
`Apple V. SlghtSOund Technologles
`Cm0991®023
`
`Page 00001
`
`Page 00013
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`US 7,685,163 B2
`
`5
`Altemately, according to one embodiment ofthe invention,
`the analysis 302 of the media asset metadata provides suffi-
`cient information for identification of the media asset and the
`
`analysis 304 of the media asset data need not be performed.
`The proposed media asset creation process 300 continues
`with the creation 306 of a proposed media asset illustration.
`Next a decision 308 determines if the proposed media asset
`illustration is sufficiently unique in appearance. A wide vari-
`ety of uniqueness criteria may be imposed. According to one
`embodiment of the invention, two media asset illustrations
`are unique (to each other) if a typical viewer can tell the two
`illustrations are different at a glance. If the decision 308
`determines that the proposed media asset illustration is not
`unique according to the chosen criteria, then the media asset
`is altered 310 in order to make it sufficiently unique and the
`proposed media asset creation process 300 can return to per-
`form the decision 308 and subsequent blocks.
`If, on the other hand, the proposed media asset creation
`process 300 determines that the proposed media asset illus-
`tration process 300 is sufficiently unique, then the media asset
`creation process 300 ends.
`FIG. 4 is a flow diagram of a media genre-based media
`asset
`illustration creation process 400 according to one
`embodiment of the invention. The media genre-based media
`asset illustration creation process 400 can correspond, for
`example, to the creation 108 of a media asset as discussed
`above in relation to FIG. 1. According to one embodiment of
`the invention, the media asset illustration produced by the
`media asset illustration creation process 400 gives a viewer of
`the media asset illustration visual cues as to the media genre,
`media artist, media title, and track title of the media asset.
`According to this embodiment, a media asset illustration will
`have a specific, predetermined layout or look depending on a
`set of design rules. For instance, all media asset illustrations
`associated with jazz recordings may have one layout, while
`all media asset illustrations associated with metal recordings
`may have another layout. Other design rules may depend on
`other factors, such as the tempo of a music track (e. g., Beats
`Per Minute (BPM)), or the artist/composer of a music track.
`Layout rules can include font styles and font sizes, color
`palettes, patterns, geometric shapes, among other common
`layout design features. Of course, other layout rules or
`schemes are possible. The design rules can be created such
`that media asset illustrations produced will be identical or
`similar to those generated using another media collection
`(e.g., another user’s music collection).
`According to one embodiment of the invention, the media
`genre-based media asset illustration creation process 400
`uses information and/or data about a particular media asset in
`order to create a media asset illustration. Accordingly, the
`media genre-based media asset illustration creation process
`400 determines 402 the media asset’s genre. In the case of a
`music track, genre can include any music genre, from the
`general (e.g., jazz, classical, rock) to the specific (e. g., gothic
`industrial dance). The determining 402 of the media asset’s
`genre can involve analyzing the metadata of a particular
`media asset. Next, the media genre-based media asset illus-
`tration creation process 400 determines 404 one or more of
`the artists, composers, directors, producers and/or stars of a
`particular media item. Next, the media genre-based media
`asset illustration creation process 400 determines 406 the title
`of the media asset. For example, in the case of a music track,
`the title can be the album title and/or the song title. Next, a
`proposed media asset illustration is created 408 according to
`a set of predetermined layout rules. In an alternative embodi-
`ment, the creation 408 of a proposed media asset illustration
`can be random.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`Once a proposed media asset illustration has been created
`408, a decision 410 determines if the proposed media asset
`illustration is sufficiently unique.
`In one embodiment,
`uniqueness is desirable since a viewer may want to be able to
`tell which media item he is looking at glance. In one embodi-
`ment, for a proposed media asset illustration to be sufficiently
`unique, it should be apparent to a typical viewer’ s eye that two
`illustrations are different. Uniqueness criteria are formulated
`according to design decisions and may vary according to
`various embodiments of the invention. Uniqueness can, for
`example, be determined by comparing the proposed media
`asset illustration to some subset of a collection of media asset
`
`illustrations, for example, the media asset illustrations con-
`tained in a music collection. Varying degrees of uniqueness
`are possible. For instance, according to one embodiment of
`the invention, all songs on a music album can have the same
`illustration, while different albums by the same artist can have
`different illustrations.
`
`If decision 410 determines that a proposed media asset
`illustration is not sufficiently unique, then the proposed media
`asset is altered 412 according to a predetermined set of layout
`rules. Once the proposed media asset illustration has been
`altered, the media asset illustration returns to decision 410
`and subsequent blocks. On the other hand, if decision 410
`determines that the proposed media asset
`is sufficiently
`unique, then the media genre-based media asset illustration
`creation process 400 ends.
`In another embodiment, the media genre-based asset illus-
`tration creation process 400 can use other bases besides genre
`in creating media asset illustrations. The other bases can
`include artist-based and/or title-based media asset illustration
`creation.
`
`According to one embodiment of the invention, the media
`genre-based media asset illustration process 400 can be deter-
`ministic, that is, for two identical sets of media assets ana-
`lyzed in the same order on different computers, a generated
`media asset will be identical on both computers. Thus, color
`schemes, fonts, patterns, and other features ofa created media
`asset illustration will be predictable based on the analysis of
`the media asset. In embodiments where uniqueness criteria
`have been set, small predictable variations within created
`media asset illustrations may occur.
`According to one embodiment ofthe invention (not shown)
`substitute media asset illustrations, for example, substitute
`media asset illustrations created as described in reference to
`
`FIG. 1, can be stored as text files in a markup language such
`as XML or converted to digital image files (e.g., JPEG or GIF
`files.) Image files can then be downloaded for display on a
`portable media player such as an iPod® media player avail-
`able from Apple Computer, Inc.
`FIG. 5 illustrates an example of a media asset illustration
`generator 500 according to one embodiment of the invention.
`The media asset illustration generator 500 can be used to
`generate media assets as described in reference to FIGS. 1, 3,
`and 4. Media asset illustration generator 500 can be imple-
`mented in hardware or software as needed.
`
`The media asset illustration generator 500 includes a media
`asset analyzer 502, which analyzes a media asset 504 in order
`to determine how to generate a media asset illustration that
`will represent the media asset.
`In order to analyze the media asset 504, the media asset
`analyzer 502 analyzes the media asset 504, including the
`media asset’s 504 metadata 506 (e.g., ID3 tags in an MP3
`file), and/or the media asset’s 504 media asset data 508 (e.g.
`media content). The media asset analyzer 502 determines one
`or more ofthe media asset’ s 504 genre, titleAifiEIélqufibit 4438
`or Other ldemlfymg K135131311§i§hi§biinfi Tficfiriologies
`Cm099160023
`
`Page 00001
`
`Page 00014
`
`Apple Exhibit 4438
`Apple v. SightSound Technologies
`CBM2013-00023
`Page 00001
`
`

`

`US 7,685,163 B2
`
`7
`writer). According to one embodiment of the invention,
`where the media asset 504 is a music file, the media asset
`analyzer 502, determines the media asset’s 504 genre, title,
`and artist by examining the media asset metadata 506.
`According to another embodiment ofthe invention, the media
`asset analyzer 502 identifies the media asset by analyzing the
`media asset’s 504 media asset data 508 (i.e., the media con-
`tent contained in a media file, and performing media asset
`identification. For example, the media as set analyzer 502 may
`compare the media asset data 508 to other previously identi-
`fied media assets and identify it by audio or visual compari-
`sons or signatures. In this way, a media asset 504 that has no
`metadata 506 can be analyzed and identified.
`Once the media asset 504 has been analyzed by the media
`asset analyzer 506, an media asset illustration creator 510
`creates a media asset illustration 512, taking into account
`other existing media asset illustrations 514. In this way, the
`media asset illustration creator 510 ensures that the created
`
`media asset illustration 512 is not an exact duplicate of a
`previously existing media asset. As noted above in reference
`to FIG. 4, for the media asset illustration 512 to be sufficiently
`unique, it should be apparent to a typical viewer’ s eye that two
`illustrations are different. Uniqueness criteria are formulated
`according to design decisions and may vary according to
`various embodiments of the invention. Uniqueness is deter-
`mined by comparing the media asset 512 illustration to exist-
`ing media asset illustrations 514, for example, the media asset
`illustrations contained in a music collection. Varying degrees
`of uniqueness are possible. For instance, according to one
`embodiment of the invention, all songs on a music album can
`have the same illustration, while different albums by the same
`artist can have different illustrations.
`In one embodiment of the invention, the created media
`asset illustration is the result of a deterministic process, such
`as described above in reference to FIG. 4.
`
`FIG. 6A illustrates an example of a media asset organiza-
`tional scheme 600 based on media asset illustrations accord-
`
`ing to one embodiment ofthe invention. Thus, the media asset
`illustration stack 604 can be browsed by a user. When a user
`of a media asset management program, for example iTunes®,
`wishes to browse through a collection ofmedia assets, he may
`choose to do so by browsing through media asset illustrations.
`This media asset illustration browsing process is analogous to
`flipping through a stack of LP records or CDs in a record
`store.
`
`In FIG. 6A, states (a)-(d), a collection of media asset illus-
`trations 602 are shown in a media asset illustration stack 604.
`
`In this example, seven media asset illustr