US007945653B2
`
`(12) United States Patent
`Zuckerberg et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,945,653 B2
`May 17, 2011
`
`(54) TAGGING DIGITAL MEDIA
`
`(75) Inventors: Mark Zuckerberg, Palo Alto, CA (US);
`Aaron Sittig, Palo Alto, CA (US); Scott
`Marlette, Palo Alto, CA (US)
`
`(73) Assignee: Facebook, Inc., Palo Alto, CA (US)
`(*) Notice:
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 962 days.
`
`(21) Appl. No.: 11/580,210
`(22) Filed:
`Oct. 11, 2006
`
`(65)
`
`Prior Publication Data
`US 2008/OO91723 A1
`Apr. 17, 2008
`
`(51) Int. Cl.
`G06F 5/73
`(2006.01)
`(52) U.S. Cl. ......... 709/223; 709/206; 709/217; 709/225
`(58) Field of Classification Search .................. 709f2O4
`709/206, 217, 223, 225, 219
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`6,542.936 B1 * 4/2003 Mayle et al. .................. TO9,203
`6,687,878 B1* 2/2004 Eintracht et al.
`T15,230
`7,068.309 B2 *
`6/2006 Toyama et al. .
`TO9,219
`7,249,123 B2
`7, 2007 Elder
`7,668.405 B2 *
`2/2010 Gallagher ..................... 382,305
`7,886,024 B2 *
`2/2011 Kelly et al.
`TO9,219
`2002/0103813 A1* 8/2002 Frigon ...
`TO7 104.1
`2005/0235062 A1* 10, 2005 Lunt et al.
`709/217
`2006/0048059 A1
`3f2006 Etkin ............................ 71.5/745
`2006/0218225 A1
`9, 2006 Hee Voon
`2006/025 1292 A1* 11/2006 Gokturk et al. ............... 382,103
`2006/0253491 A1* 11/2006 Gokturk et al. ............ TO7 104.1
`
`2006/0264209 A1* 11/2006 Atkinson et al. ........... 455,4221
`2007, OO16689 A1
`1/2007 Birch .........
`709/241
`2007/01 18525 A1
`5/2007 Svendsen .......................... 707/9
`2007. O159651 A1* 7, 2007 Disario et al.
`358,115
`2007/0162458 A1* 7, 2007 Fasciano ....
`TO7/10
`2007/0255785 A1* 11/2007 Hayashi et al.
`709,204
`2007/0266003 A1* 1 1/2007 Wong et al. ....................... 707/3
`2008, OO864.58 A1* 4, 2008 Robinson
`2008/0091723 A1* 4/2008 Zuckerberg et al. ....... TO7 104.1
`OTHER PUBLICATIONS
`Shneiderman, et al., “Direct Annotation: A Drag and Drop Strategy
`for labeling Photos”, Aug. 2000, International Conference on Infor
`mation Visualization.
`Brush et al., “Notification for shared Annotation of Digital Docu
`ments”, Apr. 2002, ACM, CHI vol. 4 Issue #1.*
`Marlow et al., “HT06, Tagging Paper, Taxonomy, Flickr, Academic
`Article. To Read’, Aug. 2006, ACM.*
`U.S. Appl. No. 11/701,566, filed Feb. 2, 2007, Jed Stremel, System
`and Method for Automatic Population of a Contact File with Contact
`Content and Expression Content.
`U.S. Appl. No. 1 1/893,797, filed Aug. 16, 2007, Yung-Fang Juan,
`System and Method for Invitation Targeting in a Web-Based Social
`Network.
`s NR S.C.R. E. FR See than
`ystem and Menod Ior Incorporating an Entity or Uroup oner unan
`a Natural Person into a Social Network.
`* cited by examiner
`Primary Examiner — Ramy M Osman
`(74) Attorney, Agent, or Firm – Fenwick & West LLP
`(57)
`ABSTRACT
`A method for tagging digital media is described. The method
`includes selecting a digital media and selecting region within
`the digital media. The method may further include associat
`ing a person or entity with the selected region and sending a
`notification of the association the person or entity or a differ
`ent person or entity. The method may further include sending
`advertising with the notification.
`34 Claims, 11 Drawing Sheets
`
`81 -N
`
`Select A Digital Media -v810
`
`Select A Region
`
`Associate AEmail
`Address
`
`Send Notification
`
`does Email
`Address Belong To
`Member?
`
`Receive Tag
`Walidity
`information
`
`855
`
`Ys
`
`883
`
`Send Invitation
`To Join
`-
`Send Link To
`Tagged Media
`
`
`
`Did Nor
`memberJoin?
`
`Facebook's Exhibit No. 1003
`Page 1
`
`

`

`U.S. Patent
`
`May 17, 2011
`
`Sheet 1 of 11
`
`US 7,945,653 B2
`
`| ||
`
`| ||
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Facebook's Exhibit No. 1003
`Page 2
`
`

`

`U.S. Patent
`
`May 17, 2011
`
`Sheet 2 of 11
`
`US 7,945,653 B2
`
`
`
`| Z
`
`OZ
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Facebook's Exhibit No. 1003
`Page 3
`
`

`

`U.S. Patent
`
`May 17, 2011
`
`Sheet 3 of 11
`
`US 7,945,653 B2
`
`
`
`quæuoduuOO 6e L
`
`| 9
`
`Facebook's Exhibit No. 1003
`Page 4
`
`

`

`U.S. Patent
`
`eMay 17
`
`2011
`
`Sheet 4 of 11
`
`US 7,945,653 B2
`
`
`
`
`
`ssuagydoysquig,spuassyAry
`
`SIU}ulseoddeinssouYomeU
`
`ayy‘Buys07SwayGoysyug
`
`998949SPUalyyMOAUIA,
`
`soc
`
`‘eamds
`
`de‘Sls
`
`aease
`
`PutseRCEoraleMELE
`
`
`
`&SONDAt"BLIDYDINAwos}SOPOUameys|wud|wpa}aonSqUBAgAwSpqoWiMaN|Ssoyoudapeor“epeoRin
`
`
`
`
`SIURMALODOYAbd|BEI30SOTOSSEofesunoy2pajepdns01udAis
`
`
`
`
`
`
`SpuTyynOA02aqIEIASHUING]Eoy)rmsabessayyAyyisuungyyqwasaySpusiryAWodcStqUNOIDyAida‘AqUO
`
`payepan:|SOyoyd782AAquaidespritedDa{92s2quagiespayorayaG08AqPGE82saquiaydas
`
`
`
`
`GOR40$0704dMalAibaaeys|weld|x3|etn
`
`obetinoy2patieeSj3°UEPURSpurined1QiqisiaWETLL
`
`
`SW4AA998;soyoud£.92saquaydaspeyeary
`asyaegeAeyesycoeA)
`
`
`
`
`
`sSpusuypebbe,Aquasayjanes
`
`penerene\|:WCEpOOyaUanoA
`
`“AsOspuaiynadonagainSpuunqesa9SE|BHeUS|ued|BPD|Me
`
`
`
`
`PewaryGuyAewdsyg‘sungoyoyd¢sacyno,apeaadAy
`
`
`92sequeydespeieos)SBI0NAy
`
`Pietrinpress1a
`
`meeeeppieasyt
`
`
`
`Facebook's Exhi
`
`it No. 1003
`Page 5
`
`Facebook's Exhibit No. 1003
`Page 5
`
`
`
`
`

`

`U.S. Patent
`
`May 17, 2011
`
`Sheet 5 of 11
`
`US 7,945,653 B2
`
`Z99
`
`
`
`
`
`Facebook's Exhibit No. 1003
`Page 6
`
`

`

`U.S. Patent
`
`US 7,945,653 B2
`
`sNet
`
`s":
`
`4.
`
`Af
`
`s
`
`
`
`
`
`Facebook's Exhibit No. 1003
`Page 7
`
`

`

`U.S. Patent
`
`May 17, 2011
`
`Sheet 7 of 11
`
`US 7,945,653 B2
`
`
`
`| #7
`
`
`
`?75 queuoduJOO 6e L
`
`Facebook's Exhibit No. 1003
`Page 8
`
`

`

`U.S. Patent
`
`May 17, 2011
`
`Sheet 8 of 11
`
`US 7,945,653 B2
`
`500
`
`
`
`facebook
`Photos of erin in april trip
`
`hanic setti browse rive help get
`Silicon Valley, CA
`
`My Profe
`
`ed
`
`Photo 1 of 6 Badk to Photos of erin
`
`362
`
`Previous Next
`
`My photos
`
`dick on people in the photo totag them, N
`
`Done aggr
`
`
`
`Type any name or tag:
`
`542
`or choose a person:
`
`540
`
`366-2 in poor choirmonto) by otos renowe tag)
`Added 2 triates ago
`530
`
`From your album:
`spri trip
`
`520
`
`Add a cornment.
`Restaurant in Manhatan
`
`- - - - -
`
`-
`
`-
`
`- -
`
`-
`
`- -
`
`- --- rar r - - a
`
`r
`
`-- a-
`
`55
`an
`
`-
`
`52 5 Rite {S & Rotate
`1,
`Tag This Photo
`Edit This Photo
`pelete this Photo
`Add to Printsho,
`
`-
`
`- -
`
`teft
`
`Right
`
`Facebook's Exhibit No. 1003
`Page 9
`
`

`

`U.S. Patent
`
`May 17, 2011
`
`Sheet 9 of 11
`
`US 7,945,653 B2
`
`600
`
`-
`
`ed
`
`facebook
`... photos of ein in apri trip
`
`photo of 6 Bai, to Photos of ern
`
`tire sesh browse fryite sip toget
`Silicon Waley, CA
`
`Previous text
`
`362
`
`did on people in the photo to tag then,
`.
`
`
`
`---
`
`!
`
`'t
`
`y
`Seych
`
`My Profile
`My friends
`My Photos
`My Notes
`Pty Grous
`My Eyeres
`by Messages
`Aty Account
`ky Privacy
`
`Type any name or tag:
`
`Entarbetty's amal address andw
`and ark to this photo,
`
`in
`
`630
`
`620
`
`366-1
`
`hero coineto,
`
`Added 2 minutes ago
`
`530
`
`-
`
`- ---- r - - -
`525
`tre
`
`520
`
`
`
`is: - a w w w w
`Restaurant in Manhatan
`
`-
`
`-
`
`- -
`
`- - - - - - -
`
`- - -
`
`- - -- - w
`
`r -
`
`Rotate
`
`Rotte
`KS &g:
`tag the Photo
`
`a
`
`Facebook's Exhibit No. 1003
`Page 10
`
`

`

`U.S. Patent
`
`May 17, 2011
`
`Sheet 10 of 11
`
`US 7,945,653 B2
`
`362
`
`Y.Y.
`
`gout
`hine search bioase dive help
`Silicon Waley, CA
`
`Nty photos - april trip
`
`Photos of bed to Abu
`
`700
`
`
`
`356
`
`in this photo; er
`Added Yesterdey
`366
`has conger
`Restaurant in Manhatan
`
`clickhee
`
`for more info
`
`-
`
`-
`
`:
`
`-
`
`- -
`
`550
`
`w
`
`- -
`
`Rotat
`Rotate
`E" (S&Eg:
`ag This Photo
`Ed. This Photo
`Delete This Photo
`Add to Piritshop
`- -
`- -
`
`- -
`
`-
`
`S.
`
`3) http:llow.facebook.con?photosearch.charamenessesser SS30
`-a-1--1aal-al- a-a-a-a-
`detaineerina-Zauser-5056,369.............Je...i.e. internet.....:
`
`FIG. 7
`
`Facebook's Exhibit No. 1003
`Page 11
`
`

`

`U.S. Patent
`
`May 17, 2011
`
`Sheet 11 of 11
`
`US 7,945,653 B2
`
`Address
`
`830
`
`
`
`
`
`
`
`Does Email
`Address Belong To
`Member?
`
`
`
`845
`
`860
`
`NO
`
`Send Invitation
`To Join
`
`850
`
`Receive Tag
`Validity
`Information
`
`YES
`
`855
`
`YES
`
`s Tag Valid?
`
`Remove
`Tag
`
`880
`
`Send Link To
`Tagged Media
`
`875
`-/
`Did Non
`member Join?
`
`
`
`NO
`
`CNPD FIG. 8
`
`Facebook's Exhibit No. 1003
`Page 12
`
`

`

`US 7,945,653 B2
`
`1.
`TAGGING DIGITAL MEDIA
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`The present application incorporates by reference U.S.
`Provisional Patent Application Ser. No. 60/750,844 filed on
`Dec. 14, 2005 for “Systems and Methods for Social Map
`ping.” U.S. Provisional Patent Application Ser. No. 60/753,
`810 filed on Dec. 23, 2005 for “Systems and Methods for
`Social Timeline.” U.S. patent application Ser. No. 1 1/493,291
`filed on Jul. 25, 2006 for "Systems and Methods for Dynami
`cally Generating a Privacy Summary. U.S. patent application
`Ser. No. 1 1/502,757 filed on Aug. 11, 2006 for “Systems and
`Methods for Generating Dynamic Relationship-Based Con
`tent Personalized for Members of a Web-Based Social Net
`work. U.S. patent application Ser. No. 1 1/503,093 filed on
`Aug. 11, 2006 for "Systems and Methods for Measuring User
`Affinity in a Social Network Environment. U.S. patent appli
`cation Ser. No. 1 1/503,037 filed on Aug. 11, 2006 for “Sys
`tems and Methods for Providing Dynamically Selected
`Media Content to a User of an Electronic Device in a Social
`Network Environment, and U.S. patent application Ser. No.
`1 1/503.242 filed on Aug. 11, 2006 for “System and Method
`for Dynamically Providing a News Feed About a User of a
`Social Network.
`
`10
`
`15
`
`25
`
`FIELD OF THE INVENTION
`
`The present invention relates generally to internet digital
`content, and more particularly to systems and methods for
`tagging digital media.
`
`30
`
`DESCRIPTION OF RELATED ART
`
`Various websites have developed systems for organizing
`photos into albums available for viewing by other network
`USCS.
`Some social networking websites offer mechanisms that
`may allow the user to select particular photos or albums for
`immediate viewing. Typically, however, these photos are dis
`parate and disorganized. In other words, the user must spend
`time visually searching through albums, photo by photo, for
`individuals or objects that are not presented in a coherent or
`consolidated manner. Often, many of the photos do not depict
`persons or objects of interest to the user. Just as often, the user
`remains unaware of the existence of Some photos that were
`overlooked. What is needed is a method to organize digital
`media and automatically generate notifications to persons or
`entities interested in the digital media.
`
`SUMMARY OF THE INVENTION
`
`The present invention includes systems and methods for
`tagging digital media in a social network environment admin
`istered by a social network server. In various embodiments,
`digital media may include digital images, digital video, digi
`tal audio, digital audio visual media, computer games, digital
`books, digital text, and/or the like. A user of a Social network
`may upload digital media (e.g., a digital image) to a file (e.g.,
`an album) on their web page thus becoming a media owner of
`the digital image. The media owner may select and tag a
`region of the image by clicking on a point in the digital image
`to select the region and typing appropriate text to tag the
`region. The media owner may select and tag multiple regions.
`In one embodiment, the tagged region is indicated by a border
`Superimposed over the digital image. In one embodiment, the
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`tagged text is displayed with the image, and the border is
`viewed by selecting the tagged text (e.g., by placing the cursor
`over the tagged text). Users in the Social network environment
`may visit the media owners web page via the network and
`select the tagged text to view the tagged region in the digital
`image. In some embodiments, other users can tag the media
`owner's images.
`In some embodiments, the tagged text includes contact
`information (e.g., an email address) identifying a tagged user
`within the social network environment. In various embodi
`ments, contact information includes an email address, a
`phone number, a mailing address, a user account, a user name,
`a text message number, a Voice mail user number, a pager
`number, an instant message address, and/or the like. Contact
`information may also include a name of a person or entity or
`information regarding a third person or entity. The tagged
`user may receive an automatic email notification via the
`social network that his or her email address has been used to
`tag the digital image. The notification may include a hyper
`link providing the tagged user an opportunity to view the
`digital media and tagged region, and/or visit the media own
`er's web page. The hyperlink may further provide the tagged
`user an opportunity to confirm or disaffirm the tagged text that
`includes the email address. When the tagged text has been
`disaffirmed, tags may not be displayed to other users visiting
`the media owners web page.
`In some embodiments, the tagged text includes contact
`information (e.g., an email address) for a tagged non-user
`outside the social network environment (non-member). The
`tagged non-user may receive an automatic email notification
`via the internet that his or her email address has been used to
`tag the digital media. The notification may include a hyper
`link providing the tagged non-user an opportunity to view the
`digital media and the tagged region and, optionally, visit the
`owner's web page. The hyperlink may further provide the
`tagged non-user an invitation to become a member of the
`Social network environment. Upon becoming a member of
`the Social network environment, the tagged non-user and may
`visit the owners web page (as a tagged user) and confirm or
`disaffirm the tagged text including the tagged non-user's
`email address.
`Exemplary embodiments describe methods for tagging
`digital media. In some embodiments, the methods include
`selecting the digital media and selecting a region within the
`digital media. The method further includes associating a per
`son or entity with the selected region within the digital media
`and may further include sending a notification of the associa
`tion to the person or entity, or to a third person or entity.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 illustrates an exemplary social network environ
`ment for tagging digital media:
`FIG. 2 is a block diagram of an exemplary Social network
`provider;
`FIG. 3A is a block diagram of an exemplary media engine;
`FIG.3B is an exemplary screen shot of an album web page:
`FIG.3C is an exemplary screen shot of a digital image web
`page.
`FIG. 3D is an exemplary screen shot of a digital image edit
`web page;
`FIG. 4 is a block diagram of an exemplary tag component;
`FIG. 5 is an exemplary Screen shot of a tag web page;
`FIG. 6 is an exemplary Screen shot of a tag web page;
`FIG. 7 is an exemplary screen shot of a tag web page; and
`
`Facebook's Exhibit No. 1003
`Page 13
`
`

`

`US 7,945,653 B2
`
`3
`FIG. 8 is a flow diagram of an exemplary process for
`tagging digital images in a Social network.
`
`DETAILED DESCRIPTION
`
`4
`130 includes a profile database 202, a communications inter
`face 204, a monitoring module 206, a media database 210, a
`display engine/GUI 208, an activity database 212, and an
`advertising module 214. Although the Social network pro
`vider 130 is described as being comprised of various compo
`nents (the profile database 202, the communications interface
`204, the monitoring module 206, the display engine/GUI 208,
`the media database 210, the activity database 212, and the
`advertising module 214), fewer or more components may
`comprise the social network provider 130 and still fall within
`the scope of various embodiments.
`The profile database 202 is provided for storing data asso
`ciated with each of the users, such as the user 101 associated
`with user device 110. When the user 101 subscribes to ser
`vices provided by the social network provider 130, a user
`profile may be generated for user 101. For example, the user
`101 may select privacy settings, provide contact information,
`provide personal statistics, specify memberships in various
`organizations, indicate interests, list affiliations, post class
`schedules, detail work activities, or group other users 101
`according to one or more categories. When the user 101 adds
`additional information to the user profile, such as adding
`additional albums, the user profile in the profile database 202
`may be updated with icons of the additional albums. The user
`profile may be stored, modified, added, and so forth to any
`storage medium. A timestamp may be associated with the
`user profile, in the profile database 202. Examples of times
`tamps include order of occurrence in the profile database 202,
`date, time of day, and the like.
`According to Some embodiments, the user profile is created
`outside of the social network environment 100 and provided
`to the profile database 202 for local access by the social
`network provider 130. Alternatively, the profile database 202
`is located remotely and accessed by the Social network pro
`vider 130.
`The communications interface 204 is configured to com
`municate with users 101, such as via the user device 110 over
`the network 104. The user device 110 communicates various
`types of information, such as digital media (e.g., digital
`images), privacy settings selections, groupings of other users
`101, and so forth, to the social network provider 130 via the
`communications interface 204. Any type of communications
`interface 204 is within the scope of various embodiments.
`The monitoring module 206 tracks one or more user's 101
`activities on the social network environment 100. For
`example, the monitoring module 206 can track the user's 101
`interaction with one or more items of digital media, Such as
`digital images, news stories, other users’ 101 profiles, email
`to other users 101, chat rooms provided via the social network
`provider 130, and so forth. Any type of user activity can be
`tracked or monitored via the monitoring module 206. The
`information, digital media (e.g., digital images), people,
`groups, stories, and so forth, with which the user 101 inter
`acts, may be represented by one or more objects, according to
`various embodiments. The monitoring module 206 may
`determine an affinity of the user 101 for subjects, other user's
`101 digital images, relationships, events, organizations, and
`the like, according to users’ 101 activities.
`The display engine/GUI 208 displays the one or more
`items of digital media (e.g., digital images), profile informa
`tion, and so forth, to users 101. Users 101 can interact with the
`social network provider 130 via the display engine/GUI 208.
`For example, users 101 can select albums, access individual
`digital images, access other users’ 101 digital images avail
`able via the social network provider 130, and so forth, via the
`display engine/GUI 208. The albums and/or digital images
`may be displayed in a field in the display engine/GUI 208.
`
`10
`
`15
`
`25
`
`FIG. 1 illustrates an exemplary environment for tagging
`digital media, such as in a social network environment 100.
`One or more users 101, at user devices 110, are coupled to a
`social network provider 130 via a communications network
`120. In various embodiments, user devices 110 include a
`computer terminal, a personal digital assistant (PDA), a wire
`less telephone, a digital camera, and/or the like. In various
`embodiments, the communications network 120 includes a
`local area network (LAN), a wide area network (WAN), a
`wireless network, an intranet, an internet, and/or the like. In
`one embodiment, users 101 comprise various types of users,
`including a user who is a digital media owner 101a (e.g., a
`user 101 who uploads digital media) and a user who is a
`tagged user 101b (e.g., a user 101 associated with a region in
`the digital media). In various embodiments, digital media
`includes digital images, digital video, digital audio, digital
`audiovisual media, digital text, digital books, online game
`icons, online game avatars, and/or the like. For the purposes
`of illustration, digital images are discussed herein. However,
`one skilled in the art would understand that the discussion
`applies equally to a wide variety of digital media. The use of
`digital images is not intended to be limiting.
`The social network provider is an entity or person that
`provides social networking services, communication ser
`vices, dating services, company intranets, online games, and
`so forth. For example, the social network provider 130 may
`host a website that allows one or more users 101, e.g., the
`media owner 101a and/or the tagged user 101b, at one or more
`user devices 110, to communicate with one another via the
`website. The social network environment 100 offers users
`101, e.g., the media owner 101a, an opportunity to connector
`reconnect with the one or more other users 101, e.g., the
`tagged user 101b and/or other users 101 that attended, for
`example, the same university as the media owner 101a. In
`some embodiments, a social network environment 100
`includes a segmented community. A segmented community
`according to one embodiment is a separate, exclusive or semi
`exclusive social network environment 100, or social network
`environment 100 wherein each user 101 who is an authenti
`cated segmented community member may access and interact
`45
`with other members of their respective segmented commu
`nity.
`The social network environment 100 may further offer
`users 101 an opportunity to connect or reconnect with one or
`more non-users outside the social network environment 100.
`One example of Such non-user is a tagged non-user 102. The
`tagged non-user 102 may be coupled to the Social network
`provider 130, at a user device 110 via the communications
`network 120.
`The social networking environment 100 further includes a
`media engine 135. The media engine 135 is configured to
`provide the user 101 media services for manipulating media
`(e.g., digital images) within the Social network environment
`100. Examples of digital image manipulation include creat
`ing albums within the user's 101 web page, uploading digital
`images to the user's 101 albums, associating captions with the
`digital images, tagging the digital images with information
`about regions within the digital images, stacking digital
`images, deleting digital images, deleting albums, and the like.
`Referring now to FIG. 2, a block diagram of an exemplary
`Social network provider, such as the Social network provider
`130 shown in FIG. 1, is shown. The social network provider
`
`30
`
`35
`
`40
`
`50
`
`55
`
`60
`
`65
`
`Facebook's Exhibit No. 1003
`Page 14
`
`

`

`US 7,945,653 B2
`
`5
`
`10
`
`15
`
`5
`The media database 210 is configured to store data about
`digital media (e.g., digital images) for users 101. Information
`about the digital images includes album location, captions,
`tags, date information, access privileges, and the like. In
`various embodiments, the media owner 101 a can assign an
`image to a selected album, associate captions with the images,
`and associate tags with the images, using the media database
`210. In one embodiment, the media owner 101 a may tag a
`digital image using the email address of the tagged user 101b
`and associating the email address with a region of the digital
`image. The association between the digital image and the
`email address may be stored in the media database 210. The
`media owner 101 a can store access privileges to a digital
`image, according to groups, networks, and so forth, in the
`media database 210.
`The activity database 212 is configured to store activity
`data (e.g., tracked by the monitoring module 206) about each
`user 101. The activities may be tracked by the monitoring
`module 206. Activities monitored by the monitoring module
`206 may be stored in the activity database 212. Activity
`entries in the activity database 212 may include a timestamp
`indicating time and date of the activity, the type of activity, the
`user 101 initiating the activity, any other users 101 who are
`objects of the activity, and the like. Activities may be stored in
`multiple databases, including the activity database, the profile
`database, the relationship database, and so forth. Examples of
`activities stored in the activity database 212 include creating
`albums, uploading digital images, deleting digital images,
`deleting albums, tagging digital images, and/or the like. For
`example, an entry in the activity database 212 may record that
`a digital image was uploaded to an album at 14:52 on March
`31, or that the digital image was tagged at 15:12 on March 31.
`According to various embodiments, one or more networks
`are provided for each user 101 within the social network
`environment 100. For example, user 101 may have a network
`comprised of other users 101 within the social network envi
`ronment who are grouped according to a university attended,
`a network comprised of people grouped according to the
`user's geographical location of residence, a network com
`prised of people grouped according to a common field of
`40
`work, a network comprised of people grouped according to a
`particular business, and so forth. A common network may
`establish a relationship between user 101 and other users 101
`in the common network.
`The advertising module 214 is configured to provide adver
`tising to users 101 via the communications interface 204
`and/or the display engine/GUI 208. The advertising module
`214 may determine appropriate advertising using the profile
`database 202, the monitoring module 206, and/or the activity
`database 212. For example, the monitoring module 206 may
`communicate to the advertising module 214 that a digital
`image upload is in progress via the communications interface
`204. The advertising module 214 selects the advertising
`according to the profile of the user 101 in the profile database
`202 and displays the advertising to the user 101 via the dis
`play engine/GUI 208 during the upload. Since the user 101 is
`likely to be focused on the display, watching for the upload to
`complete, the advertising module 214 may further tailor
`selection of the advertising for effect on the focused user 101.
`Any type of network may be provided by the social net
`work provider 130. In other words, a network may comprise
`people grouped according to any type of category, Such as
`various social networks described herein, like “friends.”
`“geographical location.” and so forth. User 101 may specify
`the networks, the categories, Subcategories, and so forth and/
`or these may be predetermined by the social network provider
`130. The networks, categories, the Subcategories, and so
`
`30
`
`6
`forth, may comprise a relationship with the user 101, as
`discussed herein, but do not necessarily comprise the only
`relationship user 101 has with the other users 101.
`FIG. 3A is a block diagram of an exemplary media engine
`135. The media engine 135 is configured to provide the user
`101 media services for manipulating digital media (e.g., digi
`tal images) within the social network environment 100.
`Examples of digital image manipulation include creating
`albums within the user's 101 web page, uploading digital
`images to the user's 101 albums, associating captions with the
`digital images, tagging the digital images with information
`about regions within the digital images, deleting digital
`images, deleting albums, and the like.
`The media engine 135 includes an optional album compo
`nent 310, a digital media component 320, a digital image edit
`component 330, and a tag component 340. Although the
`media engine 135 is described as being comprised of various
`components (e.g., the album component 310, the digital
`media component 320, the digital image edit component 330,
`and the tag component 340), fewer or more components may
`comprise the media engine 135 and still fall within the scope
`of various embodiments.
`The album component 310 is configured to create albums
`and/or delete albums. An album may be a collection of digital
`media (e.g., digital images, digital audio, digital video, and/or
`the like). Various embodiments of an album include a list of
`digital media, a folder containing media files, a file, and or the
`like.
`FIG.3B is an exemplary screen shot of an album web page
`350. The album web page 350 includes one or more album
`icons 352. In various embodiments, creating an album
`includes assigning a name to the album, recording a time
`stamp for the album, recording descriptive text about the
`album, assigning access privileges for who can view and/or
`modify the contents of the album, and the like.
`The album component 310 is further configured to display
`information about the album. In some embodiment, the infor
`mation about the albums includes a list of albums and the
`number of albums associated with the user 101. The album
`component 310 further includes an optional album caption
`354. The album caption 354 may include, in various combi
`nations, an album name, a time stamp, descriptive text about
`the album, privilege information, the number of digital
`images in the album, the access privileges, and the like. In
`Some embodiments, the album component 310 uses a digital
`image from the album as the album icon 352. In various
`embodiments, the album component 310 displays further
`information about the albums including which album is the
`most recently updated, which album is the most popular,
`which albums contain digital images that have been tagged by
`other users 101, and/or the like.
`Optionally, the album component 310 displays advertising
`356, which may be received from the advertising module 214.
`In various embodiments, the album component 310 includes
`one or more links 358 and software code configured to view
`the album and/or the contents of the album, edit the album
`and/or the contents of the album, print the album and/or
`contents of the album, share the album and/or the contents of
`the album with other users 101, and the like. In some embodi
`ments, a privacy setting 359 may be associated with the album
`by the album component 310. The privacy setting 359 may
`limit access to, for example, users 101 who are friends of the
`media owner 101a, any user 101 of the social network envi
`ronment 100 who is within the media owner's 101a personal
`network, any user 101 of the social network environment 100,
`and so forth.
`
`25
`
`35
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Facebook's Exhibit No. 1003
`Page 15
`
`

`

`US 7,945,653 B2
`
`10
`
`15
`
`25
`
`7
`FIG.3C is an exemplary screen shot of a digital image web
`page 360. The digital media component 320 is configured to
`upload digital media (e.g., one or more digital images 362) to
`an album. In various embodiments, the digital images 362
`may be uploaded from a local disk on the user device 110, a
`personal digital assistant, a cellphone, a camera, remote user
`device 110, and the like. Optionally, the digital media com
`ponent 320 resizes the digital image 362 while uploading the
`digital image 362. The digital images 362 may be uploaded to
`a storage device associated with the Social network environ
`ment (e.g., a storage device on the user device 110, the Social
`network provider 130, and/or the like). According to some
`embodiments, the digital images 362 are stored outside of the
`social network environment 100 and provided to the digital
`media component 320 for local access via the social network
`provider 130. Alternatively, the digital images 362 are located
`remotely and accessed by the social network provider 130.
`The digital media component 320 is further configured to
`delete digital images 362 from the album.
`The digital media component 320 is further configured to
`display information about the digital images 362. In some
`embodiments, the information about the digital images 362
`includes a list of digital images 362 in the album and the
`number of digital images 362 in the album that are associated
`with the user 101. In various embodiments, the information
`further includes, for each digital image 362, the name of the
`digital image 362, a representative icon, a date stamp, the
`access privileges, and the like. In some embodiments, the
`digital media component 320 provides the user 101 an option
`to select a digital image 362 for use in the album as the
`representative icon for an album. In various embodiments, the
`digital media component 320 displays further information
`about the digital images 362 including which digital image
`362 is the most recently updated, which digital image 362 is
`the most popular, which digital images 362 have been tagged
`by other