... ~
`---------------------------------------------,,-~··-===,
`. =
`
`-
`
`0
`·-P,~
`• .....-t ~
`
`Given Name (first and middle [if any])
`Ken
`Laurie
`
`Family Name or Surname
`Rothmulter
`Vertelney
`
`Residence
`c· and either State or Forei
`Santa Rosa, California
`Palo Alto, California
`
`INVENTOR(S)
`
`@ Additional inventors are being named on the _1_ separately numbered sheets attached hereto
`TITLE OF THE INVENTION 280 characters max
`. _,
`a------------------~=-=--'-'-'=-=--==;;..;.;.=:..,,;::;=:a.-=.:===-~='-------------·--· ::><C"">-==M
`q, __ :i::i;,
`Photo Journal User Interface
`~ \OC:::, ~
`IO~
`..-1
`0
`--------------------------------------------·:-··,...~-.. =====
`Direct all correspondence to ... : ________ c_o_R_R_E_S_PO_N_D_,ENCE ADDRESS
`~ Customer Number
`... , _____ 2_3_3_3_9 _____ _.
`
`Type Customer Number here
`
`Firm or
`Individual Name
`
`State
`Tele hone
`ENCLOSED APPLICATION PARTS check all that a
`14 7
`Specification Number of Pages
`
`ZIP
`Fax
`
`D CD(s), Number
`D Other (specify)
`
`Drawing(s) Number of Sheets
`
`38
`
`Application Data Sheet. See 37 CFR 1.76
`
`METHOD OF PAYMENT OF FILING FEES FOR THIS PROVISIONAL APPLICATION FOR PATENT
`[K]
`Applicant claims small entity status. See 37 CFR 1.27.
`D
`A check or money order is enclosed to cover the filing fees
`IBJ
`The Commissioner is hereby authorized to charge filing
`fees or credit any overpayment to Deposit Account Number:
`D
`Payment by credit card. Form PT0-2038 is attached.
`The invention was made by an agency of the United States Government or under a contract with an agency of the
`United States Government.
`[RI No.
`0 Yes, the name of the U.S. Government agency and the Government contract number.are:---------------
`
`FILING FEE
`AMOUNT
`
`75.00
`
`,._ _ _ 50_-0_6_8_9 _
`
`___.l _
`
`Date
`
`10, 31/ 01
`
`Re spe c f fu J J y su~£d t~
`it/-
`A' ~
`SIGNATURE
`TYPED or PRINTED NAME Walstein Bennett Smith 111
`
`36,685
`j Fo.2001.08
`TELEPHONE 512-869-2068
`USE ONLY FOR FILING A PROVISIONAL APPLICATION FOR PA TENT
`This collection of information is required by 37 CFR 1.51. The information is used by the public to file (and by the PTO to process) a
`provisional application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This collection is estimated to take 8 hours to
`complete, including gathering, prepanng, and submitting the complete provisional application to the PTO. Time will vary depending upon
`the individual case. Any comments on the amount of time you require to complete thrs fonn and/or suggestions for reducing this burden,
`should be sent to the Chief Information Officer, U.S. Patent and Trademark Office, U.S. Department of Commerce, Washington, D.C.
`20231. DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Box Provisional Application, Assistant
`Commissioner for Patents, Washington, D.C. 20231.
`
`REGISTRATION NO.
`(if appropriate)
`Docket Number:
`
`Facebook's Exhibit No. 1005
`Page 1
`
`

`

`,.,...
`
`
`
`
`
`. ~·· ,, .....•. ,,
`
`fi':'. r'ft ••;:;•• »;;j" lL.jl..ll::'" "ii ,,r:;
`
`"ff Jl'"jl":~""11 !'"11·,1·/
`"' • ,jh, ,1 ... _ .. ;;.1, ,,1 .. 1., ,. r
`
`. . . / I --:
`
`
`
`- ,
`..
`-
`,·
`l
`PROVISIONAL APPLICATION COVER SHEET
`Additional Page
`
`i
`t
`!
`PTO/SB/16 (02-01)
`Approved for use through 10/31/2002. 0MB 0651-0032
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`Under the Papetwork Reduction Act of 1995, no persons are required to res ond to a collection of information unless it dis la s a valid 0MB control number.
`Type a plus sign (+)
`+
`inside this box ~
`
`Docket Number Fo.2001.08
`
`Given Name first and middle if an
`
`Famil or Surname
`
`c·
`
`INVENTOR(S}/APPLICANT(S)
`
`Michael
`
`Bernard
`
`Slater
`
`Peuto
`
`Sebastopol, California
`
`Mountain View, California
`
`Number 2
`
`of 2
`
`WARNING: Information on this form may become public. Credit card information should not
`be included on this form. Provide credit card information and authorization on PT0-2038.
`
`Facebook's Exhibit No. 1005
`Page 2
`
`

`

`ft
`
`Fo.2001.08
`
`Summary
`
`The present invention teaches a graphical user interface for digital photo management
`
`that enhances and greatly simplifies the organization and management of digital
`
`photographs. This interface will be referred to herein as "Photo Journal" or
`
`occasionally "PJ", and includes specialized windows, displays, views, menus, dialogs,
`
`and tools (e.g. specialized viewers and editors), as well as an overall scheme for
`
`integration and cooperation between multiple windows, displays, views, menus, and
`
`dialogs. Photo Journal includes optimized techniques for photo sharing, user(cid:173)
`
`transp·arent handling of diverse print destinations, user-transparent handling of
`
`multiple variations of a single image, and user-transparent adaptation for new and
`
`diverse services and Internet-based vendor services. Photo Journal further includes
`
`database methods and structures (e.g., specialized tags, media objects, and metadata),
`
`tagging methods, search methods, and network interfacing.
`
`Photo Journal provides a means ("tagging") for associating fields of text and numeric
`
`data ("metadata") with individual images or photos, and provides database
`
`functionality for selecting, sorting and organizing the images based on the values in
`
`those fields. The invention additionally teaches a simple, graphical means for the user
`
`to perform all the above mentioned functions - associating tags with an image,
`
`selecting certain images based on their metadata, organizing images and sets of images
`
`together. Further, the invention teaches a single interface that provides other photo
`
`management functions in a manner consistent with the photo organization functions
`
`1
`
`Facebook's Exhibit No. 1005
`Page 3
`
`

`

`..
`
`Fo.2001.08
`
`above. These photo management functions include photo printing, importing photos
`
`from devices, and sharing photos with friends, family members and colleagues.
`
`The following paragraphs describe an overview of typical operation of the Photo
`
`Journal interface.
`
`Photo Journal allows you to:
`
`• Organize your photos by putting tags on them, like post-it notes with
`
`information about each photo. Then you can find all the photos with any tag, or
`
`combination of tags. Unlike album- and folder-oriented approaches, you
`
`organize by putting tags on photos, not by putting photos into albums or
`
`folders. This is a much more powerful approach, since it allows each photo to be
`
`found in many ways by putting multiple tags on it.
`
`• Find photos by dragging tags into the Lens in the Finder (the horizontal pane at
`
`the top of the window). You can further refine your search by narrowing the
`
`time using the timeline or adding search criteria using the pop-up menu above
`
`the lens.
`
`• To view, print, share, or do anything else with a set of photos, first find the
`
`photos of interest using the Finder, then select the desired action from the File
`
`2
`
`Facebook's Exhibit No. 1005
`Page 4
`
`

`

`..
`
`Fo.2001.08
`
`menu or from the action buttons at the top of the image area. The Finder lets
`
`you easily find photos with any tag or combination of tags, and with other
`
`constraints such as a specific date range.
`
`You can get information about most items by pointing to them with the mouse and
`
`letting the cursor rest there for a moment ("hovering").
`
`The Photo Journal interface is divided into four major components, illustrated in Figs.
`
`9A and 9B. In these and many of the other figures, numbered geometric shapes are
`
`used to facilitate illustration. Those skilled in the art will understand that these
`
`geometric shapes are used as surrogates for the color photos that would actually be
`
`presented by the graphical user interface.
`
`• The image area. This is the where photos are shown, either one at a time or in a
`
`grid of thumbnails. With the other panes closed, the image area occupies almost
`
`all of the screen. In the illustrative embodiment, panes never cover images; the
`
`image area is automatically resized to make room for any open panes.
`
`• The Finder pane or drawer, which when open occupies a horizontal stripe at the
`
`top of the window. This pane includes the timeline, the lens for searching, the
`
`system analysis pop-up list, and various status indications.
`
`3
`
`Facebook's Exhibit No. 1005
`Page 5
`
`

`

`..
`
`Fo.2001.08
`
`• The Tag Keeper pane or drawer, which when open occupies a vertical stripe at
`
`the left edge of the window. This is where you get tags, either for applying to a
`
`photo or for putting in the lens to initiate a search.
`
`• The Project pane or drawer, which when open occupies a horizontal stripe at
`
`the bottom of the window. Photos in the project pane can be rearranged in any
`
`order. In the illustrative embodiment, the Project is used for making a custom
`
`slideshow. Preferred embodiments will optionally include support for saving
`
`and retrieving custom slideshows and creation of custom albums.
`
`Each pane can be opened or closed independently by clicking on its tab. In general, you
`
`will want to keep the Tag Keeper and Finder panes open, and the Project pane closed.
`
`If you want to have maximum screen area available once you have found the photos of
`
`interest, you can close the Tag Keeper and Finder panes. And if you have not tagged
`
`your photos and are interested only in time-based searches, you can close the Tag
`
`Keeper and keep the Finder open.
`
`At the top of the image area is a row of action buttons. These buttons provide quick
`
`access to the most common actions. The group of icons at the left allows you to select
`
`the zoom level of the image display, and whether you want to see details (metadata).
`
`You can also choose whether you want to show the most recent day first or the oldest
`
`day first. The buttons at the right provide quick access to getting images from your
`
`camera, sharing, printing, and slideshows.
`
`IMPORTING YOUR OWN PHOTOS
`
`4
`
`Facebook's Exhibit No. 1005
`Page 6
`
`

`

`-
`
`Fo.2001.08
`
`Make an empty database: Select New Collection from the File menu. (If you want to
`
`return to the demonstration database, select Open Collection from the File menu and
`
`select Demo Database.)
`
`Import from disk: To import photos that are already on your hard disk, select Import in
`
`the File menu.
`
`Import from camera/flash: To configure Photo Journal for your camera or flash card
`
`interface, connect your camera or plug in your flash card, and select Select Camera
`
`Source Directory from the File menu. Select the drive volume that corresponds to your
`
`camera or flash card. (Photos may be in any directory on the volume but must be in
`
`JPEG or TIFF format.)
`
`Once the configuration has been set, you only need to click on the Get Photos action
`
`button or select Get Photos from Camera from the File menu. PJ will copy all photos from
`
`the camera or flash card to the hard disk.
`
`When reviewing or tagging your newly imported photos, you will probably find it best
`
`to be in .the medium or large grid setting with details on.
`
`Where the files are: Photos imported from your hard disk remain in their original
`
`location on the disk. PJ's database stores a pointer to the image. If you move the image
`
`5
`
`Facebook's Exhibit No. 1005
`Page 7
`
`

`

`..
`
`•
`
`11::.h r·n . . . . ·;,;- ... :.,, 11..n .. !,::::1; "Ji
`
`'
`
`,
`
`, _ j ,
`
`,1::1
`
`'..I»
`
`I
`
`.. ,1
`
`Id _..,,,
`
`iru "::,:·
`
`,, ,J
`
`.,
`
`1'1 , .• , ... 11·1· n
`
`j , _
`
`• 1!
`
`,
`
`Fo.2001.08
`
`file after importing it, PJ may not be able to find it. Preferred embodiments will
`
`optionally be able to search for files that have been moved.
`
`When you import photos from your camera or flash card, the images are stored in
`
`C:/Program Files/Fotiva/Photo Journal/Database/Camera/Batch. You shouldn't
`
`need to access them directly. If you want to use them in another application, find them
`
`with PJ and export them.
`
`Rotate photos: After the photos are imported, rotate any that were taken in portrait
`
`mode. Select one or more images, and then right-click on one of the selected images
`
`and select one of the Rotate options.
`
`Slideshow: To see your photos in their full glory, click on the slide-show action button.
`
`ORGANIZING YOUR PHOTOS
`
`Making tags: To create a new tag, open the Tag Keeper pane (click the arrows on the
`
`Tag Keeper tab at the bottom left of the screen) and click on the "new tag" icon (toward
`
`the right edge of the Tag Keeper tab, which is now at the top of the Tag Keeper pane).
`
`Select the type of tag you want to create and enter the name of the tag in the Label field.
`
`The other information about the tag is all optional. The first time you apply the new tag
`
`to a photo, it will take on that photo as its icon. After you have applied the tag to more
`
`6
`
`Facebook's Exhibit No. 1005
`Page 8
`
`

`

`•
`
`Fo.2001.08
`
`photos, you can go back to the tag editor (double-click on the tag in the Tag Keeper)
`
`and select a different picture for the icon.
`
`Applying tags: The simplest way to apply tags is drag them from the Tag Keeper to the
`
`photo. You can use shift-click and control-click to select multiple tags and they will all
`
`drag together. If you have selected multiple photos (using shift-click, control-click, or
`
`control-A), then dragging one or more tags onto any of the selected photos will apply
`
`those tags to all the selected photos.
`
`FINDING PHOTOS
`
`To view, share, or print photos, the first step is to find them. The Finder pane can be
`
`closed (to give you the most space for your photos) or open (to allow you to find
`
`photos). If the Finder is closed, open it by clicking on the tab at the top left of the
`
`window.
`
`Finding photos by when they were taken: If you have not tagged your photos, you can
`
`still find them by the date they were taken (assuming that they came from a digital
`
`camera and that the camera's date was set correctly). The timeline shows the relative
`
`number of pictures taken in each month. You can move to a particular month by
`
`clicking on its bar in the timeline. You can also find photos visually in a particular
`
`month by using the calendar display, which is accessed by clicking on the calendar
`
`button at the upper right comer of the Finder.
`
`7
`
`Facebook's Exhibit No. 1005
`Page 9
`
`

`

`•
`
`Fo.2001.08
`
`Finding photos using tags: To find photos that have been tagged, open the Finder and
`
`Tagger panes and drag the desired tag or tags into the Finder's "Lens". The image area
`
`will then show your photo collection divided into three groups: best match, near
`
`match, and no match. The best match group is those photos that match all the tags in
`
`the lens. The near match group includes photos with one or more but not all of the tags
`
`in the lens, and the no match group is photos with none of the tags. The Finder's tab
`
`shows the number of images in each group. Each group is marked in the image area
`
`with a text header and also by the background color: white for best match, light grey
`
`for near match, and dark grey for no match.
`
`Controlling the time range: The left and right markers on the timeline allow you to
`
`control the time range. They are normally at the far left and far right edge, but if you
`
`move them toward the center they narrow the date range of the photos in the best
`
`match group.
`
`Finding favorite photos: If you apply the "favorite" tag to your best photos, you can
`
`find them easily. This is especially useful when you take many pictures of the same
`
`scene and want to find just the best one. To limit the best match group to photos that
`
`have been marked as favorites, click on the pop-up list above the lens and select
`
`"Favorite Photos". If there are no tags in the lens, the best match group will be all(cid:173)
`
`photos that have been marked as favorites. If there are tags in the lens, then the best
`
`match group will be all photos that have all the tags that are in the lens and are marked
`
`as favorites.
`
`8
`
`Facebook's Exhibit No. 1005
`Page 10
`
`

`

`..
`
`,r .. 1, .. ;:;•· ";:,:· 1u·1 .. w:· .. "li
`'l"'lJ
`.. ;i
`,1•::
`ll··:
`'·" . • -" .. " ,.,, ... ,,.,., ..
`
`'l
`r"1
`11
`:-.. U ':!
`
`Fo.2001.08
`
`Finding photos based on their source or usage: The pop-up menu above the lens also
`
`allows you to find photos in other ways. For example, you can find photos taken on a
`
`particular holiday, or imported on a particular day, or that have been shared or
`
`printed.
`
`Using the photos you have found: Whenever you want to do something with photos
`
`(such as make a slideshow, print, share, or export), first find them using any of the
`
`techniques described in this section. Then select the desired action using one of the
`
`action buttons or a menu item. The action will act upon all the best-match photos. If
`
`you want only some of them, select them first by clicking on them (and using control(cid:173)
`
`click or shift-click to extend the selection) and then select the desired action.
`
`SHARING PHOTOS
`
`Register: The illustrative embodiment of PJ has basic support for sharing between PJ
`
`users. Before you can use our sharing network, you must enter your name and email
`
`address. To do this, go to File: Preferences, select the Sharing tab, and fill in the two
`
`fields. You must be connected to the Internet when you do this. The sharing
`
`mechanism uses your email address as a unique identifier. In preferred embodiments
`
`you will optionally able to select email notification of shared images that have been
`
`sent to you.
`
`9
`
`Facebook's Exhibit No. 1005
`Page 11
`
`

`

`..
`
`., ..
`
`,,,,,,
`
`..... ,, .... ,,. ll ll ll''" "'!
`,r-,,,,, • • '"'"
`
`, ..
`
`Fo.2001.08
`
`Set up people to share with: To be able to share with someone, they must have PJ
`
`installed and registered, and you must know the email address under which they
`
`registered. To set up someone for sharing, open the contact book (using View: Contact
`
`Book), click Add Contact, and enter the name and email address.
`
`Initiate sharing: First find the photos using any of the usual methods. If you want to
`
`share only some of the photos you have found, select the desired photos. Then select
`
`Share from the File menu or click on the Share Out action button.
`
`The Share dialog shows a list of all the people in the contact book; click on the check
`
`boxes for the people you want to share with. When you click the Share button, the
`
`photos will be uploaded to a server on the Internet herein referred to as the T Server,
`
`which will store the photos until the share recipient(s) check for an incoming share.
`
`You must be connected to the Internet when you click the Share button. PJ resizes
`
`photos to 800 x 600 before uploading them.
`
`Receiving shared photos: If you are connected to the Internet when you launch Photo
`
`Journal, it will automatically check for shared photos that may be waiting for you on
`
`the server and download them to your Photo Journal client. To check for new incoming
`
`shares while the program is running, be sure you are connected to the Internet and
`
`click on the Incoming Shares action button. Preferred embodiments will optionally
`
`automatically check periodically.
`
`10
`
`Facebook's Exhibit No. 1005
`Page 12
`
`

`

`-
`
`Fo.2001.08
`
`Viewing shared photos: When new photos have been received, the Photos Received
`
`dialog will be displayed with a list of previous shares. Select the one at the top of the
`
`list {the most recent one), and the first image in the share will be displayed. You can
`
`preview the images in this dialog. Preferred embodiments will optionally provide a
`
`choice in this dialog of whether t9 add each image to your database or whether to
`
`delete it.
`
`To view the photos outside of this dialog, click OK to exit the dialog. Then use the pop(cid:173)
`
`up menu above the Lens to select "Photos received from" and select the desired batch
`
`in the dialog that is displayed. The photos received in that batch will now be in your
`
`best-match group, and you can view them at any of the zoom levels or as a slideshow.
`
`Note that these photos will appear in your database along with your other photos. The
`
`date and time shown for each will be when the photo was taken, if this information was
`
`available when the photo was shared.
`
`Viewing past shares: You can access any past incoming share by using the "Photos
`
`received from" item in the pop-up list above the lens (at the top left of the Finder pane).
`
`Similarly, you can find photos that you have shared with others by selecting the
`
`"Photos shared with" item from the pop-up list.
`
`PRINTING PHOTOS
`
`To print photos, first find the desired photos, and then select Print from the File menu
`
`or click on the Print action button. To print to your printer, leave the local or remote
`
`11
`
`Facebook's Exhibit No. 1005
`Page 13
`
`

`

`-
`
`., ... 1 .... ,,. "'I
`'!
`'l"'j' 'II
`•1"·
`,1 .. ··1 ..... ,, ..... ,,,111 w ... "'l
`.....
`•r"111J-1
`. . . . . . . . . . 1.,, 1 1 1
`~
`• , . _ , .... , , , , 1 , , , , . , , , ' 1 p , , , l i , , ,
`.•
`
`Fo.2001.08
`
`setting at local. If more than one photo of the selected size will fit on a page, they will
`
`be tiled on the page.
`
`You can also select albmn printing in the Print dialog. This allows you to print the
`
`captions for the photos, as well as the date if desired.
`
`Preferred embodiments will optionally include Print Preview functions.
`
`EXPORTING PHOTOS
`
`First find the photos you want to export, then select Export from the File menu. Specify
`
`the desired resolution and destination folder, and optionally a new root name. You
`
`should use export any time you want to use a photo in another program; only when
`
`you export are r~tation and cropping functions actually performed. Preferred
`
`embodiments will optionally support drag-and-drop exporting.
`
`EDITING PHOTOS AND META DA TA
`
`To modify a photo or its metadata (tags, caption, and notes), select single-image view
`
`with details on. The image window will show all the metadata and the edit controls.
`
`You can also edit date and time in any grid view with details on. You can enter or edit
`
`captions in the large grid view, as well as the single image view.
`
`12
`
`Facebook's Exhibit No. 1005
`Page 14
`
`

`

`..
`
`Fo.2001.08
`
`All edits are stored in PJ's database and do not affect your original photo files. If you
`
`want to use the photo in another application and have rotated or cropped it in PJ, use
`
`PJ's export function to produce files with the edits applied.
`
`BACKING UP YOUR PHOTOS
`
`Preferred embodiments will optionally have integrated backup support. The
`
`illustrative embodiment describes a procedure for performing manual backups. Back
`
`up the entire Database folder (C:/Program Files/Fotiva/Photo Journal/Database),
`
`which will save all images imported from the camera or that have been shared with
`
`you, as well as any audio you've recorded and the database itself (which stores all the
`
`metadata). In addition, you must back up any photos that have been imported from the
`
`hard disk, which are left in their original locations.
`
`13
`
`Facebook's Exhibit No. 1005
`Page 15
`
`

`

`..
`
`Fo.2001.08
`
`Detailed Description
`
`COMPLEMENTARY SOFTWARE APPLICATIONS
`Photo Journal is a standalone application that can be enhanced by other applications,
`
`including:
`
`,. E-Mail Client - used for sharing notification and replying to share-ins
`
`.. Web Browser-used to gain the latest information from the Photo Journal site and
`
`act as one component part for sharing
`
`• Photo Editor - used to extend the minimal, global editing features of Photo
`
`Journal.
`
`INTERNATIONALIZATION
`Photo Journal is being developed so that it can execute both in a variety of countries
`
`and languages. Unicode is being used as the internal character set. Country specific OS
`
`preference settings, including:
`
`,. Date
`
`11 Time
`
`are being referenced by the software
`
`OVERALL ARCHITECTURE
`The main elements of the application function within a single window, including
`
`critical functions like printing and sharing images. Viewing albums and slide shows
`
`happens in a full-screen view. Less frequently used interactions take place in dialog
`
`boxes (new tag, preferences).
`
`14
`
`Facebook's Exhibit No. 1005
`Page 16
`
`

`

`-
`
`ll'"l! "",l' .... ,,, 11 l' T"" "II
`... ,.
`,c, " ., . . • ,,, .
`
`,..
`II·,,
`
`,, :,, W"k ;c;:: ,11,, ff'#: ii
`
`'I
`
`Fo.2001.08
`
`INTERFACE OVERVIEW
`The interface has five main elements:
`
`.. Menu Bar (standard Windows)
`
`~ Find Area (collapsible)- used to locate images, it contains:
`
`a. System Analysis Menu
`
`b. Shuffle Lens
`
`c. Time Controls
`
`'" Image Content Area- entire image database display using a shuffling/ sorting
`
`mechanism
`
`11 Tag Area (collapsible) - used for marking images and finding content
`
`.. Project Area (collapsible)- used for making custom albums and slide shows
`
`WINDOWS AND PANES
`To simplify the user experience and minimize the amount of window management the
`
`user needs to perform, most Photo Journal functions are performed in a full screen,
`
`paned window. The panes automatically manage the screen real estate without the user
`
`having to resize multiple windows and move them around on the screen.
`
`(See Fig. 1)
`
`The main screen is divided into the following panes:
`
`" Image Area- all images in the database are visible in this area sorted and shuffled
`
`by the Find Drawer controls
`
`15
`
`Facebook's Exhibit No. 1005
`Page 17
`
`

`

`Fo.2001.08
`
`.. Find Drawer - contains tools for isolating a subset of the images in the database
`
`and sorting / shuffling those images to the top of the image area. This drawer is
`
`fixed in height and is located at the top of the screen. A set of action icons appears
`
`immediately under the Find Drawer whether it is open or closed. Other
`
`embodiments may add or remove icons from this set of action icons, or modify the
`
`sequence in which they appear .
`
`.. Tag Drawer - contains the currently defined set of tags that can be associated with
`
`images or used in the Find Drawer Lens. This drawer is fixed in width and located
`
`at the bottom of the screen when closed. When it is open it occupies the left vertical
`
`area between the bottom of the Find Drawer and the bottom of the window. If the
`
`Project Drawer is open, this tab moves up with the Project Drawer. If the Tag
`
`Drawer is open when the Project Drawer is open, the top of the Project Drawer sets
`
`the bottom of its pane.
`
`.. Project Drawer - can contain one or more images that will form a custom slide
`
`show or album. This drawer is located at the bottom of the screen. When it opens it
`
`moves toward to the top of the screen. The number of images in the drawer
`
`determines the height of this drawer. It opens only as high as it needs to for
`
`displaying its content. The drawer tries to share the screen with the image area, so
`
`those images can be easily found and then be dragged and drop into position
`
`within the project. The Project Drawer is NOT always visible. It is made visible
`
`through a request for a custom slideshow or album.
`
`All of the drawer panes can be open or closed independently. Depending on what task
`
`the user is performing; a subset of the drawers can be open and made active. The
`
`middle image area resizes as necessary to accommodate the open panes. All drawers
`
`16
`
`Facebook's Exhibit No. 1005
`Page 18
`
`

`

`..
`
`r,,n·?-;;11 """ "" J
`
`Fo.2001.08
`
`and panes with variable content (Tag Drawer, Image Area, and Project Drawer) offer a
`
`vertical scroll bar for accessing content (but not a horizontal bar).
`
`Shown below are a variety of different pane configurations. The images displayed in
`
`the Image Area are medium size thumbnails. Note that in Figs. 1 through Fig. 6 the
`
`Find, Tag and Project Drawers, whether open or closed, are represented as simple
`
`blank rectangular space, whereas in reality they would contain various items
`
`(minimally a drawer title and maximize button). This is done to emphasize which
`
`portions of the screen are utilized by which drawers, and to demonstrate how the
`
`image area resizes itself in response to which drawers are open. It is to be understood
`
`that in preferred embodiments these areas are not blank but contain various user
`
`interface items.
`
`Finder Drawer Open
`
`(See Fig. 2)
`
`Tag Drawer Open
`
`(See Fig. 3)
`
`Project Drawer Open
`
`Note, the Tag Drawer tab moves up with the Project Drawer.
`
`(See Fig. 4)
`
`Tag and Project Drawer Open
`
`Note, the Tag Drawer is tall enough to display all recent tags and at least one row of
`
`tags in the Listbox.
`
`(See Fig. 5)
`
`17
`
`Facebook's Exhibit No. 1005
`Page 19
`
`

`

`..
`
`Fo.2001.08
`
`Initially, when the system is launched, all the drawers are closed and the Image Area is
`
`set to single, large image view. The auto forward mechanism is turned on so that the
`
`user starts by seeing an in-place (within the window) "slide show". Clicking the stop
`
`button, the previous or next buttons will stop the automatic show. Switching views or
`
`selecting an action will also halt the show.
`
`Default Start Up Configuration
`
`(See Fig. 6)
`
`These drawer interface elements resize depending of the main window size and
`
`monitor's screen resolution in the following ways:
`
`• Find Drawer - height is fixed, but width is set to the content area width. The
`
`Timeline is the UI element within this area that varies in width. For an 800 x 600
`
`screen, the Timeline can display two years of content without scrolling.
`
`• Tag Drawer - width is fixed, but the height varies depending on the window
`
`height (and whether the Project Drawer is open). The UI element within this
`
`area that varies in height is the Tag Listbox size
`
`•
`
`Project Drawer - varies its width depending on the window size. It height is
`
`determine by content (the number of images it contains). At some point the
`
`drawer does not get any taller and a vertical scrollbar is added to access the
`
`images within the drawer.
`
`Automatic View Reselection
`
`Depending on how the screen is paned and the main window size (which is dependent
`
`on monitor resolution), the system may switch zoom levels to show more images as the
`
`18
`
`Facebook's Exhibit No. 1005
`Page 20
`
`

`

`-
`
`Fo.2001.08
`
`screen real estate for the image area becomes compromised. In a preferred embodiment
`
`large, single images are only shown when the Project Drawer is closed. When this
`
`drawer is open the system switches to large or medium resolution thumbnail view.
`
`Menu Bar
`
`The menu bar contains access to all of the commands in the interface.
`
`Shuffle Lens
`
`Adding tags to this area shuffles the contents of the Image Area.
`
`Tag Area
`
`Tags are dropped into the Shuffle Lens to control the Image Area and dropped on
`
`photos to tag them. The entire area can collapse into the lower-left of the application
`
`window to allow for maximum real estate for the Image Area.
`
`Time Controls
`
`Included in the Time Controls are ways to constrain the time frame for a shuffle in the
`
`Image Area, jump to a specific point in time and shuffle photos based on holidays and
`
`other recurring events (birthdays, anniversaries).
`
`Image Area
`
`The Image Area is where photos are displayed at four zoom levels, from a single photo
`
`view to a small grid. The image area is the primary space for finding and tagging
`
`photos. The criteria entered in the Shuffle Lens and Time Controls shuffle the contents
`
`of the Image Area.
`
`19
`
`Facebook's Exhibit No. 1005
`Page 21
`
`

`

`., .. ,., ........ , ... , .... , , . .,,.,"
`
`,ii ff"II ",:·•·
`
`·ii r1"'!! "!I
`
`-
`
`Project Area
`
`o:",, •j'"lj "::;•• ";;;•• I! ji 1r.::· »11 1,:::
`
`Fo.2001.08
`
`The Project Area is the launching point for all kinds of actions with photos, including
`
`printing, sharing, and exporting. Additionally, it is the place where albums and slide
`
`shows can be created, edited, saved and accessed again later.
`
`Image Area
`
`The image area contains the complete set of media stored in the database. When Finds
`
`are performed using tags and the Lens control, the database is sorted so that the media
`
`that best matches the query is placed at the top of the scrollable Image Area (in the Best
`
`Match Group, followed by Close Match media and ending with No Match Media).
`
`Controls are available for determining how the media will be displayed in the Image
`
`Area:
`
`" Date Sort Control - showing the newest photo first or oldest first. Newest first is
`
`the default view. When photos are sorted newest first, this is done by date and
`
`within a specific day the photos are sorted from oldest time to newest time.
`
`" Zoom Control - provided for switching among the four zoom levels described on
`
`the following pages. Three of the levels display media in various sized grids. The
`
`forth level, display the a media item by itself in the window at the largest possible
`
`size