(12) United States Patent
`US 8,255,815 B2
`(10) Patent N0.:
`Ording Aug. 28, 2012 (45) Date of Patent:
`
`
`
`
`US008255815B2
`
`MOTION PICTURE PREVIEW ICONS
`
`(54)
`
`(75)
`
`Inventor: Bas Ording, San Francisco, CA (US)
`
`(73)
`
`Assignee: Apple Inc., Cupertino, CA (US)
`
`( * )
`
`Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21)
`
`App1.No.: 11/462,696
`
`(22)
`
`Filed:
`
`Aug. 4, 2006
`
`(65)
`
`Prior Publication Data
`
`US 2008/0034306 A1
`
`Feb. 7, 2008
`
`Int. Cl.
`
`(51)
`
`(2006.01)
`G06F 3/00
`(2006.01)
`G06F 9/00
`(2006.01)
`G06F 17/00
`US. Cl.
`......................... 715/764; 715/810; 715/838
`Field of Classification Search .................. 715/810,
`71 5/7 64
`
`See application file for complete search history.
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`(52)
`(58)
`
`(56)
`
`5,404,316 A *
`5,680,619 A
`5,790,114 A
`6,166,736 A
`6,295,062 B1
`6,851,091 B1
`6,874,126 B1
`7,043,477 B2 *
`7,159,175 B2
`7,346,850 B2
`7,360,152 B2 *
`7,386,784 B2
`2002/0082730 A1
`2003/0090504 A1*
`
`............... 715/723
`4/1995 Klingler et a1.
`10/1997 Gudmundson et a1.
`8/1998 Geaghan et a1.
`12/2000 Hugh
`9/2001 Tada et a1.
`2/2005 Honda et a1.
`3/2005 Lapidous
`5/2006 Mercer et a1.
`1/2007 Ishii et a1.
`3/2008 Swartz et a1.
`4/2008 Capps et a1.
`6/2008 Capps et a1.
`6/2002 Capps et a1.
`5/2003 Brook et a1.
`
`.................. 715/201
`
`.................. 345/716
`
`..................... 707/7
`
`7/2005 Capps et a1.
`2005/0165843 A1
`7/2005 Capps et a1.
`2005/0166136 A1
`3/2007 Park et a1.
`..................... 382/305
`2007/0065044 A1*
`2/2008 Ording
`2008/0034325 A1
`OTHER PUBLICATIONS
`
`Blinkxtv “http://www.techn0ve1gy.com/ct/Science-Fiction-News.
`asp?NewsNum:470” Oct. 3, 2005 pp. 1-2.*
`Murmurscom, “REM Last Show, Last Encore,” Nov. 22, 2008,
`http://www.murmurs.com/vblist7page:1&
`s:ca18a4737dddf05e98ecbdbfe66e5725 A browser window (A1,
`A2) showing a video clip sourced from a third-party web site that can
`be activated in the present web page or the clip’s home page.
`YouTube, “R.E.M. Encore from Mexico City,” Nov. 21, 2008, http://
`www.y0utube.com/watch?v:UF5AxcGCkW4&feature:channeli
`page The Source video / home page (A3) for the video clip ofCite N0.
`7, above.
`ESPN.com, “Lakers Rally to Beat Blazers, 100-86,” Jan. 4, 2009,
`http://scores.espn.go.com/nba/recap7gameld:290104013
`A
`browser window (Bl-B3) showing a video clip in a web page.
`Portions of prosecution history of US. Appl. No. 11/462,695, Mar.
`30, 2010, Ording, Bas.
`Updated portions of prosecution history of US. Appl. No.
`11/462,695, Jan. 10, 2011, Ording, Bas.
`Updated portions of prosecution history of US. Appl. No.
`11/462,695, Jul. 7, 2011, Ording, Bas. Updated portions ofprosecu-
`tion history of US. Appl. No. 11/462,695, Apr. 11, 2011, Ording,
`Bas.
`
`* cited by examiner
`
`Primary Examiner 7 Boris Pesin
`Assistant Examiner 7 Sabrina Greene
`
`(74) Attorney, Agent, or Firm 7 Adeli & Tollen LLP
`
`(57)
`
`ABSTRACT
`
`Some embodiments of the invention provide a method that
`presents a preview of a set of images in a graphical user
`interface (GUI) of a device. The method presents a GUI
`element to represent the set of images in the GUI, where the
`GUI element is moveable within the GUI. The method then
`
`displays within said GUI element a sequence of the images in
`the set of images to provide a preview of the set of images.
`
`47 Claims, 30 Drawing Sheets
`
`425
`
`Hawaflavl
`
`\
`
`Mex‘coaw
`
`Amemlnaavl
`
`Apple Exhibit 4249
`
`Apple V. SightSound Technologies
`CBM2013-00020
`
`Page 00001
`
`Apple Exhibit 4249
`Apple v. SightSound Technologies
`CBM2013-00020
`Page 00001
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 1 of 30
`
`US 8,255,815 B2
`
`\\\. \\\\\.\\\\\\\\ \Wwww
`
`
`
`
`x\\\\\\\\
`
`““‘\‘§‘Q§‘\“§‘Q§Q§§‘§\§§‘Q§‘Q§‘§
`‘R“‘§‘\‘\‘§‘Q§‘\“‘§\‘Q§‘\“§\‘Q§§§Q\‘§‘R
`‘K‘Q‘YK‘QQ‘QRWVR‘QQQ‘QK ““‘\‘§‘Q§‘\
`\ Q3
`. \\\\\\§\\\\ \\\§\ \ \\\&
`\\\\\
`\\\ \
`k
`\Yk§\\\ \\\\\\ \
`\
`\
`\ KR \\
`\W
`§WWWMW
`
`\\
`\\\\
`
`
`
`
`===\
`
`
`
`\\\\E
`\
`
`\\\\§
`
`2::
`
`\\\\\:
`
`Figure1
`
`\\\\§\\\\
`
`\ w\ \\\\<§\§§
`\ 51%
`- -
`\\\\§\\\\
`\ w\ \\\\<§\§§
`:§s\
`\\\\§
`g;--
`““Q
`\\\\
`
`;:§\ \\\\§
`5§5_\ W\\\\\
`
`\ w\\\
`
`
`
`\\\\§
`:9 m,
`
`Videog
`
`Mexiooavi
`
`§\\\\\\\\;
`
`NW
`.
`\
`
`\ m ‘
`
`\\\\\\\ \
`
`§§§i\\\\\\\\
`§§§\\\\\\\\
`
`W§
`
`:\\\\\\\\\\
`
`i/
`
`x\\\\\\\\
`
`
`
`
`
`
`§\m&\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\ \N
`
`
`
`
`
`Page 00002
`
`Page 00002
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 2 of 30
`
`US 8,255,815 B2
`
`
`§§§§§§§§§§§§§§§§s$§§wmmmmmmmmmmmmmmmmmmmmmm
`
`emmww\\\
`
`
`
`
`Xm
`
`\
`
`§§§
`
`§§§§
`§§§§
`
`§§§
`
`&
`
`
`
`
`
`E
`
`E
`
`: \§
`
`\ § 9
`EVE
`
`i\§§
`
`k
`
`
`
`.3
`
`Page 00003
`
`Page 00003
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 3 of 30
`
`US 8,255,815 B2
`
`<\\ m,
`
`m5
`
`orm
`
`Bug.mmmuMmg9.3on
`
`
`\\\\\\\\\\\\\
`\.CT\
`
`mag..ma5.”EELMQ
`
`mafia.mHasuMQEEG
`
`Wm?cat;En:30.
`
`fitawa2&533
`
`539$MET"...
`
`.MM56.
`
`inan.E;Mum-
`
`
`
`Ewenxwwmuffin
`
`
`
`MDHQMH“...fififinfi.
`
`yuan
`
`
`
`nmOME3......0....
`
`may“...KQNM
`
`mevwé
`
`Wu.4
`
`0
`
`Page 00004
`
`Page 00004
`
`
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 4 of 30
`
`US 8,255,815 B2
`
`
`
`meW W mmmwwm Nx‘mm‘» W \\\\\\ m x \\\ x m
`
`
`
`\\\
`\\
`% K“ ;
`\ \ \\\\\\\\\\ am \\\\\ \ \
`“E \\\‘Q\ \\\‘Q\ \\\\\\\\ \ \ \ “E \\\‘Q\ \m \\\ \ m :c
`“E \x\\
`\\\\ \ \
`
`\\ \km \E \
`\
`
`
`425
`
`450
`
`
`
`
`
`
`
`
`Page 00005
`
`445
`
`Europe.avi
`
`
`
`Argentinaavi
`Hawaii.avi
`
`
`
`
`
`
`
`
`
`Page 00005
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 5 of 30
`
`US 8,255,815 132
`
`m
`
`mmmmmmmmmII5mW
`
`\\,\\N
`
`Argentinaavi
`
`x“ /
`//”fig/ivé/‘5”ZI“
`I“ /
`//w%/‘fv%f“
`
`"i;
`
`8x8
`:\\:\\\\"
`
`§
`\\\\$\\\>\\:\E
`\§§§k
`
`Page 00006
`
`888%I“I“I“ //
`//»’%"5/5”é“I“ /
`//»’%"z/‘fl”g“I“ /
`
`////p/Cfi/flééééifi;é/ififfl/é“
`
`
`
`
`
`fi/éé/é/Wfifig/fiWWWWWWWW ia?8?
`
`Page 00006
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 6 of 30
`
`US 8,255,815 B2
`
`START
`
`600
`
`F
`
`605
`
`Identify a set of criteria for
`selecting a subset of images
`
`Select the subset of images
`
`610
`
`615
`
`Produce at least one thumbnail for
`
`each image in the subset or produce
`a composite thumbnail
`
`620
`
`7
`
`Define the icon based on the
`
`thumbnail or thumbnails
`
`Figure 6
`
`Page 00007
`
`Page 00007
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 7 of 30
`
`US 8,255,815 B2
`
`
`
`Hawaii.av ///////// I“r“N//
`
`
`
`\
`
`
`
`\
`
`Page 00008
`
`% Figure7
`
`x“x“,«§5’5’54/2IfI?I;
`
`/ E
`
`urope.avi
`
`710
`
`Page 00008
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 8 of 30
`
`US 8,255,815 B2
`
`“wmaaa
`
`sssssssssssssss
`
`
`
`“:::saasaaaaaaam
`
`ssssssssssssssss
`Ekkkkkkkkkktkttk
`
`ssss
`“sssssssss
`““““““
`
`Ekkkkkkkkkkttkt
`
`mmw
`
`\\
`
`sEmfiamm
`
`m.«SEE
`
`Page 00009
`
`Page 00009
`
`
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 9 of 30
`
`US 8,255,815 132
`
`mNm
`
`§\\\
`
`\\0.x.
`
`m9:95
`
`Page 00010
`
`303mmfix0
`
`mEEomE
`
`am»?
`
`Page 00010
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 10 of 30
`
`us 8,255,815 132
`
`\\\\\\\\\\\\
`
`SmdaoEm
`
`_>m.oo_xo_>_
`
`Q h9
`
`59E
`
`Page 00011
`
`
`
`Page 00011
`
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 11 of 30
`
`Us 8,255,815 B2
`
`moor
`
`\\\\\\\\\
`
`SdeEomE
`
`hh939$
`
`Page 00012
`
`Page 00012
`
`
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 12 of 30
`
`US 8,255,815 B2
`
`momr
`
`oFNF
`
`
`
`Emac2283
`
`mwmw
`
`_.=manJE.
`
`o__u_28:296”;
`
`F__m:nE::._.200:99.9;
`
`m__m:nE::._.200:05on
`
`:__m:QE:c._.
`
`c__m:nE::._.98:996”;
`
`mNNF
`
`N__m:QE:c._.
`
`
`
`
`
`m__man:c._.9:65me93922
`
`E9%.:
`
`Page 00013
`
`Page 00013
`
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 13 of 30
`
`US 8,255,815 B2
`
`9_m0quo
`
`__mcgE:r_._.
`
`mNmF
`
`mom:
`
`
`
`
`
`__mcgE:r_._.0:89:00@6369mango:
`
`9mmc0283
`
`m__u_28:99me
`
`
`
`__mcgE:_._._.9_moquo98:996”;
`
`mFNF
`
`.2«Sat
`
`Page 00014
`
`Page 00014
`
`
`

`

`U.S. Patent
`
`Aug. 28,2012
`
`Sheet 14 of 30
`
`US 8,255,815 B2
`
`GHQF
`
`9%:
`
`owvF
`
`mt“F
`
`/
`
`Ed33M.
`anSnow
`
`Eamm?
`w@«C‘Nmunfl.\
`
`.\\\\\\\\\\ mowF
`
`
`
`mom:IVwnmg‘mmzuficg
`
`‘smflmfimumwfi
`
`M3353
`
`mawmmu._am<
`
`wmtmgfiumfl
`
`$an3?.
`
`§\\\§
`
`3959m
`
`Page 00015
`
`Page 00015
`
`
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 15 of 30
`
`US 8,255,815 B2
`
`
`
`1525
`
`Argentinaavi
`
`.aVl
`
` eXICO
`
`:3.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\.\
`
`
`V
`
`R
`
`\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\
`
`
`
`:\\
`
`Figure15
`
`Page 00016
`
`Page 00016
`
`

`

`QMU
`
`tnm
`
`Aug. 28, 2012
`
`Sheet 16 of 30
`
`US 8,255,815 B2
`
`m\\
`
`9.9moor
`
`_>m_maohsm
`
`.2«59¢
`
`Page 00017
`
`Page 00017
`
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 17 of 30
`
`US 8,255,815 B2
`
`Figure17
`
`1715
`
`1705
`
`Page 00018
`
`Page 00018
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 18 of 30
`
`US 8,255,815 B2
`
`Figure18
`
`Page 00019
`
`Page 00019
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 19 of 30
`
`US 8,255,815 B2
`
`
`
`
`
`
`
` _>m.oaohsm mmmr
`
`2East
`
`Page 00020
`
`Page 00020
`
`

`

`U.S. Patent
`
`Aug- 28, 2012
`
`Sheet 20 of 30
`
`US 8,255,815 B2
`
`
`
`>_m.m:.Emm?
`
`8«BE
`
`Page 00021
`
`Page 00021
`
`
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 21 of 30
`
`US 8,255,815 B2
`
`momwLomomw
`
`
`
`:02930:“.20:22
`
`GEN
`
`morm
`
`:8_£me
`
`852:2
`
`m_._.N
`
`$23:02
`
`$236:80
`
`930E8:22
`
`853326:80
`
`ONFN
`
`E«But
`
`Em.ms:
`
`Page 00022
`
`Page 00022
`
`
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 22 of 30
`
`US 8,255,815 132
`
`\\k..
`
`OFNN
`
`
`
` Eu.NE:aV$3..m,m\.HMmm,
`
`«in:0mg»mew
`
`
`
`Sfl‘wnhc:u
`
`.923.6.
`
`«$32
`
`NN939m
`
`Page 00023
`
`Page 00023
`
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 23 of 30
`
`US 8,255,815 B2
`
`Sacmaen
`
`N“
`
`g
`\\ ‘1
`\ wmx‘
`
`\\
`
`Giympiglfimgg
`
`Gimmic2lta’fiwg
`
`‘9)?
`1?N
`w.1!‘1'“!
`*4r”:
`t»
`\.
`:"m.“
`
`44.31023andisk
`
`Figure23
`
`Page 00024
`
`Newark
`
`Agpilcaziens
`
`manace?
`
`mmd‘ey,m mmmertial.mm
`
`iymaigulimgg
`
`iymeLlSmgg
`
`0 0
`
`Page 00024
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 24 of 30
`
`US 8,255,815 B2
`
`Figure24
`
`Page 00025
`
`a.
`
`\emok
`
`'imems
`
`manzae‘eie
`
`
`
`
`
`3aUl
`
`:D
`Kg2
`n"!V
`w
`
`
`
`C09)merciefimev
`
`Page 00025
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 25 of 30
`
`US 8,255,815 B2
`
`36E42n?”WE€45
`
`.l
`
`\\\\.\\\\
`
`
`
`..LGmm...3“
`
`.C.xxu
`
`\\x.>
`
`fin3ME33
`
`wfidmagm
`
`ESESq,
`
`2,332m9NE
`
`
`
`$6mm2,.au,.8.
`
`mm9:3
`
`Page 00026
`
`Page 00026
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 26 of 30
`
`US 8,255,815 B2
`
`
`
`fig3mg”mg
`
`ESEr
`
`33.
`
`2d9.,2SEN.
`
`mm9:95
`
`Page 00027
`
`Page 00027
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 27 of 30
`
`US 8,255,815 B2
`
`2725
`
`\\.\\ \\\
`
`§\\\\\\\‘§
`
`
`
`
`
`
`
`
`
`
`
`
`
`W
`
`N
`
`
`5:
`
`'35:?
`
`
`
`
`
`
`\\
`
`
`
`
`W
`
`
`
`
`
`k
`
`W E
`m N
`§\\\\\\\ %
`
`
`
`.‘\\§\\\\ \\\\§§S
`
`N
`
`
`
`N
`‘
`‘ K
`
`
`
`
`
`
`
`
`
`
`
`
`
`\\
`
`\\
`
`
`
`Page 00028
`
`Page 00028
`
`

`

`US. Patent
`
`Aug. 28, 2012
`
`Sheet 28 of 30
`
`US 8,255,815 B2
`
`yé
`
`5%\\ \\
`,\\\\\\.\§\\\
`
`55\ \\
`
`5‘,
`53
`
`\\‘
`\\
`
`55\
`55:»
`
`\\N
`\\\\\\%
`
`5w \\\\\\\
`5»
`\\\\\\\\5
`
`._
`
`5
`
`:
`
`5'"
`.9
`g
`m ,
`1:}:
`
`:1.
`V
`55\ \\\\\ \‘
`5 \
`5:,
`\\\\\\\\§
`55\ \\\\\ \\
`5*\ 55555
`
`5*\ 555% 0°
`\ N
`55‘\ \\\\.\ \\
`‘5 CD
`55\ \\\\§\\\§ K
`\ 3
`55‘\ \\\\.\ \\
`‘5 5‘»
`55\ \\\\§\\\§ ‘
`\ ”-
`55‘\ \\\\.\ \\
`
`55\ \\\\§\\\§
`\
`55‘\ \\\\.\ \\
`
`\
`55‘\ \\\\.\\.\
`
`3y
`
`\.
`/%
`mm \
`5mm “5
`5&3 *3
`
`m\\\m \§
`
`k
`\\\‘
`5mm \\
`
`§\\
`
`mm \
`M\\\\\
`
`\
`;\\\\\\\\\§
`m
`may
`;\\\\\\\\\§
`555%
`
`
`
`.
`
`555%
`\\
`mmx
`Ex ,
`l\\\\\\\§\\$
`m '
`mmx
`Ex
`;\\\\\\\\§
`m
`mmx
`
`;\\\\\\\\§
`m
`mmx
`
`m
`mm \
`
`,\\\\\\.\ \\
`;\\\\\\\\\\§
`555% >
`
`%
`R\\\\\\
`\\\\\\\\§\\§ is
`\\\.\\\\\.\\\
`m\\
`‘\ \\ \
`\
`
`
`\\\\.\ \\\\\ \\\\ \\\\\\.\ \ \\\\\.\\\\.\ \\ \\\\\.\\\\.\
`\\.\\.\\\\\
`§\\\\\\
`\Q\\.\\ §\\\ \
`\\ \
`xxx
`
`
`mm
`\\\.\\\ \ \
`N\\\\\\\
`\\\\.\\.
`W}&E§\W§&E&\W\¥E§E\W\\E§E\W
`kfibikbEkbEkbbfikkbk “Q
`\EEEbEkfikEQ
`
`55:5
`\\\\\.\
`55\ ““3
`‘ 5555Z
`\\\\\\§
`55\ \\\\ \
`K \
`\ \\\\\
`/
`\ “QR
`\ mfi
`
`Page 00029
`
`Page 00029
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet 29 of 30
`
`US 8,255,815 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`N9sz
`
`Page 00030
`
`Page 00030
`
`

`

`U.S. Patent
`
`Aug. 28, 2012
`
`Sheet300f30
`
`US 8,255,815 B2
`
`{02,52
`
`mwom
`
`moon\
`
`mmom4/
`
`ooom
`
`4/
`
`mrom
`
`59:08296
`
`
`
`wmo_>mn_39:92
`
`@92on-4/
`
`mmom
`
`onEast
`
`omom__wmo_>mn_
`
`SqE
`
`Lowwmooi
`
`orom
`
`omom
`
`Page00031
`
`Page 00031
`
`

`

`US 8,255,815 B2
`
`1
`MOTION PICTURE PREVIEW ICONS
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`The present application is related to US. patent application
`Ser. No. 11/462,695, concurrently filed with the present
`application, with the title “Multi-Point Representation”.
`
`FIELD OF THE INVENTION
`
`The invention relates to motion picture preview icons.
`
`BACKGROUND OF THE INVENTION
`
`In recent years, there has been a proliferation of multi-
`media content. One example of such content is motionpicture
`content. Motion picture content
`is content
`that
`includes
`numerous pictures (frames, fields, images, drawings, etc.)
`that are displayed in a sequence in order to provide the illu-
`sion to a viewer that objects in the picture appear to move.
`Examples of such content include animations, movies, tele-
`vision shows, home videos, or any other type of video clips.
`With the proliferation of multi-media content on comput-
`ers, various methods have been proposed to allow computer
`users to identify and organize such content. However, to date,
`few solutions have been proposed to allow a user to ascertain
`quickly the subject matter ofmotion-picture content stored on
`a computer.
`For instance, the graphical user interface of most comput-
`ers today display a generic icon for the motion picture content
`and require the user to identify the content’s subject matter
`from the title ofthe icon. FIG. 1 illustrates one such approach.
`Specifically, it illustrates four icons 105-120 of four video
`clips that are stored in a folder 125 entitled V1deos. Each of
`these icons has a text component and a graphical component.
`The graphical component of each icon only illustrates that the
`icon’s associated video clip is anAVI file that can be opened
`by the Quicktime media player. An icon’s graphical compo-
`nent provides no other indication of the subject matter of the
`icon’s video clip. The only indication of the subject matter of
`the icon’s video clip is provided by the icon’s text, which
`provides the name of the video clip. Hence, a viewer cannot
`glean too much information about the subject matter of a
`video clip from the video clip’s icon.
`Some have suggested having one frame from the video clip
`serve as the graphical component of the clip’s icon. FIG. 2
`illustrates one such approach. In particular, it illustrates four
`icons 205-220 of four video clips that are stored in a folder
`225 entitled Videos. The graphical component of each of
`these icons illustrates the first frame in each video clip, while
`the icon’s text provides the name of the video clip. This
`approach pictorially provides a user with more information
`regarding the subject matter of each clip than the approach
`illustrated in FIG. 1. However, even under the approach illus-
`trated in FIG. 2, a viewer still might not be able to glean too
`much information about the subject matter of a video clip
`from the video clip’s icon, because the first frame of the clip
`might not be very representative ofthe clip’ s subject matter or
`might not provide enough information to allow a viewer to
`understand the subject matter.
`Another approach is to display a video preview window
`next to a video clip’ s icon when the video clip is selected. The
`user can then view the video clip in this preview window. FIG.
`3 illustrates this approach. Specifically, it illustrates a Movies
`folder 305 that includes eight video clips. In this figure, the
`Movies
`folder
`is
`illustrated in a column-view format
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`
`employed by the OS X operating system ofApple Computer,
`Inc.Also, in this figure, a video clip 310, entitled Comedy, has
`been selected. This selection causes a preview window 315 to
`open to the right of this video clip. At its bottom, the window
`315 has control buttons 320 (e.g., play, volume, etc.) that
`allow a user to initiate and control the playback of the video
`clip within the window 315.
`The approach illustrated in FIG. 3 allows a user to review
`the subject matter of a video clip without the need to have a
`media player formally open the video-clip’s file. Hence, a
`user can more quickly ascertain the subject matter of a video
`clip. On the other hand, this approach still does not provide
`the user with immediate or near immediate visual data regard-
`ing the subject matter of the video clip.
`Therefore, there is a need in the art for a graphical user
`interface that provides quick feedback to a user about the
`subject matter of a video presentation. More generally, there
`is a need for a graphical user interface that would provide the
`same preview feedback for any other audio presentation,
`image presentation (e.g., collection of images), document
`presentation, etc. Ideally, this graphical user interface would
`provide the user with several different options to quickly
`discern and access the subject matter of the presentation.
`
`SUMMARY OF THE INVENTION
`
`Some embodiments of the invention provide a method that
`presents a preview of a set of images in a graphical user
`interface (GUI) of a device. The set of images can be a video
`presentation, a set of digital photographs, an animation, a set
`of drawings, etc. To generate the preview, the method initially
`selects a subset of images that includes several images in the
`set but not all the images in the set. In some embodiments, the
`method selects the subset of images in an automated manner.
`For instance, in some embodiments, the method automati-
`cally selects the images based on a specified set of criteria,
`such as specified intervals in the set of images, scene changes
`in the set of images, etc. Some embodiments allow a user to
`adjust the set of criteria (e.g., allow a user to adjust the
`specified intervals for selecting images in the set of images).
`In addition, some embodiments allow a user to select the
`images in the selected subset of images.
`After selecting the subset of images, the method concur-
`rently displays the images in the selected subset as the pre-
`view of the set of images. In some embodiments, the dis-
`played images are thumbnail versions of the images in the
`selected subset of images. Some embodiments display all the
`thumbnail images in the same size in one row or one column.
`Other embodiments display at least two different thumbnail
`images in at least two different sizes. For instance, in some
`embodiments, the thumbnail for at least one image is larger
`than the thumbnail for at least two other images, and the two
`smaller images are aligned in one row or one column that is
`adjacent to the larger thumbnail. Some embodiments define
`the order ofthe thumbnail images in the concurrent display of
`images based on the order of the images in the set of images.
`In this manner, the order of the images in the display is
`indicative of the order of the images in the content.
`Some embodiments concurrently display the selected sub-
`set of images when a user selects, in the GUI, an icon that
`represents the set of images. Other embodiments have the
`subset of images form the graphical component of the icon
`that represents the set of images. In other words,
`these
`embodiments display the selected image subset as at least a
`portion of the graphical component of the icon representing
`the set of images. Some embodiments display the selected
`
`Page 00032
`
`Page 00032
`
`

`

`US 8,255,815 B2
`
`20
`
`30
`
`10
`
`3
`image subset in at least a portion of another GUI element
`(e. g., a button or other user-selectable GUI element).
`Such an icon or GUI element can be part of the GUI of an
`operating system of the device (e.g., of a computer or other
`electronic device). For instance, the icon can be displayed in 5
`a folder structure of the operating system. Alternatively, the
`operating system can display the icon in a window that dis-
`plays the results of a search performed by a user. The icon can
`also be part of the GUI of an application program (e.g., an
`image or video editing application) that is executing on the
`device. The GUI element can be part of the GUI of the
`operating system of the device or any application executing
`on the device.
`Each multi-image representation provides a static multi-
`image preview of a set of images. In some embodiments, each
`such multi-image representation can also provide a dynamic 15
`motion-picture preview. Specifically, some embodiments dis-
`play the set of images in a sequence (1) within the graphical
`component of the set’s associated icon, or (2) within the
`display window that opens adjacent to the icon to display the
`subset of images when the icon is selected.
`Moreover, when a user requests such a dynamic motion-
`picture preview, some embodiments provide a motion-picture
`transition from the static multi-image preview within a multi-
`image icon to a dynamic motion-picture preview within the
`multi-image icon. For instance, in some embodiments, all but 25
`one of the images in the displayed image subset gradually
`disappear behind the remaining image. In these embodi-
`ments, the graphical window that contains the remaining
`image then sequentially displays the images in the set. The
`motion-picture preview icons were described above in the
`context of multi-image icons and previews. However, some
`embodiments implement the motion-picture preview in icons
`that are represented by only a single image (e.g., a single
`thumbnail image).
`In some embodiments, the sequential display of images is
`in response to a user’s request to view a motion picture 35
`preview of the images. In response to this request, some
`embodiments direct an application (e.g., a media player) to
`retrieve the images and generate the sequential display (e.g.,
`the video display) of the image. Some embodiments have the
`application perform this operation without a visual indication 40
`to the user that the application has been opened.
`Some embodiments provide playback control buttons (e. g.,
`play button, stop button, enlarge button, etc.) to facilitate the
`playing of the sequential display. Such buttons can be part of
`or associated with (l ) the icon that represents the image set, or 45
`(2) the displayed image subset when the subset is displayed
`adjacent to the icon. Some embodiments present some or all
`of these buttons only when a cursor of the GUI is within a
`particular distance of the icon or the displayed image subset.
`Alternatively, in some embodiments, some or all of the but- 50
`tons are displayed irrespective of the position of the cursor
`(e.g., some of the buttons are at all times displayed with the
`icon).
`Some embodiments also provide a line that scrolls across a
`window that displays the sequence of images as the images 55
`are being sequentially displayed in a motion-picture icon.
`This line provides a visual indication of the location of a
`currently displayed image in the series of the images that are
`being sequentially displayed. In some embodiments, a user
`can select and move this line in order to change the image that 60
`is being displayed in the window.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The novel features of the invention are set forth in the 65
`
`appended claims. However, for purpose of explanation, sev-
`eral embodiments are set forth in the following figures.
`
`4
`
`FIG. 1 illustrates generic icons.
`FIG. 2 illustrates icons having one frame from the video
`clip serve as the graphical component of the clip’s icon.
`FIG. 3 illustrate a video preview window next to a video
`clip’s icon of some embodiments of the invention.
`FIG. 4 illustrates multi image icons of some embodiments
`of the invention.
`
`FIG. 5 illustrate a video preview window as part of the
`graphical component of an icon of some embodiments of the
`invention.
`
`FIG. 6 illustrates a process that generates a multi-image
`icon that represents a set of images in the graphical user
`interface of a device of some embodiments of the invention.
`
`FIG. 7 illustrates an arrangement of the thumbnails in the
`pictorial representation of icons in some embodiments of the
`invention.
`
`FIG. 8 illustrates a search window that displays multi-
`image icons ofvideos of some embodiments ofthe invention.
`FIG. 9 illustrates a graphical user inter face of a photo
`editing/organizing application having multi-image icons of
`some embodiments of the invention.
`
`FIGS. 10 and 11 illustrate an example of moving a multi-
`image icon from one folder to another in some embodiments
`of the invention.
`
`FIG. 12 illustrates a data structure used to represent a
`multi-image icon of some embodiments of the invention.
`FIG. 13 illustrates another data structure used to represent
`a multi-image icon of some embodiments of the invention.
`FIG. 14 illustrate a multi-image content in a preview win-
`dow of some embodiments of the invention.
`
`FIG. 15 illustrates multi-image icons of videos that are
`stored in a folder of some embodiments of the invention.
`
`FIG. 16 illustrates four stages of a motion-picture transi-
`tion for the case when a user selects the play button of some
`embodiments of the invention.
`
`FIG. 17 illustrates a geometric shape that scrolls across an
`icon during a motion picture preview of the icon of some
`embodiments of the invention.
`
`FIG. 18 illustrates an example of a motion picture preview
`that provides an expansion button for expanding the motion
`picture preview to cover the entire display screen of some
`embodiments of the invention.
`
`FIGS. 19 and 20 illustrate an example of moving a motion
`preview icon from one folder to another in some embodi-
`ments of the invention.
`FIG. 21 illustrates a data structure used in some embodi-
`
`ments to represent a multi-image, motion-picture preview
`icon of some embodiments of the invention.
`
`FIG. 22 illustrates a multi-image preview of a video clip
`after the selection of the clip’s associated icon of some
`embodiments of the invention.
`
`FIGS. 23-25 illustrate a motion picture transformation of a
`preview after a user selects the play button on the play bar of
`some embodiments of the invention.
`
`FIG. 26 illustrates the playing of a motion picture preview
`in an enlarged preview window after only one thumbnails
`remains in some embodiments of the invention.
`
`FIG. 27 illustrates an example of a single thumbnail,
`motion-picture preview icon of some embodiments of the
`invention.
`
`FIG. 28 illustrates the display of the video represented by
`the icon after a user has requested the playing of this video by
`selecting the button of some embodiments of the invention.
`FIG. 29 illustrates an example of using the multi-image
`preview to create a multi-image preview icon that represents
`a word processing document in some embodiments of the
`invention.
`
`Page 00033
`
`Page 00033
`
`

`

`US 8,255,815 B2
`
`5
`FIG. 30 conceptually illustrates a computer system with
`which some embodiments of the invention are implemented.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`In the following description, numerous details are set forth
`for the purpose ofexplanation. However, one of ordinary skill
`in the art will realize that the invention may be practiced
`without the use of these specific details. In other instances,
`well-known structures and devices are shown in block dia-
`
`gram forrn in order not to obscure the description of the
`invention with unnecessary detail.
`
`I. OVERVIEW OF SOME EMBODIMENTS
`
`Some embodiments of the invention provide a method that
`presents a preview of a set of images in a graphical user
`interface (GUI) of a device. The set of images can be a video
`presentation, a set of digital photographs, an animation, a set
`of drawings, etc. Also, in some embodiments, the device is a
`standalone computer, such as a desktop, laptop, handheld
`computer, etc. In other embodiments, the device is any type of
`electronic device that has embedded computing resources,
`such as processors with firmware or software, or configurable
`computing resources (e.g., FPGA’s), etc. Examples of such
`devices include consumer electronic or communication
`devices, home media centers/hubs, handheld electronic
`devices, etc.
`To generate the preview, the method initially selects a
`subset of images that includes several, but not all, the images
`in the set. In some embodiments, the method selects the
`subset of images in an automated manner. For instance, in
`some embodiments, the method automatically selects the
`images based on a specified set of criteria. Some embodi-
`ments utilize numerical or statistical criteria, such as speci-
`fying numerical or percentage intervals in the set of images.
`Other embodiments utilize criteria based on the content ofthe
`
`images in the set. For instance, some embodiments select
`images in a video by identifying scene changes in the video
`and selecting images that occur before or after the scene
`changes. Some embodiments allow a user to adjust the set of
`selection criteria (e.g., allow a user to adjust the specified
`intervals for selecting images in the set of images), while
`other embodiments do not. In addition, some embodiments
`allow a user to select the images in the selected subset of
`images.
`After selecting the subset of images, the method concur-
`rently displays the images in the selected subset as the pre-
`view of the set of images. In some embodiments, the dis-
`played images are thumbnail versions of the images in the
`selected subset. FIG. 4 illustrates an example of such a dis-
`play. Specifically, it illustrates four icons 405-420 of four
`video presentations that are stored in a folder 425 entitled
`Videos. Each icon has a text component that provides the
`name of the video presentation associated with the icon.
`Each icon also has a graphical component that illustrates
`five images of five frames in the video presentation. In the
`embodiment illustrated in FIG. 4, the first image 430 is larger
`than the other four images. Also, the four smaller images
`435-450 are arranged in two rows that are to the right of the
`larger image. However, as further described below, other
`embodiments arrange the images differently, have other
`images appear larger, use the same size for all the images,
`and/or allow a user to select the arrangement or size of the
`images.
`In each icon 405-420, the order of the images is based on
`the order of the images in the icon’s corresponding video. In
`
`6
`this manner, the order ofthe displayed images is indicative of
`the order of the images in the video. The combination of an
`icon’s displayed images and the order for their display pro-
`vides a user with immediate information about the subject
`matter of the video presentation associated with the icon.
`Hence, by simply viewing a video’ s icon in FIG. 4, a user can
`immediately obtain information about the subject matter of
`the video.
`
`FIG. 4 provides just one example of some embodiments of
`the invention. Many other embodiments exist. For instance,
`multi-image icons can be used (1) by the GUI’ s of application
`programs (e.g., image and video editing applications) to dis-
`play multi-image content being organized, stored and/or
`edited by these programs, (2) by operating systems or appli-
`cations to display results of searches, etc. Moreover, as fur-
`ther described below in Section IV, some embodiments use
`the multi-image representation of a multi-image content not
`in the content’s associated icon but rather in a preview win-
`dow that opens when a user selects the icon. These alternative
`embodiments are further described in Sections III and IV. The
`
`multi-image preview is also shown in other GUI elements
`(such as buttons, other user-selectable GUI elements, etc.).
`Some embodiments provide a motion picture preview win-
`dow as part of the graphical component of an icon that rep-
`resents an image set, such as a video presentation. This win-
`dow allows a user to view a preview of the image set within
`the graphical component of the set’s icon. FIG. 5 illustrates
`one such approach. Specifically, it illustrates the video folder
`425 of FIG. 4 after a user has initiated a motion picture
`preview ofthe video presentation associated with icon 410. In
`the embodiment illustrated in FIG. 5, the five images of the
`icon 410 have collapsed into a single preview window 510,
`which is larger than the five images. The preview window 510
`provides a preview of the video presentation entitled Europe,
`as indicated by the playback bar 505 at the bottom of the
`window 510.
`
`Section V further describes an icon’s motion-picture pre-
`view window of some embodiments. This section also
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`describes playback control buttons and features that allow a
`user to direct the display in the preview window in some
`embodiments. This section further describes alternative
`
`45
`
`50
`
`55
`
`60
`
`65
`
`embodiments for a motion-picture preview icon. As further
`described below, some of these alternative embodiments
`implement the motion-picture preview icons in icons that are
`represented by only a single thumbnail image.
`Before describing additional embodiments in Sections III-
`V, several definitions are provided in Section II below.
`
`II. DEFINITIONS
`
`As used in this document, the terms image, thumbnail,
`icon, motion picture, and slide show have the following defi-
`nitions.
`
`An image is a picture, a drawing, a video frame, a video
`field, etc.
`Multi-image content is any content that includes two or
`more images that can be displayed in a sequence. Motion
`picture content
`is one example of multi-image content.
`Motion picture content is content that includes several images
`that are displayed in a sequence in order to provide the illu-
`sion of motion to a viewer (i.e., to provide the illusion to a
`viewer that objects appear to move in the images). Multi-
`image content incl