as) United States
`a2) Patent Application Publication co) Pub. No.: US 2013/0198602 Al
`
`(43) Pub. Date: Aug. 1, 2013
`Kokemohr
`
`US 20130198602A1
`
`(54)
`
`NARRATIVE-BASED MEDIA ORGANIZING
`SYSTEM FOR CONVERTING
`DIGITALMEDIA INTO PERSONAL STORY
`
`(75)
`
`Inventor: Nils Kokemohr, La Jolla, CA (US)
`
`(73)
`
`Assignee: NIK SOFTWARE,INC., San Diego,
`CA (US)
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`GO6F 17/24
`(52) U.S.CL
`CPC. vecesssssssssssssssnseeesssesseee GO6F 17/241 (2013.01)
`USPC ceesssssssssseessessssssssssssssssiveesseesessessssssen 715/233
`
`(2006.01)
`
`(21)
`
`Appl. No.:
`
`13/576,918
`
`(57)
`
`ABSTRACT
`
`PCT Filed:—Feb. 3, 2011
`(22)
`A computer system for a narrational media organizer for
`transforming digital media into a personal, memorable story
`with minimaluser input having a processor and storage with
`instructions for creating a narrational media organizer
`(NMO)environment, where a user can annotate one or more
`than onedigital media file or graphical representations of the
`digital media files using a user interface; and an NMO data
`structure for storing the digital media and annotations of the
`NMOenvironment.
`
`(86)
`
`PCT No.:
`
`PCT/US2011/023639
`
`§ 371 (©),
`(2), (4) Date:
`
`Feb. 21, 2013
`
`Related U.S. Application Data
`
`(60)
`
`Provisional application No. 61/301,142, filed on Feb.
`3, 2010.
`
`500
`
`Canon_01.25.2011
`
`
`
`‘add-text.4
`NESS
`
`‘export.
`N
`
`>!
`2
`
`1
`
`SAMSUNG 1034
`
`SAMSUNG 1034
`
`1
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 1 of 27
`
`US 2013/0198602 Al
`
`
`
`
`
`OD)
`
`/
`
`/
`
`08
`
`
`
`
`
`
`
`
`
`
`
`
`
`
` HDLIDO
`
`
`
`
`‘LILLE(Jb aeIL CO
`
`
`
`
`
`Vacation
`
`LILLIE
`Ooooo
`
`
`
`
`
`
`
`
`LILILILI
`Eee
`Soon
`BRERR
`
`
`
`
`
`
`
`
`
`
`
`
`
` |||| Roo
`
`
`
`
`
` =
`
`
`
`
`
`[ll
`
`rar ars
`
`
`OOOO / gposoo
`
`
`
`TODO, Deo
`WO
`«-, C001
`
`
`
`
`
`
`
`DODO ,oopnoo
`
`
`
`OOo - ooooo
`Pa eae af PSPS ape
`
`
`
`Figure 1
`
`2
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 2 of 27
`
`US 2013/0198602 Al
`
`200~\
`
`/
`
`2: Comment what you.
`forgot to capture:
`
`3: Comment unnumbered next:
`
`1: Comment a single image:f20:
`208ff
`
`20
`
`206
`
`210
`
`4 That was
`the house we
`stayedin - see
`that lake?
`
`(After this, aunt
`Maggie fell into
`the pond. Too
`bad the camera
`wasoffl)
`
`Next few,,
`images: Stands
`at the Stack-
`holm christmas
`market.
`
`epeeThat was the
`i
`mayor (and Bill
`had his finger
`up his nasel!!)
`
`4:Comment a detail:
`
`
`f5: Comment next numbered'set of images (paragraph)
`
`Day 3: Going Waterskiing
`
`HET
`
`Figure 2
`
`3
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 3 of 27
`
`US 2013/0198602 Al
`
`Canon_01.25.2011
`
`JI
`
`LL
`LL
`
`304
`
`400
`
`oN = f
`
`same on-screen
`
`height, such as 150
`pixels
`
`wee,aspect
`
`Figure 4
`
`4
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 4 of 27
`
`US 2013/0198602 Al
`
`500~\
`
`Canon_01.25.2011
`ew Paragraph
`
`LLL
`
`Figure 5
`
`600
`
`Canon_01.25.2011
`
`i N
`
`Figure 6
`
`5
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 5 of 27
`
`US 2013/0198602 Al
`
`702
`
`New Paragraph
`
`TL|Vt|jadd.text..:
`
`ALToon
`
`FILE
`ia
`
`Laura’s & my Vacation in Hawaii
`
`Day 2: Okura Waterfalls
`
`Figure 8
`
`6
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 6 of 27
`
`US 2013/0198602 Al
`
`900 i 906
`
`902
`
`Ain >
`
`Figure 9
`
`710
`
`904
`ftthd
`
`_ LILIL
`|||
`
`_“
`
`Laura’s & my Vacation in Hawaii
`
`Day 2: Okura Waterfalls
`
`Figure 10
`
`7
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 7 of 27
`
`US 2013/0198602 Al
`
`Laura's & my Vacation in Hawaii
`
`Day 2: Okura Waterfalls
`
`
`
`11”
`
`add text.NR
`
`
`
`Figure 11
`
`8
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 8 of 27
`
`US 2013/0198602 Al
`
`1202
`
`1204 1206 1208
`
`
`
`singlelmage|nextimages between2ples
`
`_» —
`
`
`
` This image was shat from behind the wa-
`
`1210
`
`terfall, that’s why it’s so foggy!
`
`1212
`
`4 This image was
`shotfrom behind
`the waterfall,
`that’s whyit’s so
`foggy!
`
`1214
`
`Figure 12
`
`1300 \
`
`1310
`
`1304
`
` 1308
`
`aura’s & my Vacation in Hawaii
`Our long-awaited vacation in 2010, can't believe we actuallydid it!
`
`1306
`
`4 This image was
`shot from behind
`the waterfall, that's
`whyit’s 50 foggy!
`
`~ —}- a smaket
`
`images taken bb
`bythe 3yr-old that
`“borrowed’the
`camera‘)
`
` Flo
`
`ic
`
`c
`
`3i
`
`went to Dan's
`party, but
`forgot the
`camera
`
`Day 2: Okura Waterfalls
`
`1302
`
`Figure 13
`
`9
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 9 of 27
`
`US 2013/0198602 Al
`
`1400
`
`Laura's & my Vacation in Hawaii
`Our long-awaited vacation in 2010, can’t believe we actuallydid it!
`
`This image was
`shot from behind
`the waterfall, that’s
`whyit’s so foggy!
`
`~}- asnake!
`
`went to Dan’s
`party, but
`forgot the
`camera
`
`Day 2: Okura Waterfalls
`
`images taken >>
`bythe 3yr-old that
`“borrowedthe
`camera ;-)
`
`1402
`
`1404
`
`Export Options
`
`Upload myStory to Facebook
`Print PDF
`
`Order Book
`
`Send eMail
`
`1406
`
`
`
`
`
` Laura’s & my Vacation in Hawaii
`
`Our long-awaited vacation in 2010, can’t believe we actually did it!
`
`1408
`
`img_001,jpg
`This image was
`shot from behind
`the waterfall, that’s
`whyit’s so fogay?
`
`went to Dan's
`party, but
`forgotthe
`camera
`
`img_008,jpg
`
`
`
`1412
`
`1410
`
`Figure 14
`
`10
`
`10
`
`

`

`Patent Application Publication
`
`Aug. 1, 2013 Sheet 10 of 27
`
`US 2013/0198602 Al
`
`1500
`
`1502
`
`Laura's & my Vacation in Hawaii
`Our long-awaited vacationin 2010,can’t believe we actually did it!
`
`a]
`
`&
`
`
`
`re
`
`
`
`S]
`
`4 This image was
`shotfrom behind
`the waterfalll, that’s
`whyIt's so foggy!
`
`
`
`
`
`camera ;-)
`
`
`oy:2snake!
`wentto Dan's
`party, but
`forgotthe
`camera
`
`
`
`Day 2: Okura Waterfalls
`
`images taken >>
`bythe 3yr-old that
`“borrowed”the
`
`1504
`
`1508
`
`1506
`
`
`
`
`
`BW.Style
`
`Brightness 60%
`
`Contrast 20%
`Structure 44%
`
`
`
`1514
`
`Figure 15
`
`11
`
`11
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 11 of 27
`
`US 2013/0198602 Al
`
`1600 \
`
`wowyrombehiad
`the waterfall, that’s
`whyIt’s sofoggy!
`
`rq)
`1602
`
`went to Dan's
`party, but
`forgot the
`camera
`
`Laura’s & my Vacation in Hawaii
`Ourlong-awaited vacationin 2010, can’t believe we actually did it!
`
`camera ;-)
`- CT|tf 1704
`
`Day 2: Okura Waterfalls
`
`images taken DP
`by the 3yr-oldthat
`“borrowed”the
`
`Figure 16
`
`Figure 17
`
`12
`
`12
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 12 of 27
`
`US 2013/0198602 Al
`
`1800 ~\
`
`<www.b\ogs.com/myvacation> 1804
`
`MyVacation
`
`1802
`
`social
`this post
`
`Media descriptor text for
`/ for this tweet plus link:
`
`Laura's&myVacationin A
`
`Ourlong-awaited vacation in 2010, can’t believe we actually did itt
`
`4 This image was
`shot from behind
`the waterfall,
`that's whyit’s so
`foggy!
`
`-asnaket
`
`went to Dar’s
`party, but
`forgot the
`
`camera
`
`Day 2: Okura Waterfalls
`
`images taken D>
`by the 3yr-old
`that “borrowed”
`the camera ;-)
`
`Figure 18
`
`1900 \
`
`
`
`1902
`
`1904
`
`1906
`
`1908
`
`Figure 19
`
`13
`
`13
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 13 of 27
`
`US 2013/0198602 Al
`
`200
`
`<Story01>
`<element:01>
`<element:03>
`<element:04>
`
`2002 2006
`
`</StaryO1>
`
`Figure 20
`
`2100
`
`<HEADER>
`
`<Default Filter: Black&White>, <StoryStyle: Vintage04>
`
`Figure 21
`
`14
`
`14
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 14 of 27
`
`US 2013/0198602 Al
`
`: mailed to suzie@... 2202
`
`} original
`; book Jan 12th
`? mailed to frank@...
`
`2206
`
`Figure 22
`
`230
`
`2306,
`
`2300
`
`~
`
`2304
`
`movepics
`
`!
`!
`l
`
`!
`!
`|
`
`:
`'
`|
`
`
`
`
`
`enecensennnne Descriptive Text for
`these 2 images
`
`--~--- Descriptive Text
`for this image
`
`7
`
`Figure 23
`
`15
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 15 of 27
`
`US 2013/0198602 Al
`
`2308
`
`<Story>
`<Header>"Paragraph Headline: Day 1</Header>
`<image> IMG_0025.JPG, unused </image>
`<image> IMG_0026.JPG, unused </image>
`<image> IMG_0027.JPG, used, [ky=180/220], filter=Sepia, </image>
`<cmt> “CommentText’, [xy=190/250] IMG_0025.JPG </emt>
`
`</Story>
`
`Figure 23 (CONT.)
`
`2404
`
`2AO
`
`text text text text text
`text text text text text
`text text text text text
`text text text text text
`text text image detail
`text text text text text
`text text text text text
`text text text text text
`text image
`text text text text text
`text text text text text
`text some images —_
`
`Headline
`
`text text text text text
`text text text text text
`text text text text
`
`
`
`eM ll [lee ped
`
`2408
`
`Figure 24
`
`16
`
`16
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 160f27
`
`US 2013/0198602 Al
`
`—
`
`Day 1: Fun in the Hotel
`
`
`
`Figure 25
`
`——
`
`2602
`
`AN
`
`o
`lid
`Laura's & my Vacation in Hawaii
`
`long-awaited vacation in 2010,can'tbelieve weactu:
`
`Figure 26
`
`2502
`
`2504
`
`17
`
`17
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 17 of 27
`
`US 2013/0198602 Al
`
`270
`
`Conventional Photo Book Creation
`
`NMO-Environment Book Creation
`
`Commitment Cycle
`
`CommitmentCycle
`
`committo invest Thr
`to create book
`
`committo booktype,
`page count, etc.
`
`narrate story while
`layouting book
`
`add single comment
`.
`instances
`
`see story grow
`
`push button to
`preview book
`
`used for future outputs
`
`story has been narrated fora
`single print instance
`
`book was created + story can be
`
`Figure 27
`
`18
`
`18
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 18 of 27
`
`US 2013/0198602 Al
`
`_
`
`Figure
`
`/\ A
`
`/*B
`
`Arrival in Hawai
`
` Spf
`
`Figure 28
`
`19
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 19 of 27
`
`US 2013/0198602 Al
`
`2900 ~\
`
`2904
`
`2902
`
`2906
`
`Album/Blog Preview Mode / on Screen
`Preview NMO Enviroment.
`
`
`
`Pelee ce Ea eelcof.
`
`NMO Environment / on Screen
`
`OW Second Vacation Day
`
`
`
`L aes User Edits
`
`User Edits
`
`2908
`
`2910 Printed Album / Published Blog
`
`2912
`
`Figure 29
`
`20
`
`20
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 20 of 27
`
`US 2013/0198602 Al
`
`Private Environment
`Our SecandVacation Day
`
`
`
`3004
`
`3006
`
`‘CommunityPost / Tweet
`
`Preview Virtual Book Online & Order
`
`My Vacation!
`hey guys, check out our
`great honeymoonvaca-
`tion. Click on the book to
`‘filo through the pages.
`
`\
`
`~
`Figure 30
`vA
`3100 \
`
`
`
`order hardcopy
`
`K
`
`3102
`
`3010
`
`aS, 4
`
`aq Private Environment
`
`3104
`
`3106
`
`\
`
`‘
`
`4
`
`s
`a
`
`Community Post / Tweet
`
`Preview (3D) Merchandize Online &
`
`My Photo Gadget!
`hey guys, check outthis
`great photo merchandize
`that we made asa follow-
`
`
`
`— (Ss)
`
`meee eee 7
`
`order gadget
`
`Figure 31
`
`21
`
`(a)
`
`3108
`
`21
`
`

`

`Patent Application Publication
`
`Aug. 1, 2013 Sheet 21 of 27
`
`US 2013/0198602 Al
`
`3200
`
`Headline of Paragraph
`
`
`
`A Type 3 comment
`
`A regular image having the
`image number11 and having a
`type 2 comment.
`
`An imagethat is marked
`as,,favourite” in the main
`NMOenvironment
`
`A cell having the
`cell number 18
`
`Figure 32
`
`22
`
`22
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 22 of 27
`
`US 2013/0198602 Al
`
`3300 \
`
`ATbum#
`
`NikVault™™ Image Safe:
`Alkimages in:this:book-and related: images can be retrieved
`forthe next 99-years-the-following ways:
`Methis rid:chip:
`38this code:
`PasG
`:
`oe
`thi
`SB this:uush stick:
`
`AA58-USG2- 0014-ABFG- GULL
`Give Ut on ays
`badeadtevurcoank-cy8
`
`SSthis dvd
`
`
`
`Sm these stickers:
`
`Figure 33
`
`3400 _)
`
`Our Second Vacation Day
`
`
`
`
`Our Second Vacation Day
`
`Figure 34
`
`23
`
`23
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 23 of 27
`
`US 2013/0198602 Al
`
`3500 \
`
`i
`srondoceccenecccanancnacsnnnnccccanecccanencccosmcccccccnromemnnarcnsrecconscoesrccoreccnccos y=0
`‘Laura’s & my Vacation in Ha-
`ii
`four long-awaited vacation in 2010, can’t believe we actually did it!
`
` 4 This image
`was shot from
`
`behind the wa-
`terfall that’s why
`it's so foggy!
`
`
`
`x=W
`t
`
`iiii
`i
`it
`Ss
`Be
`a
`
`
`
`
`
`
`wentto Dan’s
`party, but
`forgot
`ames
`
`1
`i
`
`a
`
`3502
`
`Ss
`
`set P to Px =0, Py =h
`
`receive first object of NMO objects
`p
`
`no more NMOobjects?|—» no J
`f \
`“ placeNMOobjectatP
`
`receive next object of NMO objects
`
`if (NMO object)=headline
`
`no
`
`J
`Px =p.x + width(NMO object) +a
`
`Px =0;Py=Py+h
`
`no
`
`Ve
`
`yes
`
`Py=py+th
`
`Figure 35
`
`24
`
`24
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 24 of 27
`
`US 2013/0198602 Al
`
`——
`
`3602
`
`sion meds
`
`3614
`
`3616
`
`3618
`
`
`
`aA
`
`
`
`
`
`3610
`
`3612
`
`©
`
`oO
`
`@O
`
`st
`
`db
`
`db
`
`3606
`
`3608
`
`Figure 36
`
`25
`
`25
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 25 of 27
`
`US 2013/0198602 Al
`
`i
`
`
`
`
`
`|||| 3700a
`
`~~ IU
`
`
`spe ET Paragraph 2
`Style:
`(Sepia.
`PILILIL
`ii|]= Paragraph 3
`0sCoOoco
`|
`
`
`
`Style:
`
`3708
`
`CoDoCo.
`—Ce
`HP= Paragraph 3Sooooo
`
`
`
`EL
`
`Figure 37
`
`26
`
`26
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 26 of 27
`
`US 2013/0198602 Al
`
`~~
`
`Paragraph
`PLLLL
`||
`Paragraph
`PL
`PPL
`
`OO
`
`-o
`Figure 38
`
`~ F
`
`igure 39
`
`27
`
`27
`
`

`

`Patent Application Publication
`
`Aug. 1,2013 Sheet 27 of 27
`
`US 2013/0198602 Al
`
`400
`
`Search Results
`
`
`
`showentire paragraph
`First Paragraph
`
`
`4 text text text
`
`text text] Aunt
`
`
`text text text
`
`eee
`
`- text text text
`
`text text
`Aunt
`
`
`text text text
`
`
`
`
`
`Seventh Paragraph
`
`texttext text >>
`
` text text
`Aunt
`
`
`text
`
`Figure 40
`
`28
`
`28
`
`

`

`US 2013/0198602 Al
`
`Aug. 1, 2013
`
`NARRATIVE-BASED MEDIA ORGANIZING
`SYSTEM FOR CONVERTING
`DIGITALMEDIA INTO PERSONAL STORY
`
`RELATED APPLICATIONS
`
`[0001] The present PCT Application claims the benefit of
`US. provisional patent application 61/301,142,
`titled
`“Method and Application to Transform a Set of Images into a
`PersonalStory,” filed Feb. 3, 2010, the contents of which are
`incorporated in this disclosure by reference in their entirety.
`
`FIELD
`
`[0002] This present invention is related to digital media
`manipulation and more specifically to a computer system for
`a narrational media organizing (NMO)system for transform-
`ing digital media into a personal, memorable story with mini-
`mal user input.
`
`BACKGROUND
`
`[0003] A picture may be worth a thousand words, but with-
`out any context, the words portrayedin the picture are mean-
`ingless. Current digital media applications allow a user to
`comment, tag, sort, re-arrange, group andlabel digital media,
`such as, for example, Adobe® Photoshop® Elements, flickr.
`com, Phanfare, Apple® iPhoto®, youtube.com, etc. How-
`ever, research showsthat user satisfaction is low with these
`applications, because too much user interaction is needed.
`Rarely do users label and categorize all oftheir digital media.
`Further, memories of the events captured in the digital media
`can becomelost due to the inability to quickly and easily
`document
`the narrative of the events. For example,
`Microsoft® Photo Story 3.0, due to its non-narrative user
`experience, and canned templates for a photo album with
`some standard digital media editing functionality. Also,
`applications such as Adobe Bridge, Google Picasa, Apple®
`iPhoto®, and the embedded digital media and media organi-
`zation tools in AppleOS® and Microsoft® Windows only
`allow difficult, time consuming user interaction to personal-
`ized the digital media in a meaningful way.
`[0004] Therefore, there is a need fora system for transform-
`ing digital media into a personal, memorable story with mini-
`mal user input.
`
`SUMMARY
`
`[0005] A computer system for a narrational media orga-
`nizer for transforming digital media into a personal, memo-
`rable story with minimaluser input, the system comprising:a)
`one or more than one processor; b) a machine readable stor-
`age connected to the one or more than oneprocessor; c) a set
`of machine readable instructions stored in the machine read-
`
`able storage and operable on the one or more than onepro-
`cessor for creating a narrational media organizer environ-
`ment, where the instructions enable a user to annotate one or
`more than one digital media file, where the one or more than
`one digital mediafiles are displayed as graphical representa-
`tions of each of the digital media files; d) a user interface
`operably connected to the set of computer instructions for
`transmitting one or more than one commandto the micropro-
`cessor; e) an NMOdata structure operably connected to the
`computer instructions and the user interface for storing the
`digital media and annotations; and f) a storage operably con-
`nected to the microprocessorfor storing the narrational media
`organizer environmentdata structure. The computer instruc-
`
`tions further comprises instructions to receive textual anno-
`tations from the user and to place a graphical instance of the
`textual annotations between the graphical representations of
`the digital media representations; instructions to receive input
`from the user that construct a paragraph within the NMO
`environment; instructions to receive input from the user to
`exclude one or more than one digital media from the NMO
`environment, thereby making space available for the remain-
`der of the digital media collection. The computer instructions
`further comprises instructions for cropping one or more than
`one digital media within the NMO environmentandinstruc-
`tionsfor rescaling the digital media preview andto rearrange,
`if necessary, subsequent digital media in the NMOenviron-
`ment.
`
`In another embodiment, the computer instructions
`[0006]
`for receiving textual annotations from the user further com-
`prises instructions to receive annotations related to contents
`of a following numbered or unnumberedseries of digital
`media; instructions to receive a paragraph headline annota-
`tion related to the contents of a following section of digital
`media.
`
`In another embodiment, the computer instructions
`[0007]
`further comprises instructions to re-included a digital media
`file in the NMOenvironment; instructions for excluding the
`excluded digital media in an NMO output. The computer
`instructions for receiving textual annotations from the user
`further comprises instructions to receive annotations that
`relate to an event that occurred between two digital media, the
`contents of a single digital media and to one or more than one
`detail within the digital media.
`[0008]
`Inone embodiment, the excludeddigital mediafiles
`are represented in a form that requiresless display space in the
`NMO environment. The instructions further comprises
`instructions for the creation of a paragraph using an input
`device, a gesture or both an input device and a gesture,
`thereby, adding space betweenthe digital media in the form of
`a new paragraph. The creation of a new paragraph also
`includes adding space in the NMOenvironmentfor a head-
`line. The gesture is performed by the user by taking the
`graphical representation of the digital media with a pointing
`device and dragging it down.
`comprises
`further
`[0009] The
`computer
`instructions
`instructions to reposition a cursor between the graphical rep-
`resentation of the digital media. The cursor position can be
`controlled by arrow keys, keyboard key combinations, or by
`a pointing device, or the return key to create a paragraph, and
`thereby movethe digital media subsequentto the cursor posi-
`tion to be moved down and form a new paragraph. The cre-
`ation of a new paragraph also includes adding space in the
`NMOenvironmentfor a headline. The user has control over
`
`the cursor positioned between digital media, where the posi-
`tion ofthe cursor can be controlled by the user to add a textual
`input by the user; wherethe textual input will trigger instruc-
`tions to the NMO environmentto receive the textual input as
`an annotation andplace it at the position of the cursor.
`[0010]
`In another embodiment, the computer instructions
`further comprises instructions to present a user interface
`menuoption for switching betweena first mode and a second
`mode, where the first mode is suitable to review the digital
`media collection with the current status of annotations, and
`the second modeis suitable to receive annotations or digital
`media exclusion information from the user.
`
`In another embodiment, there is provided a data
`[0011]
`structure, where the data structure comprises: a) one or more
`
`29
`
`29
`
`

`

`US 2013/0198602 Al
`
`Aug. 1, 2013
`
`The presented collection is transformed into smaller resolu-
`than onefields for storing a list of digital media elements
`tion versionsofthe original digital media. The methodfurther
`information; b) one or more than onefields for storing anno-
`comprises the step of uploading, emailing, or both uploading
`tation information; and c) one or more than onefields for
`and emailing the smaller resolution versions of the digital
`storing paragraph information. The annotation information
`media and adding a link to an internet accessible data store
`comprises a data field for storing the type of the annotation,
`comprising the original digital media.
`wherethe data field also comprises a hyperlink field suitable
`to link the annotation to one or more than onedigital media
`[0014]
`Inone embodimentthere is provided a methodfor a
`parameters. The digital media parameters are selected from
`narrational media organizer for transforming digital media
`the group comprising a digital media detail, a series of digital
`into a personal, memorable story with minimaluserinput, the
`mediafiles and a single digital media file. The one or more
`method comprising the steps of: a) providing a user menu
`than one digital media information field comprises actual
`where the user can choose from a list of NMO outputs; b)
`digital media data, a storage location ofthe digital media data,
`providing at least one algorithm suitable to interpret a data
`or both the actual digital media data and the storage location
`structure representing digital media and one or more than one
`ofthe digital media data; a markerto indicate the exclusion of
`annotation type and suitable to generate at one or more than
`the digital media from the NMO output; a markerto indicate
`one NMOoutputs based on the same data structure; and c)
`whetheror notthe digital media will be printedat a largersize
`outputting the NMO data structure to a physical format, a
`in the NMOoutput. The data structure further comprises a
`virtual format, or both a physical and virtual format. The
`secondlist of digital media elements where the secondlist is
`NMOoutputis selected from the group comprising a slide-
`created when a user triggers the system to output an NMO
`show, a web page,a video representing a slide show, a PDF, a
`output. The user can choose between more than onelists
`photo book, or a printed photo collection, and an email with
`related to one digital media collection. The one or more than
`contents of text and digital media suitable to represent the
`onelist represent different versions ofa user narrated story for
`story created in the NMO environment. The method further
`the digital media collection. The data structure comprises a
`comprises the step of applying a graphical style to the digital
`first list anda secondlist, wherethefirst list and the secondlist
`media, where the style can change parameters of the dis-
`comprise one or more ofthe following: a) digital media; and
`played digital media. The style can comprise one or more than
`b) a reference to digital media data. Thefirst list is a list of
`one of the following: a) a digital media filter to the digital
`elements pointing to elements in the secondlist, and where
`media; b) a background graphic behindthe digital media; c) a
`the first or the secondlist contain information or pointers to
`text style of the textual annotations; d) a spatial arrangement;
`information to annotations and information regarding the
`and e)alayoutstyle ofthe digital media and annotations. The
`type of the annotation, the information being suitable to link
`style can be applied to a selection of the digital media, to a
`the annotation to one or more than one of the following: A
`paragraph ofthe digital media,orto all of the digital media.
`digital media detail, a series of digital media, a digital media.
`The method further comprises the step of outputting the
`NMOenvironment with the applied style.
`[0012]
`In one embodimentthere is a system for a narra-
`tional media organizer for transforming digital media into a
`[0015]
`In one embodimentthere is provided a methodfor a
`personal, memorable story with minimaluser input, the sys-
`narrational media organizer for transforming digital media
`tem comprising: a display of digital media and narration as a
`into a personal, memorable story with minimaluserinput, the
`sequence of icons of digital media and other elements, the
`method comprising the steps of: a) generating an NMO out-
`display comprising: an algorithm suitable to displayall digi-
`put; b) uploading the NMO outputto a publicly accessible
`tal media initially at same on-screen height; an algorithm to
`digital storage; c) uploading the NMO output to a web com-
`display comments in-between the digital media; graphical
`munity.
`marks to indicate different types of narrational annotations;
`In one embodimentthere is a system for a narra-
`[0016]
`and vertical spatial inserts between the digital media chosen
`tional media organizer for transforming digital media into a
`by the user to indicate that a section or paragraph is to be
`personal, memorable story with minimaluser input, the sys-
`displayedat this location, leaving room for a paragraph head-
`tem comprising: a) means for generating an NMO output; b)
`line at this location. The size of a selection of the displayed
`meansfor uploading the NMO output to a publicly accessible
`digital media can be increased to emphasize the selected
`digital storage; and c) means for uploading a hyperlink to the
`digital media. One or more than one of the displayed digital
`NMOoutput to a web community. The hyperlink further
`media comprises a flag to emphasize the displayed digital
`comprisesa title for a story created in the NMO environment.
`media. The system further comprises means for generating
`The NMOoutput further comprises an icon representing the
`NMOoutput, where the emphasized digital media are dis-
`story, and a hyperlink from the web community to the pub-
`played in a larger size; means where the emphasized digital
`licly accessible digital storage. The method further comprises
`media are displayed on a dedicated page; and means where
`the step of non-destructive exclusion of one or more than one
`the emphasizeddigital media are displayed with an animated
`of the digital media, where the step of non-destructive exclu-
`presentation.
`sion is performed by clicking on an icon superimposed on
`[0013]
`In one embodimentthere is provided a methodfor a
`each of the digital media, thereby minimizing the digital
`narrational media organizer for transforming digital media
`media and where the minimized digital media can be repre-
`into a personal, memorable story with minimaluserinput, the
`sented by a smaller version of the digital media. The mini-
`method comprising the steps of: a) presenting to the user a
`mized digital media can be represented by an icon that is
`collection of digital media; b) receiving one or more than one
`displayed at the location of the digital media. The step of
`different types of digital media annotations; c) receiving a
`non-destructive exclusion is performed byinitially display-
`selection to exclude digital media from the digital media
`ing the digital media on a side bar, top bar or gutter, and then
`narration; and d) producing graphics that comprise both one
`selecting and positioning each selected digital media on a
`or more versionsofthe digital media and digital media anno-
`large space suitable to receive and arrangetheselected digital
`tations that are suitable to be uploaded or mailed or shared.
`media and annotations. The step ofnon-destructive exclusion
`
`30
`
`30
`
`

`

`US 2013/0198602 Al
`
`Aug. 1, 2013
`
`is performed by initially displaying the digital media in a
`sequenceand providinga side bar, top bar or gutter where the
`user can move the digital media to be excluded from the
`narration.
`
`In one embodiment, there is provided a method for
`[0017]
`a narrational media organizer for transforming digital media
`into a personal, memorable story with minimaluserinput, the
`method comprising the steps of: a) combining two or more
`different digital media collections of one or more than one
`event from two or more contributing users; b) providing an
`algorithm suitable to combine the different digital media
`collections into a single NMO environment; c) editing the
`single NMO environment by two or more users; and d) out-
`putting a single NMO output to the two or more users. The
`combined data collection comprises at least two different
`annotation types. The excludeddigital media in one ofthe two
`or more different digital media collections are not combined
`in the single NMO environment. The method further com-
`prises the step of granting permissions to a non-contributing
`user that did not provide any of the digital media, where the
`non-contributing user can add annotationsto the digitalNUO
`environment, and where the contributing users can add the
`non-contributing user’s annotations into each of the two or
`more different digital media collections.
`[0018]
`In one embodiment, there is provided a method for
`a narrational media organizer for transforming digital media
`into a personal, memorable story with minimaluserinput, the
`method comprisingthe steps of: a) providing a standard NMO
`environment; b) providing a preview NMOenvironment; c)
`non-destructively excluding digital media from the NMO
`environment; d) including at least two different annotation
`types; e) automatically creating an NMOoutput; f) providing
`a preview to a user of the NMOoutput on a display within a
`preview NMOenvironment; g) editing annotations within the
`NMOoutput preview on the display; h) updating the NMO
`output preview; 1) updating the NMOdata structure; j) updat-
`ing the displayed contents in the NMO environment; k) out-
`putting from the NMO environment; and 1) providing an
`output creation algorithm for outputting data stored in the
`NMOenvironment. The algorithm is operable to transform
`the NMOoutput to a hardcopy format of the NMO environ-
`ment; to output to a digital copy of the hardcopy, where the
`digital copy can be accessed and previewedusing the Internet.
`The digital copy can be ordered as a hardcopy of the NMO
`output.
`In one embodiment, there is provided a method for
`[0019]
`a narrational media organizer for transforming digital media
`into a personal, memorable story with minimaluserinput, the
`method comprising the steps of: a) creating an NMO output;
`b) providing an NMOoutput creation algorithm, where the
`algorithm is operable to output a hardcopy of an NMO output,
`a digital copy of the NMOoutput, or both a hardcopy and a
`digital copy of the NMO output; c) uploadingthe digital copy
`to a web community or a public forum; and d) providing a
`meansfor ordering a hardcopy of the NMO output hardcopy.
`[0020]
`In one embodiment, there is provided a method for
`a narrational media organizer for transforming digital media
`into a personal, memorable story with minimaluserinput, the
`method comprising the steps of: a) providing one or more
`than one digital media files; b) adding annotations to the one
`or more than one digital media files; c) non-destructively
`excluding one or more than oneofthe digital media files from
`being output within an NMO environment; d) providing an
`algorithm suitable to produce a hardcopy of the NMOenvi-
`
`ronment; and e) providing an algorithm suitable to produce a
`virtual copy of the NMO environment. The method further
`comprises the steps of providing a selector of at least two
`different NMO output types and providing access to the vir-
`tual copy of the NMO environment. The hardcopyis selected
`from the group consisting of a printed journal, a photo book,
`a calendar, a series of printed digital media with or without
`annotations, a scrapbook and a family history. The access to
`the virtual copy of the NMO environment comprises a physi-
`cal data storage including data ofdigital media not included in
`the NMOoutput, a code, a web link, a password to access a
`website, an authentication code suitable to authenticate the
`ownerofthe NMOoutput hardcopyto retain the digital media
`data from a manufacturer of an NMO output hardcopy, from
`the provider of the NMO environment software, or from a
`third trusted company.
`[0021]
`In one embodiment, there is provided a computer
`system for a narrational media organizer for transforming
`digital media into a personal, memorable story with minimal
`user input, the system comprising: a) one or more than one
`processor; b) a machine readable storage connected to the one
`or more than one processor; c) a set of machine readable
`instructions stored in the machine readable storage and oper-
`able on the one or more than one processor for creating a
`narrational media organizer environment, wherethe instruc-
`tions enable a user to annotate one or more than one digital
`mediafile, where the one or more than one digital mediafiles
`are displayed as graphical representations of each ofthe digi-
`tal media files; d) a user interface operably connected to the
`set of computerinstructions for transmitting one or more than
`one commandto the microprocessor; e) an NMOdata struc-
`ture operably connected to the computer instructions and the
`user interface for storing the digital media and annotations;
`and f) a storage operably connected to the microprocessor for
`storing the narrational media organizer environment data
`structure. The computer
`instructions further comprises
`instructions for displaying a selection of the narrational
`media organizer on a graphical representation of the one or
`more than one digi