1111111111111111 IIIIII IIIII 1111111111 11111 11111 11111 111111111111111 111111111111111 11111111
`US 20130004138Al
`
`c19) United States
`c12) Patent Application Publication
`Kilar et al.
`
`c10) Pub. No.: US 2013/0004138 Al
`Jan. 3, 2013
`(43) Pub. Date:
`
`(54) COMMENTING CORRELATED TO
`TEMPORAL POINT OF VIDEO DATA
`
`(75)
`
`Inventors: Jason A. Kilar, Santa Monica, CA (US);
`Betina J. Chan-Martin, Encino, CA
`(US); Bradley J. Suter, Santa Monnica,
`CA (US); Gavin F. Hewitt, Marina de!
`Rey, CA (US); Damon A. Young,
`Thousand Oaks, CA (US); Arash
`Nikkar, La Crescenta, CA (US); Arthur
`Switalski, San Carlos, CA (US);
`Richard W. Tom, Marina de! Rey, CA
`(US); Haisheng Wu, Beijing (CN);
`Yingan Wang, Beijing (CN); Eugene
`Wei, San Francisco, CA (US)
`
`(73) Assignee: HULU LLC, Los Angeles, CA (US)
`
`(21) Appl. No.: 13/431,952
`
`(22) Filed:
`
`Mar. 27, 2012
`
`Related U.S. Application Data
`
`(60) Provisional application No. 61/503,536, filed on Jun.
`30, 2011.
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`H04N5/775
`G06F 17100
`(52) U.S. Cl.
`
`(2006.01)
`(2006.01)
`386/230; 715/205; 386/E05.07
`
`(57)
`
`ABSTRACT
`
`Commenting tied to user-selected times during play of audio/
`video content is enabled by a computer system. An apparatus
`detects a time that input of user comment data is received
`during playback of audio/video content on an electronic dis(cid:173)
`play device. The apparatus determines a temporal point rela(cid:173)
`tive to the playback of the audio/video content correlated to
`the user comment data, based on the time. The apparatus
`transmits the user comment data correlated to identifiers for
`the audio-video content and the temporal point to a computer
`server. The server may configure the video data for publishing
`on a website so that the comment data is displayed for a
`limited period based on the temporal point. Users may
`thereby conveniently record audio or textual comments that
`are output during subsequent play of the audio/video content,
`for sharing with friends and others.
`
`input
`L"'mvice
`
`CtH"St'1f
`G0rJr0l
`
`(.-200
`-------~-----J __
`
`Ct) r-n ffnin~ttJt~z-w:
`1nterhie~t
`
`Main
`&-kHnary
`214
`
`110%1
`212
`
`Storage
`~vk~~
`
`---- ------- ----- --- ----. ------ - -- ~
`
`Exhibit 1012
`MG Freesites v. Scorpcast
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 1 of 21
`
`US 2013/0004138 Al
`
`100
`
`r·::.1biet / E.~·R~~ilt~~r
`[J~\t}(:8
`
`FIG. 1
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 2 of 21
`
`US 2013/0004138 Al
`
`-· ~ -· -~ -
`
`·- -· - -· -
`
`-
`
`/-~- 200
`I
`- ~ .J·
`
`FIG. 2
`
`

`

`Patent Application Publication
`
`Jan.3,2013 Sheet 3 of 21
`
`US 2013/0004138 Al
`
`)'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.~!
`
`l
`Ri1:~11iving Funtibn 306
`:!
`:i. ................................ ~~························==·······f.
`
`FIG. 3
`
`

`

`Patent Application Publication
`
`Jan.3,2013 Sheet 4 of 21
`
`US 2013/0004138 Al
`
`/""406
`
`.................................
`
`~
`
`408'"""
`................................. _ ............. ,
`.....
`413
`.2:(lS.~s-r
`4.t1~4·, ~
`1 ·i :'.:41.:.32 ~
`~;::;::;,i~~;::;::~r.1/r:::~;;:;;::;,:;;::~~~~r-¾"<:;; ., t;~:;~:,;::;::~:,~;;;.r.:;m".'.~;::wrr-:~Jx:;:;:;;,;::;::~i1:,i~ti~-f;:::;~~~~~~~r~-
`t
`,-~-~412
`l t
`416 ~j
`
`..
`
`"'414
`
`'•
`
`• '--.410 415
`
`....... f~H1~r~········I
`
`FIG. 4
`
`

`

`Patent Application Publication
`
`Jan.3,2013 Sheet 5 of 21
`
`US 2013/0004138 Al
`
`FIG. 5
`
`

`

`Patent Application Publication
`
`Jan.3,2013 Sheet 6 of 21
`
`US 2013/0004138 Al
`
`✓---402
`
`,..--400
`l
`
`trna.<ie Dhrtiht\i
`404_ . ·,
`
`---426
`/~
`
`408
`
`!l 1 :41 :32 ] ;;t:05~~l1
`====~h~~~~~~~~~¼,~~~~~
`
`''-..., 410
`
`,....--,A18
`t'
`
`FIG. 6
`
`

`

`Patent Application Publication
`
`Jan.3,2013
`
`Sheet 7 of 21
`
`US 2013/0004138 Al
`
`700 '"'\
`t'
`
`,r' 708
`L
`~
`~
`~
`~
`P1~l1:~ist1 z::orr~rrfu1}lt -~~--jth S❖-~1•cJ~1til Porlk.)r}
`~
`~
`~
`~
`
`,.,,,,,,,,,,,,,,,,,,.,,,,,,,,,,.,,,,,,,,,,.,,,,,,,,,,,,,,,,,,.,,,,,,,,,,.,,,,,,,,,,.,,,,,,,,,,.,,,,,,,.,,,,,,,,,,
`
`FIG. 7
`
`h)~Jtit CtJrnn~)~1t Rt~h~\tant to
`Sh:-it~tt(xi Porfam -of M❖tfa1 fllB
`
`806
`
`FIG. 8
`
`

`

`Patent Application Publication
`
`Jan.3,2013 Sheet 8 of 21
`
`US 2013/0004138 Al
`
`404
`
`406
`
`+
`416~/
`
`" " ..
`
`318
`
`FIG. 9
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 9 of 21
`
`US 2013/0004138 Al
`
`FIG. 10
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 10 of 21
`
`US 2013/0004138 Al
`
`..
`/"' 400
`-,w402
`/
`"'"""""""""""""""""""""""""""""""""""""""""""" /\ '"""""""""""""""""""""""""""""""""""""""""""""""""""" .
`f
`"'"'""'"""""'""'"""""'""'""""""'"'""""""'"'"""' ,:: """"'""'"'""""""'"'""""""'"'""""""'"'""""""'"'"""'""""'
`
`404
`
`"'""""""'""'"""""'""'"""""'""'"""""'""'"""""'""'"""""'""'""'"""""'""'"""""'""'"""""'""'" """~ '
`~?J}f.~::Jt
`
`406
`
`408"""
`
`,,,·-·440
`l
`
`•----- 444a
`•-'""· 444b
`(cid:141)--"-
`444c
`
`.. - - 318
`
`~
`
`H. (:-, <:'u,,,J, -~ <>,::,_,-~ ,-.-..nd\n,"
`.:....l~ -O'i,..~':v-~" -..~ .;...:~~~ ~s~,;,,.. .. ,~~·~
`:-
`Chrk: \""otfr~ sucl1 -tl g)i~@.--·nt:1n
`~-:1ti.rt~t}ft: L tiVi
`
`,. .. •
`
`FIG. 11
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 11 of 21
`
`US 2013/0004138 Al
`
`120~
`
`r121 o
`
`DETECTING A TIME THAT INPUT OF USER
`COMMENT DATA IS RECEIVED DURING
`PLAYBACK OF AUDIONIDEO CONTENT ON AN
`ELECTRONIC DISPLAY DEVICE
`
`DETERMINING A TEMPORAL POINT RELATIVE
`TO THE PLAYBACK OF THE AUDIONIDEO
`CONTENT CORRELATED TO THE USER
`COMMENT DATA, BASED ON THE TIME
`
`n
`
`r1230
`
`TRANSMITTING THE USER COMMENT DATA
`CORRELATED TO IDENTIFIERS FOR THE AUDIO(cid:173)
`VIDEO CONTENT AND THE TEMPORAL POINT TO
`A COMPUTER SERVER
`
`FIG. 12
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 12 of 21
`
`US 2013/0004138 Al
`
`FIG. 13
`
`130~
`
`1310
`~
`
`RECEIVING THE USER INPUT FROM A USER
`INPUT DEVICE LOCAL TO THE ELECTRONIC
`DISPLAY DEVICE
`
`,,
`
`r1320
`
`DETECTING USER INPUT OF THE USER
`COMMENT DATA
`
`140~
`
`FIG. 14
`
`1410
`~
`
`IDENTIFYING A SOURCE IDENTIFIER FOR THE
`USER INPUT DATA, AND TRANSMITTING THE
`SOURCE IDENTIFIER TO THE COMPUTER
`SERVER
`
`, .
`
`r1420
`
`IDENTIFYING A WEBSITE AND DESTINATION
`USER ACCOUNT AS A PROSPECTIVE
`PUBLICATION SITE OF THE USER COMMENT
`DATA, BASED ON FURTHER USER INPUT
`
`, .
`
`r1430
`
`TRANSMITTING INFORMATION IDENTIFYING THE
`PROSPECTIVE PUBLICATION SITE OF THE USER
`COMMENT DATA TO THE COMPUTER SERVER
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 13 of 21
`
`US 2013/0004138 Al
`
`1500
`
`~ (1502
`DETECTING A TIME THAT -
`
`COMPONENT FOR
`
`INPUT OF USER COMMENT
`DATA IS RECEIVED DURING
`PLAYBACK OF AUDIO/VIDEO
`CONTENT ON AN
`ELECTRONIC DISPLAY
`DEVICE
`
`Lr-1515
`
`r 1504
`
`-
`
`COMPONENT FOR
`DETERMINING A TEMPORAL
`POINT RELATIVE TO THE
`PLAYBACK OF THE AUDIO/
`VIDEO CONTENT CORRELATED
`TO THE USER COMMENT DATA,
`BASED ON THE TIME
`
`(1506
`
`COMPONENT FOR
`TRANSMITTING THE USER
`COMMENT DATA
`CORRELA TED TO
`IDENTIFIERS FOR THE AUDIO-
`VIDEO CONTENT AND THE
`TEMPORAL POINT TO A
`COMPUTER SERVER
`
`----
`
`, _________ r ___
`1510
`I
`I
`I PROCESSOR ~------
`._ ______________ ,
`:
`I
`
`1516
`,----------c ·-
`I
`I
`I MEMORY ~------
`._ ______________ ,
`:
`I
`
`, _________ r ___
`1514
`J NETWORK
`:
`._ ______________ ,
`-----: INTERFACE
`:
`
`FIG. 15
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 14 of 21
`
`US 2013/0004138 Al
`
`160~
`
`r161 o
`
`RECEIVING, FROM A SOURCE DEVICE, AN
`ELECTRONIC TRANSMISSION OF USER
`COMMENT DATA CORRELATED TO IDENTIFIERS
`FOR AUDIONIDEO CONTENT AND A POST(cid:173)
`INCEPTION TEMPORAL POINT IN THE AUDIO/
`VIDEO CONTENT
`
`1J
`
`r1620
`
`CONFIGURING A LINK TO THE AUDIO/VIDEO
`CONTENT INCLUDING AN INDICATION OF THE
`POST-INCEPTION TEMPORAL POINT
`
`, ,
`
`r1630
`
`PROVIDING THE USER COMMENT DATA WITH
`THE LINK TO A WEBSITE HOST FOR
`PUBLICATION ON A WEBSITE
`
`FIG. 16
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 15 of 21
`
`US 2013/0004138 Al
`
`170~
`
`FIG. 17
`
`r
`GENERATING A THUMBNAIL IMAGE FROM A
`VIDEO FRAME INDICATIVE OF THE POST-
`INCEPTION TEMPORAL POINT OF THE AUDIO/
`VIDEO CONTENT
`
`1710
`
`, '
`
`r1120
`
`CONFIGURING THE LINK TO INCLUDE THE
`THUMBNAIL IMAGE
`
`180~
`
`FIG. 18
`
`1810
`~
`
`RECEIVING AN IDENTIFIER FOR THE WEBSITE
`HOST AS A PROSPECTIVE PUBLICATION SITE
`OF THE USER COMMENT DATA FROM THE
`SOURCE DEVICE
`
`H
`
`r1s20
`
`RECEIVING AN IDENTIFIER FOR A DESTINATION
`USER ACCOUNT AT THE WEBSITE HOST FROM
`THE SOURCE DEVICE, AND PROVIDING
`INFORMATION IDENTIFYING THE DESTINATION
`USER ACCOUNT TO THE WEBSITE HOST
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 16 of 21
`
`US 2013/0004138 Al
`
`190C\ _____ ,=,_1_G_._1_9 _ __ ___.__ __ ___,,
`r'"""" 1 91 0
`~ .-
`
`PROVIDING THE AUDIONIDEO CONTENT TO THE
`WEBSITE HOST
`
`, ,
`
`~1920
`
`TRUNCATING THE AUDIONIDEO CONTENT
`BASED ON THE POST-INCEPTION TEMPORAL
`POINT TO PROVIDE A TRUNCATED AUDIONIDEO
`CONTENT, AND PROVIDING THE TRUNCATED
`AUDIONIDEO CONTENT TO THE WEBSITE HOST
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 17 of 21
`
`US 2013/0004138 Al
`
`2000
`
`~ (2002
`
`COMPONENT FOR RECEIVING
`AN ELECTRONIC
`TRANSMISSION OF USER
`COMMENT DATA
`CORRELATED TO
`IDENTIFIERS FOR AUDIO/
`VIDEO CONTENT AND A
`POST-INCEPTION TEMPORAL
`POINT IN THE AUDIONIDEO
`CONTENT
`
`(2006
`
`COMPONENT FOR
`PROVIDING THE USER
`COMMENT DATA WITH THE
`LINK TO A WEBSITE HOST
`FOR PUBLICATION ON A
`WEBSITE
`
`-.s--2015
`
`-
`
`r2004
`
`-
`
`COMPONENT FOR
`CONFIGURING A LINK TO THE
`AUDIONIDEO CONTENT
`INCLUDING AN INDICATION OF
`THE POST-INCEPTION
`TEMPORAL POINT
`
`2010
`,--------- C ·--
`'
`I
`: PROCESSOR ~------
`~--------------•
`'
`I
`.-2016
`,----------l
`-
`I
`I
`: MEMORY ~------
`~--------------•
`,
`I
`
`, _________ r ·--
`2014
`_____ J NETWORK
`:
`:
`INTERFACE
`:
`~--------------•
`
`FIG. 20
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 18 of 21
`
`US 2013/0004138 Al
`
`210~
`
`r--2110
`
`RECEIVING USER COMMENT DATA
`CORRELATED TO A LINK TO AUDIONIDEO
`CONTENT AND TO A POST-INCEPTION
`TEMPORAL POINT OF THE AUDIO/VIDEO
`CONTENT
`
`1'
`
`,r2120
`
`PUBLISHING THE USER COMMENT DATA WITH
`THE LINK ON A WEBPAGE
`
`INITIATING STREAMING OF THE AUDIONIDEO
`CONTENT TO A CLIENT DEVICE AT THE POST(cid:173)
`INCEPTION TEMPORAL POINT, IN RESPONSE TO
`DETECTING SELECTING OF THE LINK
`
`FIG. 21
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 19 of 21
`
`US 2013/0004138 Al
`
`FIG. 22
`
`220~
`
`2210
`r'
`
`RECEIVING COMMENT DATA CORRELATED TO
`THE LINK
`
`, ,
`
`r2220
`
`PUBLISHING THE COMMENT DATA WITH THE
`LINK
`
`, ,
`
`r2230
`
`DISPLAYING A THUMBNAIL IMAGE FROM A
`VIDEO FRAME INDICATIVE OF THE POST-
`INCEPTION TEMPORAL POINT OF THE AUDIO/
`VIDEO CONTENT AS AN ICON FOR THE LINK
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 20 of 21
`
`US 2013/0004138 Al
`
`230~
`
`FIG. 23
`
`2310
`
`RECEIVING AN IDENTIFIER FOR A USER ACCOUNT
`WITH THE USER COMMENT DATA, AND SELECTING
`THE WEBPAGE BASED ON THE USER ACCOUNT
`
`2320
`
`CONFIGURING THE
`WEBPAGE TO INCLUDE
`CONTENT SUBMITTED BY
`A GROUP OF
`INDEPENDENT USERS
`IDENTIFIED WITH THE
`USER ACCOUNT
`
`CONFIGURING THE
`WEBPAGE TO INCLUDE
`CONTENT SUBMITTED BY A
`GROUP OF INDEPENDENT
`USERS IDENTIFIED WITH A
`SECOND USER ACCOUNT,
`WHEREIN THE USER
`ACCOUNT IS IDENTIFIED AS
`A MEMBER OF THE GROUP
`OF INDEPENDENT USERS
`
`

`

`Patent Application Publication
`
`Jan. 3, 2013 Sheet 21 of 21
`
`US 2013/0004138 Al
`
`2400
`~
`
`2402
`('
`
`COMPONENT FOR RECEIVING
`A LINK TO AUDIONIDEO
`CONTENT AND TO A POST-
`INCEPTION TEMPORAL POINT
`OF THE AUDIONIDEO
`CONTENT
`
`w-2412
`
`----
`
`,__
`
`r2404
`
`COMPONENT FOR PUBLISHING
`THE LINK ON A WEBPAGE
`
`(2406
`
`COMPONENT FOR INITIATING
`STREAMING OF THE AUDIO/
`VIDEO CONTENT TO A CLIENT -
`DEVICE AT THE POST-
`INCEPTION TEMPORAL
`POINT, IN RESPONSE TO
`DETECTING SELECTING OF
`THE LINK
`
`, _________ r ___
`2410
`._ ______________ ,
`I PROCESSOR ~------
`, __________ c __
`2416
`I MEMORY ~------
`---------------'
`
`I
`
`:
`
`I
`
`:
`
`2414
`--
`,--------- C
`J NETWORK
`:
`._ ______________ ,
`-----: INTERFACE
`:
`
`I
`
`I
`
`I
`
`I
`
`FIG. 24
`
`

`

`US 2013/0004138 Al
`
`Jan. 3, 2013
`
`1
`
`COMMENTING CORRELATED TO
`TEMPORAL POINT OF VIDEO DATA
`
`CROSS-REFERENCE TO RELATED
`APPLICATION
`
`[0001] This application claims priority pursuant to 35 U.S.
`C. §119(e) to U.S. provisional application Ser. No. 61/503,
`536, filed Jun. 30, 2011, which is hereby incorporated by
`reference, in its entirety.
`
`FIELD
`
`[0002] The present application relates generally to input/
`output processing using a computer, and more particularly to
`enabling collection, configuration and distribution of user
`comments correlated to user selected times during playback
`of a video data.
`
`BACKGROUND
`
`[0003] Video data, including audio-video data, is increas(cid:173)
`ingly distributed over computer networks, telecommunica(cid:173)
`tions networks, and combinations of such networks, for the
`viewing and enjoyment of network users. Video data is often
`distributed as discrete video files or video clips posted on
`social networking websites, as a way for members of such
`sites to share video content with members of a social group.
`Video files or clips are also frequently distributed by posting
`on public forum websites, where access to the video is avail(cid:173)
`able to the general public and is not restricted to a particular
`group of users. Both public forums and social network sites
`may often include features that enable users to post comments
`about any posted content, including video content. Such fea(cid:173)
`tures may cause comments about posted video content to
`appear adjacent to a video link to the video content. The
`comments adjacent to the video link may be visible to a user's
`designated "friends" (i.e., members of the social network that
`share access to the user's content) when posted by the user or
`to the general public, and be presented in an interface that
`enables a comment thread to be developed from additional
`user comments responding to the original comment or video
`content. Through these connections, users may share video
`and other content including recommendations and commen(cid:173)
`tary with friends or others.
`[0004] For example, a user may view a video on a video
`content distributor website such as www.hulu.com or the like,
`and decide to post it on a social networking website, such as
`www.facebook.com or www.twitter.com for example. The
`video website may enable such sharing by presenting one or
`more icons related to different social networks. By selecting
`a "share" icon, a window may pop up on the video content site
`and prompt a user to insert a comment to accompany the
`video. The user may then enter a comment, and post a link to
`the video and comment to the user's homepage of the social
`network chosen, via a content sharing module of the video
`content distribution site in cooperation with the social net(cid:173)
`working site. Notwithstanding the advantages of prior video
`commenting methods, such methods may be subject to cer(cid:173)
`tain limitations. For example, prior commenting methods do
`not enable commentators to conveniently direct an intended
`audience to a precise portion of video content, nor to indicate
`such portion in an iconic manner. These and other limitations
`of prior video commenting methods may be overcome by the
`novel methods and apparatus disclosed herein.
`
`SUMMARY
`
`[0005] Methods, apparatus and systems for configuration
`and distribution of user comments correlated to user selected
`times during playback of a video data are described in detail
`in the detailed description, and certain aspects are summa(cid:173)
`rized below. This summary and the following detailed
`description should be interpreted as complementary parts of
`an integrated disclosure, which parts may include redundant
`subject matter and/or supplemental subject matter. An omis(cid:173)
`sion in either section does not indicate priority or relative
`importance of any element described in the integrated appli(cid:173)
`cation. Differences between the sections may include supple(cid:173)
`mental disclosures of alternative embodiments, additional
`details, or alternative descriptions of identical embodiments
`using different terminology, as should be apparent from the
`respective disclosures.
`In an aspect, a method for providing user comment
`[0006]
`data correlated to a temporal point in playback of audio/video
`content may be performed by a client device. The method
`may include detecting a time that input of user comment data
`is received during playback of audio/video content on an
`electronic display device. The method may include determin(cid:173)
`ing a temporal point relative to the playback of the audio/
`video content correlated to the user comment data, based on
`the time. The method may further include transmitting the
`user comment data correlated to identifiers for the audio(cid:173)
`video content and the temporal point to a computer server.
`In another aspect, the method may include provid(cid:173)
`[0007]
`ing data for a user interface, including control objects for the
`playback of the audio/video content and entry of the user
`comment data, to the electronic display device. Detecting the
`time may be based on a time that input of the user comment
`data is initiated, based on a time that input of the user com(cid:173)
`ment data is completed, or some other time. The method may
`include receiving the user input from a user input device local
`to the electronic display device. The method may include
`detecting user input of the user comment data.
`In other aspects, the method may include identify(cid:173)
`[0008]
`ing a source identifier for the user input data, and transmitting
`the source identifier to the computer server. The source iden(cid:173)
`tifier may be, or may include, a user account identifier, such
`as, for example, an account name or account number. In
`addition, the method may include identifying a website and
`destination user account as a prospective publication site of
`the user comment data, based on further user input, and trans(cid:173)
`mitting information identifying the prospective publication
`site of the user comment data to the computer server.
`[0009] A computer server in communication with one or
`more client devices may perform a method for providing a
`link to digital audio/video content responsive to user com(cid:173)
`ment data. The method may include receiving, from a source
`device, an electronic transmission of user comment data cor(cid:173)
`related to identifiers for audio/video content and a post-in(cid:173)
`ception temporal point in the audio/video content. The
`method may further include configuring a link to the audio/
`video content including an indication of the post-inception
`temporal point. The method may further include providing
`the user comment data with the link to a website host for
`publication on a website.
`In an aspect, the method may include generating a
`[0010]
`thumbnail image from a video frame indicative of the post(cid:173)
`inception temporal point of the audio/video content. The
`method may further include configuring the link to include
`the thumbnail image.
`
`

`

`US 2013/0004138 Al
`
`Jan. 3, 2013
`
`2
`
`[0011]
`In another aspect, the method may include receiving
`an identifier for the website host as a prospective publication
`site of the user comment data from the source device. For
`example, the method may include receiving an identifier for a
`destination user account at the website host from the source
`device, and providing information identifying the destination
`user account to the website host.
`[0012]
`In another aspect, the method may include truncat(cid:173)
`ing the audio/video content based on the post-inception tem(cid:173)
`poral point to provide a truncated audio/video content ( e.g., a
`video clip), and providing the truncated audio/video content
`to the website host.
`[0013] A website host may perform a method for providing
`a link to audio/video content referencing a temporal point for
`user comment data. The method may include receiving a link
`to audio/video content and to a post-inception temporal point
`of the audio/video content. The method may include publish(cid:173)
`ing the link on a webpage. The method may include initiating
`streaming of the audio/video content to a client device at the
`post-inception temporal point, in response to detecting select(cid:173)
`ing of the link.
`[0014]
`In an aspect, the method performed by the website
`host may include receiving comment data correlated to the
`link. The method may further include publishing the com(cid:173)
`ment data with the link. The method may include displaying
`a thumbnail image from a video frame indicative of the post(cid:173)
`inception temporal point of the audio/video content as an icon
`for the link.
`[0015]
`In another aspect, the method may include receiving
`an identifier for a user account with the link, and selecting the
`webpage based on the user account. The method may include
`configuring the webpage to include content submitted by a
`group of independent users identified with the user account.
`The method may include configuring the webpage to include
`content submitted by a group of independent users identified
`with a second user account, wherein the user account is iden(cid:173)
`tified as a member of the group of independent users.
`[0016]
`In related aspects, a client-side or server-side com(cid:173)
`puting apparatus may be provided for performing any of the
`methods and aspects of the methods summarized above. An
`apparatus may include, for example, a processor coupled to a
`memory, wherein the memory holds instructions for execu(cid:173)
`tion by the processor to cause the apparatus to perform opera(cid:173)
`tions as described above. Certain aspects of such apparatus
`(e.g., hardware aspects) may be exemplified by equipment
`such as computer servers, personal computers, smart phones,
`notepad computers, laptop computers, and other computing
`devices of various types used for providing or accessing infor(cid:173)
`mation over a computer network. Similarly, an article of
`manufacture may be provided, including a non-transitory
`computer-readable medium holding encoded instructions,
`which when executed by a processor, may cause a client-side
`or server-side computing apparatus to perform the methods
`and aspects of the methods as summarized above.
`[0017] Further embodiments, aspects and details of meth(cid:173)
`ods, apparatus and systems for configuration and distribution
`of user comments correlated to user selected times during
`playback of a video data are presented in the detailed descrip(cid:173)
`tion that follows.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0018] The present technology, in accordance with one or
`more various embodiments, is described in detail with refer(cid:173)
`ence to the following figures. The drawings are provided for
`
`purposes of illustration only and merely depict typical or
`example embodiments of the technology. These drawings are
`provided to facilitate the reader's understanding of the tech(cid:173)
`nology and shall not be considered limiting of the breadth,
`scope, or applicability of the technology. Like element
`numerals may be used to indicate like elements appearing in
`one or more of the figures.
`[0019] FIG. 1 is a schematic diagram illustrating an
`embodiment of a computing environment in which systems
`and methods discussed herein may be implemented.
`[0020] FIG. 2 is a schematic block diagram illustrating
`another embodiment of a computer system for supporting and
`executing the systems and methods described herein.
`[0021] FIG. 3 is a schematic block diagram illustrating an
`embodiment of a system for receiving, associating, display(cid:173)
`ing, and sharing comments corresponding to video files.
`[0022] FIG. 4 is a diagram illustrating a simplified screen(cid:173)
`shot of a user interface enabling comments to be linked to
`selected portions of a video file.
`[0023] FIG. 5 is a diagram illustrating the screenshot shown
`in FIG. 4 of the user interface responding to receiving a
`comment from a viewer of the video file.
`[0024] FIG. 6 is a diagram illustrating the screenshot shown
`in FIG. 4 of the user interface after the comment from the
`viewer has been uploaded or otherwise received.
`[0025] FIG. 7 is a schematic block diagram showing
`aspects of a method for linking comments to selected portions
`of a video file.
`[0026] FIG. 8 is a schematic block diagram showing
`aspects of a method for commenting on a selected portion of
`a video file.
`[0027] FIG. 9 is a diagram illustrating a simplified screen(cid:173)
`shot of a user interface providing or displaying a collection of
`comments corresponding to a selected portion of a video file.
`[0028] FIG.10 is a diagram illustrating a simplified screen(cid:173)
`shot of a social media page presenting a video file or portion
`thereof associated with selected comments.
`[0029] FIG. 11 is a diagram illustrating a simplified screen(cid:173)
`shot of a user interface providing or displaying a collection of
`comments corresponding to a selected portion of a video file.
`[0030] FIGS. 12-14 are diagrams illustrating operations
`that may be performed by a client device in connection with
`configuration and distribution of a user comment correlated
`to a user selected temporal point of video data.
`[0031] FIG. 15 is a diagram illustrating a client apparatus
`configured for distribution and configuration of a user com(cid:173)
`ment correlated to a temporal point of video data.
`[0032] FIGS. 16-19 are diagrams illustrating operations
`that may be performed by a computer server in connection
`with configuration and distribution of a user comment corre(cid:173)
`lated to a user selected temporal point of video data.
`[0033] FIG. 20 is a diagram illustrating a server apparatus
`configured for publishing a user comment correlated to a
`temporal point of video data.
`[0034] FIGS. 21-23 are diagrams illustrating operations
`that may be performed by a computer server in connection
`publishing a user comment correlated to a user selected tem(cid:173)
`poral point of video data.
`[0035] FIG. 24 is a diagram illustrating a server apparatus
`configured for distribution and configuration of a user com(cid:173)
`ment correlated to a temporal point of video data.
`
`

`

`US 2013/0004138 Al
`
`Jan. 3, 2013
`
`3
`
`DETAILED DESCRIPTION
`
`[0036] Various embodiments are now described with refer(cid:173)
`ence to the drawings, wherein like reference numerals are
`used to refer to like elements throughout. In the following
`description, for purposes of explanation, numerous specific
`details are set forth in order to provide a thorough understand(cid:173)
`ing of one or more embodiments. It may be evident, however,
`that such embodiments may be practiced without these spe(cid:173)
`cific details. In other instances, well-known structures and
`devices are shown in block diagram form in order to facilitate
`describing one or more embodiments.
`[0037]
`In selected embodiments, the features and aspects
`disclosed herein may be implemented within a computing
`environment 100. Such an environment 100 may include one
`or more computer servers 102. A server 102 may be opera(cid:173)
`tively coupled to one or more data stores 104 ( e.g., databases,
`indexes, files, or other data structures). A server 102 may
`connect to a data communication network 116. A data com(cid:173)
`munication network 116 may comprise a local area network
`(LAN), a wide area network (WAN) (e.g., the Internet), a
`telephone network, a wireless cellular telecommunications
`network, or some combination of these or similar networks.
`[0038] One or more client devices may be in communica(cid:173)
`tion with the server 102, and a corresponding data store 104,
`via the data communication network 116. Such client devices
`may include, for example, one or more laptop computers 108,
`desktop computers 120, smart phones 122, mobile phones
`124, televisions 126, or combinations thereof. In operation,
`such client devices 108, 120, 122, 124, 126 may send and
`receive data or instructions to the server 102, in response to
`user input received from user input devices or other input. In
`response, the server 102 may serve data from the data store
`104, alter data within the data store 104, add data to the data
`store 104, or the like or combinations thereof.
`[0039]
`In selected embodiments, the server 102 may stream
`or transmit one or more video files including video content,
`audio content and/or metadata from the data store 104 to one
`or more of the client devices 108, 120, 122, 124, 126 via the
`data communication network 116. The devices 108,120,122,
`124, 126 may output video content from the video file using
`a display screen, projector, or other video output device. For
`example, the video file may comprise a clip of a movie,
`television show, news broadcast, or portion thereof for output
`using a display device of one or more of the client devices
`108, 120, 122, 124, 126. In certain embodiments, the system
`100 configured in accordance with the features and aspects
`disclosed herein may be configured to operate within or sup(cid:173)
`port a cloud computing environment. For example, a portion
`of, or all of, the data store 104 and server 102 may reside in a
`cloud server.
`[0040] Referring to FIG. 2, a diagrammatic view of an
`example computer 200 is illustrated. One or more of the
`devices 102, 108, 120, 122, 124, 126 of the system 100 may
`be configured as or include such a computer 200. In selected
`embodiments, the computer 200 may include a bus 208 or
`other communication mechanism 208, a processor 202, main
`memory 214, read only memory (ROM) 212, one or more
`additional storage devices 210, a communication interface
`204, or the like or sub-combinations thereof.
`[0041] A bus 208 or other communication mechanism 208
`may support communication of information within the com(cid:173)
`puter200. A processor202 maybe connected to a bus 208 and
`process information. In selected embodiments, a processor
`202 may be a specialized or dedicated microprocessor con-
`
`figured to perform particular tasks in accordance with the
`features and aspects disclosed herein by executing machine(cid:173)
`readable software code defining the particular tasks. Main
`memory 214 (e.g., random access memory (RAM) or other
`dynamic storage device) may be connected to a bus 208 and
`store information and instructions to be executed by a pro(cid:173)
`cessor 202. Main memory 214 may also store temporary
`variables or other intermediate information during execution
`of such instructions.
`[0042] Read only memory (ROM) 212 or some other static
`storage device 212 may be connected to a bus 208 and store
`static information and instructions for a processor 202. An
`additional storage device 210 (e.g., a magnetic disk, optical
`disk, memory card, or the like) may be connected to a bus 208.
`The additional storage device 210 may include a non-transi(cid:173)
`tory computer-readable medium holding
`information,
`instructions, or some combination thereof, for example
`instructions that when executed by the processor 202, cause
`the computer 200 to perform one or more operations of a
`method as described herein. A communication interface 204
`may also be connected to a bus 208. A communication inter(cid:173)
`face 204 may provide or support two-way data communica(cid:173)
`tion between a computer 200 and one or more external
`devices (e.g., other devices 108,120,122,124,126 contained
`within the computing environment 100).
`In selected embodiments, a computer 200 may be
`[0043]
`connected (e.g., via a bus 208) to a display 216.A display 216
`may use any suitable mechanism to communicate informa(cid:173)
`tion to a user of a computer 200. For example, a display 216
`may include orutilize a cathode ray tube (CRT), liquid crystal
`display (LCD), light emitting diode (LED) display, projector,
`or other display device to present information to a user of the
`computer 200 in a visual display.
`[0044] One or more input devices 218 (e.g., an alphanu(cid:173)
`meric keyboard or microphone) may connected to a bus 208
`to communicate information and commands to a computer
`200. In selected embodiments, one input device 218 may
`provide or support control over the positioning of a cursor.
`Such a cursor control device 220, also called a pointing
`device, may be configured as a mouse, a trackball, a track pad,
`touch screen, cursor direction keys or other device for receiv(cid:173)
`ing or tracking physical movement and translating the move(cid:173)
`ment into electrical signals indicating cursor movement. A
`cursor control device 220 may communicate direction infor(cid:173)
`mation and command selections to a processor 202 and con(cid:173)
`trol