(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2010/0241699 A1
`(43) Pub. Date:
`Sep. 23, 2010
`MUTHUKUMARASAMY et al.
`
`US 2010O241699A1
`
`(54) DEVICE-BASED CONTROL SYSTEM
`
`Publication Classification
`
`(76) Inventors:
`
`Sivasubramanian
`MUTHUKUMARASAMY, Santa
`Clara, CA (US); Thirumalai
`ARUNACHALAM, Santa Clara,
`CA (US); Balamurugan
`KRISHNAN, Santa Clara, CA (US)
`
`Correspondence Address:
`COURTNEY STANFORD & GREGORY LLP
`10001 N. DeAnza Blvd., Suite 300
`Cupertino, CA 95.014 (US)
`
`(21) Appl. No.:
`
`12/728,670
`
`(22) Filed:
`
`Mar. 22, 2010
`
`Related U.S. Application Data
`(60) Provisional application No. 61/162.245, filed on Mar.
`20, 2009, provisional application No. 61/262,926,
`filed on Nov. 20, 2009.
`
`(51) Int. Cl.
`(2006.01)
`G06F 5/16
`(2006.01)
`G06F 5/18
`(52) U.S. Cl. ........................................... 709/203; 706/12
`(57)
`ABSTRACT
`A Device-Based Control System (DBCS) enables a device
`agnostic and source-agnostic entertainment experience
`through use of an internet-enabled device (IED). The IED
`includes a media management application for navigating
`through media or entertainment content, controlling media
`devices according to a type of media content selected by the
`user, and sharing media experiences via Social networks. The
`IED includes smartphones, tablet computers, and other inter
`net-enabled processor-based devices. The DBCS leverages
`the internet access of the IED to enable search and discovery
`of all available media content. A content recommendation
`system (CRS) coupled to the media management application
`learns media preferences from user behavior, generates from
`numerous disparate media Sources media choices corre
`sponding to the media preferences, and presents the media
`choices on the IED.
`
`Show Recommendation
`Algorithms
`
`Webservices
`over WiFi Y
`
`Network and
`TV ShoWs
`
`
`
`
`
`
`
`--> RFIZigbee
`-------> Infrared
`-
`-
`-
`- - -> 802.11bg wifi C2) tely
`HE Ethernet
`Hub
`Zelfy System Component
`- 3rd Party Services
`
`
`
`Page 1 of 41
`
`GOOGLE EXHIBIT 1008
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 1 of 29
`
`US 2010/0241699 A1
`
`
`
`Page 2 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 2 of 29
`
`US 2010/0241699 A1
`
`
`
`200
`
`Top Picks) Animation
`
`Comedy Drama D
`
`Sports
`
`Search
`
`Socialize
`
`Page 3 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 3 of 29
`
`US 2010/0241699 A1
`
`
`
`300
`
`Top Picks) Animation Comedy Dramad
`
`Deck the Halls
`An uptight, optometrist hits the roof when his
`neighbor decides to decorate his house with
`enough Christmas lights to be seen from.
`8:00-10:00 PM
`
`Page 4 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 4 of 29
`
`US 2010/0241699 A1
`
`
`
`400
`
`AT&T an
`
`12:34 PM
`
`go)
`
`Now Playing
`
`O
`
`tap to mute
`double-tap for menu
`
`Page 5 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 5 of 29
`
`US 2010/0241699 A1
`
`
`
`| ws:||:::::::::::| , | \!\,)
`
`| laessae | ±±1),Mae Hºllae)).| | ? |C |
`
`Page 6 of 41
`
`

`

`Patent Application Publication
`
`US 2010/0241699 A1
`
`
`
`Page 7 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23
`
`9
`
`2010
`
`Sheet 7 Of 29
`
`US 2010/0241699 A1
`
`
`
`Z/9’OIH
`
`Page 8 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 8 of 29
`
`US 2010/0241699 A1
`
`
`
`700
`
`12:34 PM
`
`O
`
`AT&T a
`
`go)
`
`Now Playing
`Super Why
`The Gingerbread Boy
`9:00 - 9:30
`$
`Poppa Pig warns Pig to slow down as he races
`through the playground at top speed.
`
`Š 8)
`
`Sid the Science Kid
`irrrry 99,347 views
`
`
`
`Curious George
`Gireets. Monkey
`
`Page 9 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 9 of 29
`
`US 2010/0241699 A1
`
`FIG.9
`
`900
`
`Different Fruit for Each R00m
`
`901
`
`Q
`
`(1)
`
`902
`
`O 576.)
`
`903
`
`910
`
`Page 10 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 10 of 29
`
`US 2010/0241699 A1
`
`
`
`Page 11 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 11 of 29
`
`US 2010/0241699 A1
`
`
`
`Internet IRUES
`Database
`
`1200
`1.
`
`V
`
`Send IRUES code
`
`W
`W
`w
`
`w
`Request
`IRUES code v,
`
`W
`
`y
`1
`
`Zelfy HW. Infrared is sas
`Pulse
`
`FIG.12
`
`Page 12 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 12 of 29
`
`US 2010/0241699 A1
`
`
`
`00m0$ 10019$
`
`
`
`
`
`yndynO Opný 10919SS00||A9CIppy
`
`
`
`q089 JOJ
`
`
`
`90] [10S
`
`
`
`Page 13 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 13 of 29
`
`US 2010/0241699 A1
`
`FIG.14
`
`Device
`
`E.
`Device
`Manufacturer
`
`A
`A
`
`1
`
`
`
`A /
`
`Device Model
`
`Identifier of
`Device that
`switches the
`connection to
`this device
`
`Method to
`switch
`connection to
`this device
`
`Identifier of
`Device that
`changes the
`channels
`
`Identifier of
`Device that plays
`the audio output
`from this device
`
`Page 14 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 14 of 29
`
`US 2010/0241699 A1
`
`
`
`
`
`
`
`FIG.15/1
`
`FIG.15/2
`
`FIG.15/3
`
`FIG.15/4
`
`FIG.15/5
`
`FIG.15/6
`
`FIG.15/7
`
`FIG.15/8
`
`FIG.15/9
`
`FIG.15/10
`
`FIG.15/11
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Page 15 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 15 of 29
`
`US 2010/0241699 A1
`
`1500
`
`Trying it Out
`
`
`
`
`
`
`
`Show Plugging
`in Hub and
`Positioning Fruit
`
`Online Store
`(many steps not
`illustrated here)
`
`FIG.15/1
`
`
`
`Page 16 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 16 of 29
`
`US 2010/0241699 A1
`
`FIG.15/2 'N
`
`
`
`
`
`Launch App
`
`
`
`Look for Hubs
`
`How many Hubs?
`
`1
`
`Have Hub and iPhone
`been setup before?
`
`No
`
`Have Hub and iPhone
`been used together?
`
`
`
`Yes
`
`No
`
`Yes
`
`Alert prompting user to:
`1) Copy Settings to iPhone from HUB
`2) Overwrite Hub Settings with iPhone settings
`3) Delete Hub Settings & Start from Scratch
`
`Execute Appropriate Command
`
`
`
`
`
`Last Used Zelfy
`app Screen
`
`Choose TW Brand
`List Of TW Brands
`
`Select Brand
`
`Page 17 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 17 of 29
`
`US 2010/0241699 A1
`
`-1500
`
`
`
`
`
`Is the Node for
`each Hub named
`
`No
`
`Is the Node, last used
`by the iPhone available?
`No
`
`UI asking which
`Node they would
`like to control.
`
`FIG.15/3
`
`Page 18 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 18 of 29
`
`US 2010/0241699 A1
`
`
`
`Allow
`
`Don't
`
`
`
`Allow Looku
`WLOOkup
`Don't Allow Lookup
`Enter Zip Code or use
`Find TV Service
`"Locate Me" Butt Me"
`or
`and Locate Me
`Button
`
`
`
`Find TW Service
`Filled Zip Code
`Field and list of
`content providers
`
`Pick Content Provider
`
`
`
`Pick Channels
`
`Alert explaining
`Selection of "x"
`most popular
`channels
`
`Edit (OK)
`
`Edit
`
`FIG.15/4
`
`Page 19 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 19 of 29
`
`US 2010/0241699 A1
`
`ReOrder,
`reset order,
`Ortap to add
`OfI
`C
`
`Pick Channels
`
`Channel List and UI for
`Selecting Language,
`Resolution,
`Adding Removing
`Groups
`
`Next
`
`Choose From
`
`AddRemove Group
`
`
`
`Choose From
`
`Choose Resolution
`and Languages from
`which chamellineup
`will be generated
`
`Pick Channels
`
`Sheet for
`adding &
`removing groups
`of channels
`
`Back Button
`
`DOne
`
`1500-1
`
`FIG.15/5
`
`Page 20 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 20 of 29
`
`US 2010/0241699 A1
`
`-1500
`
`
`
`Is user just
`trying it Out
`
`Yes
`
`
`
`What does TW
`signal pluginto
`
`STB WDWR
`STB
`
`Test Setup
`Check all you
`want to turnoff
`TW
`N/
`STB
`AWReceiver Y
`
`Test Power Off
`
`Page 21 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 21 of 29
`
`US 2010/0241699 A1
`
`
`
`What Brand
`
`Tivo
`Carrier options
`Other,
`
`
`
`
`
`What Brand?
`
`Tivo
`Carrier options
`Other Brand 1
`Other Brand 2
`Other Brand 3
`Other Brand 4
`Other Brand 5
`Other Brand 6
`
`Choose brand
`
`-
`
`Video Input
`
`HDMI1
`
`+AWReceiver
`
`Choose AW
`Receiver
`Brand
`List Of AV
`Receiver
`Brands
`
`Choose TV Video Input
`
`
`
`Choose Brand
`
`What do you
`use to control
`your volume?
`TW
`
`+ AWReceiver)
`
`AV Input
`AWReceiver
`HDMI1
`HDMI2
`HDMI3
`Componentl
`Component 2
`
`Add AW
`Receiver
`
`Select
`AV Input
`
`Select TW
`
`1500-1
`
`FIG.15/7
`
`Page 22 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 22 of 29
`
`US 2010/0241699 A1
`
`Test Power Off
`
`Test Setup
`
`scar
`evices turn of
`Yes
`No)
`
`Test Setup
`Check all that
`didn't turnoff
`List of selected
`ist of Selecte
`devices
`Test Again
`
`Test Again
`
`
`
`
`
`Yes
`
`Top Picks
`Setup Complete.
`Add more devices in Settings,
`Top Picks intro.
`OK Custom
`
`OK
`
`Pick Content
`N
`
`Customize it
`Top Picks
`questionaire to
`Solve cold-start
`issue
`Pick Content
`M
`
`N-1500
`
`FIG. 1 5/ 8
`
`Page 23 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 23 of 29
`
`US 2010/0241699 A1
`
`Test Setup
`
`Be Sure
`to Orient
`Peel
`correctly.
`Test Again
`
`
`
`
`
`Arethere still
`codes available in
`cloud
`
`Yes
`
`Are all
`devices in list
`Selected?
`
`
`
`
`
`
`
`
`
`Setup Failed
`Web Support >
`Phone Support >
`
`Call
`
`Peel.com
`Tech Support
`ruming in Safari
`
`Setup Failed
`
`Call 555-1212)
`
`Yes
`
`No)
`
`FIG.15/9
`
`Page 24 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 24 of 29
`
`US 2010/0241699 A1
`
`Is user just
`trying it out?
`
`
`
`Yes
`
`InfoScreen
`
`Top Picks
`
`Did Channel
`Change?
`Yes
`No)
`
`FIG.15/10
`
`Page 25 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 25 of 29
`
`US 2010/0241699 A1
`
`
`
`
`
`-No
`
`
`
`Arethere still
`codes available in
`cloud?
`
`Trying with
`EE
`Try Again
`
`FIG.15/11
`
`Page 26 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 26 of 29
`
`US 2010/0241699 A1
`
`
`
`
`
`----------------------____
`
`*=~=æ••
`~~~~);
`
`Page 27 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 27 of 29
`
`US 2010/0241699 A1
`
`
`
`
`
`Page 28 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 28 of 29
`
`US 2010/0241699 A1
`
`N
`WiFi or Wired Network Connection
`
`-1800
`
`ZRCBS
`
`
`
`
`
`
`
`Audio & Video Out
`
`
`
`TV & Speakers
`(Display device
`and audio device)
`
`
`
`
`
`
`
`
`
`Responses
`/
`
`Zelfy
`Application
`running on User's
`Phone/Device
`
`FIG.18
`
`Page 29 of 41
`
`

`

`Patent Application Publication
`
`Sep. 23, 2010 Sheet 29 of 29
`
`US 2010/0241699 A1
`
`
`
`Go to webpage with given URL
`
`While On webpage, Navigate:Updownright|left
`(This is done via button presses or
`gestures On the Zelly application)
`
`Play video at given URL
`Execute Transport Command (Play, Pause
`Fastforward, rewind) On Currently playing video
`Play audio at given URL
`Execute Transport Command (Play, Pause
`Fastforward, rewind) On currently playing audio
`
`Playflash Swfgame or other game at given URL
`
`ZRCBS loads and displays the webpage that is
`present at the given internet URL
`
`ZRCBS jumps hyperlink to next hyperlink.
`
`ZRCIBS plays the video present at the given URL
`ZRCBS executes the transport Command
`On the Current playing video,
`ZRCIBS plays the audio present at the given URL
`ZRCBS executes the transport command
`On the Current playing audio,
`
`ZRCBS loads and presents the game (adobe flash
`swf of other) present at the given URL
`ZIMMS executes the command in the game.
`
`While Ongame: Pass game command.
`(This is done via button presses Or
`gestures On the Zelly application)
`Play video with given videoid (as specified by 3"
`ZRCBS loads the 3Party VideoPlayer specified
`party using 3 party APIs and VideoPlayers
`and plays the video with given videoid)
`Play audio with given audioid (as specified by 3ZRCIBS loads the 3"Parly Audio Player specified
`party using 3 party APIs and audio Players
`and plays the audio with given audioid)
`
`FIG.19
`
`Page 30 of 41
`
`

`

`US 2010/024.1699 A1
`
`Sep. 23, 2010
`
`DEVICE-BASED CONTROL SYSTEM
`
`RELATED APPLICATIONS
`0001. This application claims the benefit of U.S. patent
`application Ser. No. 61/162,245, filed Mar. 20, 2009.
`0002 This application claims the benefit of U.S. patent
`application Ser. No. 61/262,926, filed Nov. 20, 2009.
`
`TECHNICAL FIELD
`0003. The embodiments described herein relate generally
`to control of electronic media devices and content. More
`particularly, the embodiments described herein relate to use
`of an internet-enabled device to control navigation through
`media or entertainment content and control media devices or
`components.
`
`BACKGROUND
`0004 Consumers have two levels of complexity to deal
`with in their premises (e.g., homes, offices, etc.). A first com
`plexity deals with managing and controlling various elec
`tronic components or equipment in the premises (e.g., audio
`components, video components, digital video recorders
`(DVRs), digital video players, etc.). The conventional solu
`tion to this problem has been the universal remote that allows
`a consumer to control more than one component with a single
`remote.
`0005. A second complexity is that the consumer currently
`has no way to interactively research/browse through the
`plethora of content choices that are available for them to
`watch and/or listen to from numerous sources at any particu
`lar moment. Consumers of content are faced with the ever
`increasing dilemma of finding content to watch that matches
`their desires and needs. Given that most consumers now have
`access to a plethora of channels, the current approach of using
`an Electronic Program Guide (EPG) to search for TV content
`is not a satisfactory approach and most consumers confine
`their viewing to a limited subset of channels. When content
`from IPTV and other internet sources are included this
`approach fails completely. Furthermore, the use of search
`assumes that the user knows what they are searching for, and
`works well under that assumption. However, in many, if not
`most, circumstances the user does not have a specific piece of
`content that they wish to search for and watch.
`
`INCORPORATION BY REFERENCE
`0006 Each patent, patent application, and/or publication
`mentioned in this specification is herein incorporated by ref
`erence in its entirety to the same extent as if each individual
`patent, patent application, and/or publication was specifically
`and individually indicated to be incorporated by reference.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`0007 FIG. 1 is a block diagram of the Device-Based Con
`trol System (DBCS), under an embodiment.
`0008 FIG. 2 is a first example screenshot presented on the
`IED showing content-based navigation, under an embodi
`ment.
`0009 FIG. 3 is a second example screenshot presented on
`the IED showing content-based navigation, under an embodi
`ment.
`
`0010 FIG. 4 is an example screenshot presented on the
`IED showing context-based and gesture-based media device
`control, under an embodiment.
`0011
`FIG. 5 is a table that is a first example mapping
`(“Eyes on the TV. Until Viewer Presses Search Button”) of
`context based on actions mapped to user actions, under an
`embodiment.
`0012 FIG. 6 is a table that is a second example mapping
`(“Eyes on the Device') of context based on actions mapped to
`user actions, under an embodiment.
`0013 FIG. 7 is an example screenshot presented on the
`IED showing media content research using the IED, under an
`embodiment.
`0014 FIG. 8 shows the form factor of the ZHub, under an
`embodiment.
`0015 FIG.9 shows the form factor of the ZNode, under an
`embodiment.
`0016 FIG. 10 shows the form factor of the ZNode base
`with three (3) different tops, under an embodiment.
`0017 FIG. 11 is a block diagram for generating a custom
`program feed for the Content Index Database (CID), under an
`embodiment.
`0018 FIG. 12 is a block diagram for transferring codes to
`and from the IR code database (UES format), under an
`embodiment.
`0019 FIG. 13 is a block diagram for premise component
`configuration setup, under an embodiment.
`0020 FIG. 14 is a block diagram of a logical representa
`tion of a media device in a premise component configuration
`setup, under an embodiment.
`0021 FIG. 15 (collectively 15/1, 15/2 and 15/3) is a flow
`diagram for specifying and configuring the DBCS to interact
`with media components at a premise, under an embodiment.
`0022 FIG. 16 is a block diagram for operation of the
`Component Recommendation System (CRS), under an
`embodiment.
`0023 FIG. 17 is a block diagram of a social network
`formed among DBCS users, under an embodiment.
`0024 FIG. 18 is a block diagram of a home network com
`prising the IED along with a computer hosting the RCIBS,
`under an embodiment.
`0025 FIG. 19 is a table of commands generated by the
`IED and the resulting action or operation by the RCIBS in
`response to the command, under an embodiment.
`
`DETAILED DESCRIPTION
`(0026. A Device-Based Control System (DBCS) is
`described that enables consumers, through the use of an inter
`net-enabled device (IED), to navigate through media or enter
`tainment content, control media components or equipment to
`watch and/or listen to media content, and share their media
`experiences with an internet community or social network.
`The internet-enabled devices of an embodiment include any
`processor-based device with internet connectivity, a screen,
`and a means to navigate controls on the screen, for example,
`Smartphones, tablet computers, touch-enabled devices (e.g.,
`iPhone(R), iPodR), iPadR), etc.), personal computers (PCs),
`digital photo frames, and other internet-enabled processor
`based client or remote devices. The DBCS leverages the
`internet access of the IEDs to enable search and discovery of
`all available media content.
`(0027. The DBCS overcomes the complexities described
`above to provide consumers with direct access to media con
`tent choices that are available for them in a user-friendly way
`
`Page 31 of 41
`
`

`

`US 2010/024.1699 A1
`
`Sep. 23, 2010
`
`on IEDs. Thus, the DBCS, using a combination of premise
`hardware, a Software system, and/or internet access, allows
`consumers to select and control media content via their inter
`net-enabled device. The DBCS changes the way consumers
`select media and how they control that media across their
`entertainment components or devices and, as such, enables a
`device-agnostic and source-agnostic entertainment experi
`CCC.
`0028. Although the detailed description herein contains
`many specifics for the purposes of illustration, anyone of
`ordinary skill in the art will appreciate that many variations
`and alterations to the following details are within the scope of
`the embodiments described herein. Thus, the following illus
`trative embodiments are set forth without any loss of gener
`ality to, and without imposing limitations upon, the claimed
`invention.
`0029. The following terms can have the following general
`meanings as they are used herein, but can also have meanings
`attributed to them by one skilled in the art.
`0030. “Touch-handheld or “Touch-Enabled Device' is
`any device that has a touch screen and can be interacted with
`in a mobile form. For example, devices like the iPhone(R),
`iPod R, iPadR, and/or Nexus R Phone are touch-handheld
`devices.
`0031 “Content Source' is a source from which a specific
`piece of content is made available (e.g., broadcast, cable, over
`the air, online, digital video disk (DVD), video on demand
`(VOD), etc.).
`0032 “Input” refers to various input ports on a component
`such as a television (TV), audio/video (AV) receiver, and the
`like (e.g., HDMI1 port, Component 1 port, etc.).
`0033 “ZHub' is a hardware component that converts Eth
`ernet signals to radio frequency (RF) signals.
`0034 “ZNode' is a hardware component that converts RF
`signals to infrared (IR) signals.
`0035 “Cloud' is an Internet server-based software and
`data.
`0036 “Device/Equipment' is entertainment components
`or devices such as TV, DVD player, AppleTV device, to name
`a few.
`0037 “Router is an Internet switch that is coupled or
`connected to an internet cable or digital subscriberlink (DSL)
`modem and enables a home network that is shared by one or
`more internet protocol (IP)-based devices (e.g., personal
`computer (PC), WiFi devices, etc.) in the home.
`0038. “IR Code' is an infrared code used to control or
`perform a specific action on a component or piece of equip
`ment.
`0039 “RF is a radio frequency signal used to wirelessly
`communicate between the ZHub and the ZNode.
`0040) “Program Guide' is a collection of metadata corre
`sponding to available media content (e.g., TV programs,
`audio programs, etc.). Examples include, but are not limited
`to, electronic TV guides or electronic program guides, for
`instance.
`0041. “Online Media” is Internet-based media content.
`0042 "Serendipity” or “Content Recommendation Sys
`tem (CRS) is the Zelfy software algorithm system that pro
`vides content or other program recommendations based on
`user behavior.
`0.043 “Gesture' is a touch-based and/or movement-based
`interaction with an interface device oran interface of a device
`(e.g., Swipe right, Swipe left, tap, move right, move left,
`shake, etc.).
`
`0044 FIG. 1 is a block diagram of the Device-Based Con
`trol System (DBCS), under an embodiment. The DBCS of an
`embodiment comprises a hub 2, referred to hereinas the ZHub
`2, a node 3, referred to herein as the ZNode 3, and an DBCS
`application or Software that executes on a processor of the
`internet-enabled device (IED) 4 with which the consumer
`interacts. The ZHub 2 comprises a hardware component that
`receives signals or commands from the IED 4 via a local or
`premise network (e.g., router, WiFi, etc.) and translates the
`commands to RF signals. The ZNode 3 comprises a hardware
`component that receives RF signals from the ZHub 2 and
`translates the RF signals to a protocol (e.g. Infrared) inter
`pretable by the media components. The ZHub 2 and ZNodes 3
`present at a premise can be referred to herein as a media
`control network, but are not so limited. The DBCS applica
`tion that runs or is hosted on the IED 4 can be referred to
`herein as a media management application, but is not so
`limited.
`0045. The DBCS comprises a Content Index Database
`(CID) 1C, also referred to as content library 1C, hosted on an
`internet server 1, which manages electronic program guide
`information. The DBCS comprises a device map and infrared
`database 1B, hosted on the internet server 1, used in the
`management of media components at the premise. The DBCS
`comprises a recommendation algorithm 1G, hosted on an
`internet server 1, which Suggests media content to a consumer
`based on consumer behavior. The recommendation algorithm
`can be referred to herein as a Content Recommendation Sys
`tem (CRS), but is not so limited. The DBCS comprises or
`forms a social platform 1A that manages the consumer's
`social experience around media content. The DBCS com
`prises a ZHDStick that streams internet content over WiFi to
`High Definition television (HDTV). The DBCS comprises a
`ZSky Software agent that helps manage online media viewing
`on TV; the ZSky agent can be hosted (e.g., preinstalled) on the
`ZHDStick, or can be independently installed on a media PC,
`but the embodiment is not so limited. The DBCS also com
`prises a TV program guide 1D, online video/music/photo
`services 1E, and/or TV show information and trailers 1F. The
`components of the DBCS are described in detail below.
`0046. The DBCS software or application executes on a
`processor of the IED with which the consumer interacts.
`When the consumeruses the IED, he interacts primarily with
`the DBCS software to manage his home entertainment expe
`rience.
`0047. The DBCS software offers, through content-based
`navigation, content choices as its primary form of interface,
`where the content choices are tailored to an individual con
`Sumer's preference. The content choices are categorized
`using easy to understand genres that the consumer can
`quickly browse through to select content. The content choices
`are aggregated from a multitude of sources, for example,
`subscription media, broadcast media, cable, DVR, VOD and
`internet media to which the consumer has access.
`0048 Generally, the DBCS is a system comprising a
`media control network coupled to the internet via a local
`network of a premise. The DBCS comprises a media man
`agement application running on an internet-enabled device
`(IED) and controlling media devices at the premise via the
`media control network. The DBCS comprises a Content Rec
`ommendation System (CRS) coupled to the media manage
`ment application, wherein the CRS learns media preferences
`from user behavior, generates from a plurality of disparate
`media sources media choices corresponding to the media
`
`Page 32 of 41
`
`

`

`US 2010/024.1699 A1
`
`Sep. 23, 2010
`
`preferences, and presents the media choices on the IED,
`wherein the media management application automatically
`controls delivery of selected media content and selects and
`controls the media devices that deliver the selected media
`content according to a media type of the selected media
`COntent.
`0049 FIG. 2 is a first example screenshot 200 showing
`content-based navigation, under an embodiment. This
`example screenshot 200 includes “Top Pick” recommenda
`tions (in the category of "TV Shows”) generated and pre
`sented by the CRS via the IED. FIG. 3 is a second example
`screenshot 300 showing content-based navigation, under an
`embodiment. This example screenshot 300 includes “Top
`Pick” recommendations (in the category of “Movies”) gen
`erated and presented by the CRS via the IED. These examples
`200/300 are shown as examples on the iPhone(R), from
`Apple(R), Inc., but the embodiments herein are not limited to
`the iPhone(R) and can be used with any processor-based IED.
`The DBCS software causes personalized content choices to
`be presented on a display of the IED in an image format
`categorized by content. The content is customized for the
`specific user depending on what media services (e.g., cable,
`broadcast, etc.) the user has in the premise. The content
`choices spread across numerous sources and devices.
`Depending on time of the day the user accesses the DBCS
`Software, the content changes depending on content availabil
`ity at that time of the day.
`0050. Once the content is chosen, the DBCS software
`enables, via the IED, contextual gesture-based control of
`media components (e.g., volume selection, channel selection,
`pause/play, etc.) by the consumer. The media component
`control is enabled through gestures that enable the consumer
`to access and control media and components without having
`to look at the IED.
`0051
`FIG. 4 is an example screenshot 400 showing con
`text-based and gesture-based media device control, under an
`embodiment. This example 400 is shown as an example on
`the iPhone(R), from Apple(R), Inc., but the embodiments herein
`are not limited to the iPhone(R) and can be used with any
`processor-based device. The control of media content and
`devices are enabled through gestures made via the IED. For
`example when watching DVD players, a single tap on the IED
`400 controls the pause function of the DVD, and tapping
`again on the IED 400 controls the resume play function of the
`DVD. Similarly, swiping right on the IED screen interface
`controls the skip function to skip the content to a Subsequent
`chapter, and Swiping left controls the skip function to skip the
`content to a previous chapter. Swiping up and down on the
`IED screen interface controls the volume on the appropriate
`media device (e.g., TV. AV Receiver, etc.). Moreover, gestur
`ing right with the IED can control the skip function to skip the
`content to a Subsequent chapter, and gesturing left can control
`the skip function to skip the content to a previous chapter.
`Gesturing up and down with the IED can control the volume
`on the appropriate media device (e.g., TV, AV Receiver, etc.).
`0052. The gestures and touch actions of an embodiment
`control functions based on the context of the media currently
`being played. The gestures and touch actions can be changed
`dynamically, for example, from the Internet servers, but are
`not so limited. FIG. 5 is a table that is a first example mapping
`(“Eyes on the TV. Until Viewer Presses Search Button”) of
`context based on actions mapped to user actions, under an
`embodiment. FIG. 6 is a table that is a second example map
`
`ping (“Eyes on the Device') of context based on actions
`mapped to user actions, under an embodiment.
`0053. The DBCS software enables a consumer to research
`media choices. Before committing to specific media content,
`the consumer can use the IED to perform research on the
`choice using. For example, the consumer can locate detailed
`descriptions of the media content, details about the plots of a
`show and collective opinions of others who have previously
`viewed the content.
`0054 FIG. 7 is an example screenshot 700 showing media
`content research using the IED, under an embodiment. This
`example 700 is shown as an example for the iPhone(R), from
`Apple(R), Inc., but the embodiments herein are not limited to
`the iPhone(R) and can be used with any processor-based
`device. The consumer can use the IED to gather information
`about media content, for example, a detailed description of
`program content can be viewed from the IED, or the con
`Sumer can research via the IED similar content available from
`other sources. Additionally, this example screenshot shows
`the consumer the identity of others who are watching the
`same show (5 people watching now') and enables that con
`Sumer to share, or socialize, his entertainment experience
`with his friends. The consumer can also see what his social
`network friends are watching, and he can find out who else is
`watching the same show or a similar show to the one he is
`viewing. Thus the DBCS enables friends to assemble and
`chat, express or post comments, and/or rate specific media
`COntent.
`0055 While watching a specific show, the consumers can
`share their experience with others over the Internet through
`operation of the DBCS software. A consumer can share with
`their friends on social networks. Furthermore, they can pub
`lish what they are watching and chat with their friends to find
`out more about the show or discuss the show. All these opera
`tions can be performed via the IED from where the user chose
`the content.
`0056. The ZHub is a device that couples or connects on a
`first end to a power outlet (e.g., alternating current (AC)
`power) and couples or connects on a second end to a router or
`other network switch in the host premise. FIG. 8 shows the
`form factor 800 of the ZHub, under an embodiment. The
`ZHub, when coupled or connected to the router, is a partici
`pating device in the premise network and, as such, can access
`the Internet or other network via the router. The ZHub, by
`virtue of being tethered to the premise network, is available
`on the premise network to be discovered and coupled to by the
`IED. The ZHub publishes its IP Address via UPNP packets,
`and this enables the IED to discover or identify the ZHub and
`form a coupling or connection to the ZHub. Once the IED
`discovers a ZHub in the network, it associates with the ZHub.
`0057. When the IED sends a command, the ZHub receives
`the command from the IED and resolves the command into a
`specific instruction directed at a specific ZNode in the house.
`AS Such, the ZHub resolves or maps the command to a specific
`IR code to be sent to a specific ZNode via an RF signal. The
`ZHub can cache IR codes or other data that may be used to
`control media devices. If the appropriate IR code is not avail
`able in the cache, the ZHub looks up the code (e.g., from the
`internet server) as the ZHub is always connected to the inter
`net via the premise router. There may be more than one ZNode
`on a premise and, if so, the ZHub manages all registered
`ZNodes on the premise. Furthermore, a single ZHub can
`simultaneously interact with more than one ZNode. As an
`example, when a user selects content that is on channel 324 to
`
`Page 33 of 41
`
`

`

`US 2010/024.1699 A1
`
`Sep. 23, 2010
`
`be displayed on the living room TV, the ZHub translates the
`command into a specific RF signal directed at the ZNode in
`the living room.
`0058. The ZNode is a device that can be placed on a struc
`ture (e.g., piece of furniture, shelf, etc.) in the premise in a
`position from which it has a reasonable line of sight to the
`media components. FIG. 9 shows the form factor 900 of the
`ZNode, under an embodiment. The primary function of each
`ZNode is to receive commands from the ZHub and translate
`the commands for control of media devices via the media
`device control protocol. The ZNode of an embodiment is
`battery-operated, but is not so limited. The ZNode receives
`commands from the ZHub via RF signals and translates the
`commands to IR signals. Generally, the IR code data itself is
`cached in the ZNode, but if not cached, the Z