`
`PCT/US2013/036678
`
`[0070]
`
`Fig. 9C is a bottom view of an embodimentof a remote control with the joystick
`
`in an upperposition;
`
`[0071]
`
`Fig. 10 isa plan view of another embodimentof a handheld remote control;
`
`[0072]
`
`Fig. 11A is a front view of an embodimentofan Intelligent TV screen;
`
`[0073]
`
`Fig. 11B isa front view of an embodiment of an Intelligent TV screen;
`
`[0074]
`
`Fig. 11C is a front view of an embodimentof an Intelligent TV screen;
`
`[0075|
`
`Fig. 12 isa block diagram of an embodiment of a handheld remote control of
`
`either Figs. 7 or 10;
`
`[0076]
`
`Fig. 13 isa block diagram of an embodimentof a content data service;
`
`[0077]
`
`Fig. 14 is a first view of an embodiment ofa user interface of a smart television
`
`settings panel;
`
`[0078]
`
`Fig. 15 is a second view of an embodimentof a user interface of a smart
`
`television settings panel;
`
`[0079]
`
`Fig. 16 is a first flowchart of an embodiment of a smart television settings panel
`
`operation; and
`
`[0080]
`
`Fig. 17 is asccond flowchart of an cmbodiment of a smart television scttings
`
`panel operation.
`
`[0081]
`
`In the appended figures, similar components and/or features may have the same
`
`reference label. Further, various components of the same type may be distinguished by
`
`following the reference label by a Ictter that distinguishes among the similar components.
`
`If only the first reference label is used in the specification, the description is applicable to
`
`any onc of the similar components having the samefirst reference label irrespective of the
`
`second reference label.
`
`DETAILED DESCRIPTION
`
`[0082]
`
`Presented herein are embodiments of a device. The device can be a
`
`telecommunications device, such as a television, an clectronic visual display device, or
`
`other smart device. The device can include one or more screens, or sections of a screen,
`
`that are configured to receive and present information from a numberof sources. Further,
`
`the device can receive user input in unique ways. The overall design and functionality of
`
`the device provides for an enhanced user expericnce making the device more uscful and
`
`moreefficient.
`
`[0083]
`
`Intelligent Television (TV) Environment:
`
`[0084] Referring to Figs. 1A and 1B, an Intelligent TV, or device, 100 is shown. It is
`
`anticipated that the Intelligent TV 100 may be used for cntertainment, business
`14
`
`EX. 1002
`LG Electronics, Inc. / Page 2401 of 3394
`
`EX. 1002
`LG Electronics, Inc. / Page 2401 of 3394
`
`
`
`WO 2014/028067
`
`PCT/US2013/036678
`
`applications, social interaction, content creation and/or consumption, and to organize and
`
`control one or more other devices that are in communication with the Intelligent TV 100.
`
`As can be appreciated, the Intelligent TV can be used to enhancethe user interactive
`
`experience whether at homeorat work.
`
`[0085]
`
`In some embodiments, the Intelligent TV 100 may be configured to receive and
`
`understand a variety of user and/or device inputs. For example, a user may interface with
`
`the Intelligent TV 100 via one or more physical or electrical controls, such as buttons,
`
`switches, touch sensitive screens/regions(¢.g., capacitive touch, resistive touch,etc.),
`
`and/or other controls associated with the Intelligent TV 100. In somecases, the Intelligent
`
`TV 100 mayinclude the one or more interactive controls. Additionally or alternatively,
`
`the one or more controls may be associated with a remote control. The remote control
`
`may communicate with the Intelligent TV 100 via wired and/or wireless signals. As can
`
`be appreciated, the remote control may operate via radio frequency (RF), infrared (IR),
`
`and/or a specific wireless communicationsprotocol (e.g., Bluetooth™, Wi-Fi, etc.). In
`
`somecases, the controls, whether physical or electrical, may be configured (e.g.,
`
`programmed) to suit a uscr's preferences.
`
`{@086} Additionally or alternatively, smart phones, tablets, computers, laptops,
`
`netbooks, and other smart devices may be used to control the Intelligent TV 100. For
`
`example, control of the Intelligent TV 100 may be achieved via an application running on
`
`a smart device. The application may be configured to present a user with various
`
`Intelligent TV 100 controls in an intuitive user interface (UID) on a screen associated with
`
`the device 100. The screen may be a touchsensitive, or touch screen, display. Sclections
`
`input by a user via the UI may be configured to control the Intelligent TV 100 by the
`
`application acccssing onc or more communication features associated with the smart
`
`device.
`
`{@087)
`
`It is anticipated that the Intelligent TV 100 can reccive input via various input
`
`devices including, but in no way limited to, video, audio, radio, light, tactile, and
`
`combinations thereof. Among other things, these input devices may be configured to
`
`allow the Intelligent TV 100 to see, recognize, and react to user gestures. For instance, a
`
`uscr may talk to the Intelligent TV 100 in a conversational manner. The Intelligent TV
`
`100 may hear and understand voice commands in a mannersimilar to a smart device's
`
`intelligent personal assistant and voice-controlled navigator application (e.g., Apple's Siri,
`
`Android's Skyvi, Robin, Iris, and other applications).
`
`15
`
`EX. 1002
`LG Electronics, Inc. / Page 2402 of 3394
`
`EX. 1002
`LG Electronics, Inc. / Page 2402 of 3394
`
`
`
`WO 2014/028067
`
`PCT/US2013/036678
`
`{60881
`
`The Intelligent TV 100 may also be a communications device which can
`
`establish network connections 104 through many alternate means, including wired 108 or
`
`wireless 112 means, over cellular networks 116, and by using a telephone line 120 to
`
`connect to telephone networks operated by telephone companies. These connections 104
`
`enable the Intelligent TV 100 to access one or more communication networks. The
`
`communication networks may comprise any type of known communication medium or
`
`collection of communication media and may use any type of protocols to transport
`
`messages or signals between endpoints. The communication networks may include wired
`
`and/or wireless communication technologies. The Internet is an example of the
`
`communication network 132 that constitutes an Internet Protocol (IP) network consisting
`
`of many computers, computing networks, and other communication devices locatedall
`
`over the world, which are connected through many telephone systems and other means.
`
`i@089} Other examples of the communication network 132 include, without limitation, a
`
`standard Plain Old Telephone System (POTS), an Integrated Services Digital Network
`
`(ISDN), the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a
`
`Wide Arca Network (WAN), a cellular network, and any other type of packet-switched or
`
`circuit-switched network knownin the art. In addition, it can be appreciated that the
`
`communication network 132 need not be limited to any one network type, and instead may
`
`be comprised of a numberof different networks and/or network types.
`
`{6090}
`
`In some embodiments, the Intclligent TV 100 may be cquipped with multiple
`
`communication means. The multiple communication means may allow the Intelligent TV
`
`100 to communicate across Local Arca Networks (LANs) 124, wireless local area
`
`networks (WLANs) 128, and other networks 132. The networks may be connected in a
`
`redundant manner to ensure network access. In other words, if one conncction is
`
`interrupted, the intelligent TV 100 can use an alternate communications path to reestablish
`
`and/or maintain the nctwork connection 104. Amongotherthings, the intelligent TV 100
`
`may use these network connections 104 to send and receive information, interact with an
`
`electronic program guide (EPG) 136, receive software updates 140, contact customer
`
`service 144 (e.g., to receive help or service, etc.), and/or access remotely stored digital
`
`media librarics 148. In addition, these connections can allowthe Intelligent TV 100 to
`
`make phonecalls, send and/or receive email messages, send and/or receive text messages
`
`(such as email and instant messages), surf the Internet using an internet search engine, post
`
`blogs by a blogging service, and connect/interact with social media sites and/or online
`
`community (c.g., Faccbook, Twitter, LinkedIn, Pintercst, GooglcPlus, MySpace, and the
`16
`
`EX. 1002
`LG Electronics, Inc. / Page 2403 of 3394
`
`EX. 1002
`LG Electronics, Inc. / Page 2403 of 3394
`
`
`
`WO 2014/028067
`
`PCT/US2013/036678
`
`like) maintained by a social network service. In combination with other components of
`
`the Intelligent TV 100 described in more detail below, these network connections 104 also
`
`enable the Intelligent TV 100 te conduct video teleconferences, electronic meetings, and
`
`other commumications. The Intelhgent TV 100 may capture and store images and sound,
`
`using associated cameras, microphones, and other sensors. Additionally or alternatively,
`
`the Intelligent TV 100 maycreate and save screen shots of media, images, and data
`
`displayed on a screen associated with the Intelligent TV 100.
`
`{809%}
`
`Further, as shown in Fig. 1B, the Intelligent TV 100 can interact with other
`
`electronic devices 168 by either by the wired 108 and/or wireless 112 connections. As
`
`described. herein, components of the Intelligent TV 100 allow the device 100 to be
`
`connected to devices 168 including, but not limited to, DVD players 168a, BluRay players
`
`168b, portable digital media devices 168c, smart phones 168d, tablet devices 168e,
`
`personal computers 168f, external cable boxes 168g, keyboards 168h, pointing devices
`
`168i, printers 168j, game controllers and/or game pads 168k,satellite dishes 1681, external
`
`display devices 168m, and other universal serial bus (USB), local area network (LAN),
`
`Bluctooth™, high-definition multimedia interface (HDMI) compliant devices, and/or
`
`wireless devices. When connected to an external cable box 168g orsatellite dish 1681, the
`
`Intelligent TV 100 can access additional media content. Also, as further described below,
`
`the intelligent TV 100 is capable of receiving digital and/or analog signals broadcast by
`
`TV stations. The Intclligent TV 100 can be configured as onc or more of a standard-
`
`definition television, enhanced television, and high-definition television. It may operate as
`
`onc or morc of cable, Internct, Intcrnct Protocol, satcllitc, web, and/or smart telcvision.The
`
`Intelligent TV 100 mayalso be used to control the operation of, and may interface with,
`
`other smart componcnts such as sccurity systems 172, door/gatc controllers 176, remote
`
`video cameras 180, lighting systems 184, thermostats 188, refrigerators 192, and other
`
`appliances.
`
`[0092]
`
`Intelligent TV:
`
`16083]
`
`Figs. 2A-2D illustrate components of the Intelligent TV 100.
`
`In general, as
`
`shownby Fig. 2A, the Intelligent TV 100 can be supported by a removable base or stand
`
`204 that is attached to a frame 208. The frame 208 surrounds cdges of a display screen
`
`212, leaving a front surface of the display screen 212 uncovered. The display screen 212
`
`may comprise a Liquid Crystal Display (LCD) screen, a plasma screen, Light Emitting
`
`Diode (LED) screen, or other screen types. In embodiments, the entire front surface of the
`
`17
`
`EX. 1002
`LG Electronics, Inc. / Page 2404 of 3394
`
`EX. 1002
`LG Electronics, Inc. / Page 2404 of 3394
`
`
`
`WO 2014/028067
`
`PCT/US2013/036678
`
`screen 212 may be touchsensitive and capable of receiving input by the user touching the
`
`front surface of the screen 212.
`
`[0094]
`
`The IntelligentTV 100 may include integrated speakers 216 andat least one
`
`microphone 220. A first area of the frame 208 may comprise a horizontal gesture capture
`
`region 224 and second areas comprise vertical gesture capture regions 228. The gesture
`
`capture regions 224, 228 may comprise areas or regions that are capable of receiving input
`
`by recognizing gestures made by the user, and in some examples, without the need for the
`
`user to actually touch the screen 212 surface of the Intelligent TV 100. However, the
`
`gesture capture regions 224, 228 may not include pixels that can perform a display
`
`function or capability.
`
`[0095| One or more image capture devices 232, such as a camera, can be included for
`
`capturing still and/or video images. The image capture device 232 can include or be
`
`associated with additional elements, such as a flash or other light source 236 and a range
`
`finding device 240 to assist focusing of the image capture device. In addition, the
`
`microphone 220, gesture capture regions 224, 228, image capture devices 232, and the
`
`range finding device 240 may be used bythe Intelligent TV 100 to recognize individual
`
`users. Additionally or alternatively, the Intelligent TV 100 may learn and remember
`
`preferences associated with the individual users. In some embodiments, the learning and
`
`remembering (i.e., identifying and recalling stored information) may be associated with
`
`the recognition of a uscr.
`
`[0096] An IR transmitter and receiver 244 may also be provided to connect the
`
`Intelligent TV 100 with a remote control device (not shown) or other IR devices.
`
`Additionally or alternatively, the remote control device may transmit wireless signals via
`
`RF,light, and/or a means othcr than TR. Also shown in Fig. 2A is an audio jack 248,
`
`which may be hidden behind a panel that is hinged or removable. The audio jack 248
`
`accommodatesa tip, ring, sleeve (TRS) connector, for example, to allow the userto utilize
`
`headphones, a headset, or other external audio equipment.
`
`[0097]
`
`The Intelligent TV 100 can also include a numberof buttons 252. For example,
`
`Fig. 2A illustrates the buttons 252 on the top of the Intelligent TV 100, although the
`
`buttons could be placed at other locations. As shown, the Intelligent TV 100 includes six
`
`buttons 252a-f, which can be configured for specific inputs. For example, the first button
`
`252a may be configured as an on/off button used to control overall system powerto the
`
`Intelligent TV 100. The buttons 252 may be configured to, in combination or alone,
`
`control a numberof aspects of the Intelligent TV 100. Some non-limiting cxamples
`18
`
`EX. 1002
`LG Electronics, Inc. / Page 2405 of 3394
`
`EX. 1002
`LG Electronics, Inc. / Page 2405 of 3394
`
`
`
`WO 2014/028067
`
`PCT/US2013/036678
`
`include, but are not limited to, overall system volume, brightness, the image capture
`
`device, the microphone, and initiation/termination of a video conference. Instead of
`
`separate buttons, two of the buttons may be combinedinto a rocker button. This rocker
`
`button arrangement may be useful in situations where the buttons are configured to control
`
`features such as volumeorbrightness. In some embodiments, one or more of the buttons
`
`252 are capable of supporting different user commands. By way of example, a normal
`
`press has a duration commonly ofless than about 1 second and resembles a quick input. A
`
`medium press has a duration commonly of 1 second or more but less than about 12
`
`seconds. A long press has a duration commonly of about 12 seconds or more. The
`
`function of the buttons is normally specific to the application that is active on the
`
`Intelligent TV 100. In the video conference application for instance and depending on the
`
`particular button, a normal, medium, or long press can mean end the video conference,
`
`increase or decrease the volume,increase a rate speed associated with a response to an
`
`input, and toggle microphone mute. Depending on the particular button, a normal,
`
`medium, or long press can also control the image capture device 232 to increase zoom,
`
`decrease zoom, take a photograph, or record video.
`
`[0098]
`
`In support of communications functions or capabilities, the Intelligent TV 100
`
`can include one or more shared or dedicated antennae 256 and wired broadband
`
`connections 260 as shown in Fig. 2B. The antennae 256 also enable the Intelligent TV
`
`100 to reccive digital and/or analog broadcast TV channels. The wired broadband
`
`connections 260 are, for example, a Digital Subscriber Line (DSL), an optical line, an
`
`Ethernet port, an IEEE 1394 interface, or other interfaces. The Intelligent TV 100 also has
`
`a telephone line jack 262 to further provide communications capability.
`
`[0099]
`
`In addition to the removable base 204, the Intelligent TV 100 may include
`
`hardware and mounting points 264 on a rear surface to facilitate mounting the Intelligent
`
`TV 100 to a surface, such as a wall.
`
`In onc cxample, the Intelligent TV 100 may
`
`incorporate at least one Video Equipment Standards Association (VESA) mounting
`
`interface for attaching the device 100 to the surface.
`
`[00100] As shown in Fig. 2C, the Intelligent TV 100 may include docking interfaces or
`
`ports 268. The docking ports 268 may include proprictary or universal ports to support the
`
`interconnection of the Intelligent TV 100 to other devices or components, which may or
`
`may not include additional or different capabilities from those integral to the Intelligent
`
`TV 100. In addition to supporting an exchange of communication signals between the
`
`Intelligent TV 100 and a connected device or componcnt, the docking ports 268 can
`19
`
`EX. 1002
`LG Electronics, Inc. / Page 2406 of 3394
`
`EX. 1002
`LG Electronics, Inc. / Page 2406 of 3394
`
`
`
`WO 2014/028067
`
`PCT/US2013/036678
`
`support the supply of power to the connected device or component. The docking ports
`
`268 can also comprise an intelligent element that comprises a docking module for
`
`controlling communications or other interactions between the Intelligent TV 100 and the
`
`connected device or component.
`
`[0100]
`
`The Intelligent TV 100 also includes a numberof card slots 272 and network or
`
`peripheral interface ports 276. The card slots 272 may accommodate different types of
`
`cards including subscriber identity modules (SIM), secure digital (SD) cards, MiniSD
`
`cards, flash memory cards, and other cards. Ports 276 in embodiments may include
`
`input/output (I/O) ports, such as universal serial bus (USB)ports, parallel ports, game
`
`ports, and high-definition multimedia interface (HDMI) connectors.
`
`[0101| An audio/video (A/V) I/O module 280 can be included to provide audio to an
`
`interconnected speaker or other device, and to receive audio input from a connected
`
`microphoneor other device. As an example, the audio input/output interface 280 may
`
`comprise an associated amplifier and analog to digital converter.
`
`[0102] Hardware Features:
`
`[0103]
`
`Fig. 3 illustrates components of a Intelligent TV 100 in accordance with
`
`embodiments of the present disclosure. In general, the Intelligent TV 100 includes a
`
`primary screen 304. Screen 304 can be a touch sensitive screen and can include different
`
`operative areas.
`
`[0104]
`
`For cxamplc, a first operative arca, within the screen 304, may comprise a
`
`display 310. In some embodiments, the display 310 may be touch sensitive. In general,
`
`the display 310 may comprise a full color, display.
`
`[0105] A second area within the screen 304 may comprise a gesture capture region 320.
`
`The gesture capture region 320 may comprise an arca or region that is outside of the
`
`display 310 area, and that is capable of receiving input, for example in the form of
`
`gestures provided by a uscr. However, the gesture capture region 320 docs not include
`
`pixels that can perform a display function or capability.
`
`[0106] A third region of the screen 304 may comprise a configurable area 312. The
`
`configurable area 312 is capable of receiving input and hasdisplay or limited display
`
`capabilitics. In embodiments, the configurable arca 312 may present different input
`
`options to the user. For example, the configurable area 312 may display buttons or other
`
`relatable items. Moreover, the identity of displayed buttons, or whether any buttons are
`
`displayed at all within the configurable area 312 of a screen 304, may be determined from
`
`the context in which the Intelligent TV 100 is used and/or opcrated.
`20
`
`EX. 1002
`LG Electronics, Inc. / Page 2407 of 3394
`
`EX. 1002
`LG Electronics, Inc. / Page 2407 of 3394
`
`
`
`WO 2014/028067
`
`PCT/US2013/036678
`
`[0107]
`
`In an exemplary touch sensitive screen 304 embodiment, the touch sensitive
`
`screen 304 comprises a liquid crystal display extending across at least those regions of the
`
`touch sensitive screen 304 that are capable of providing visual output to a user, and a
`
`capacitive input matrix over those regions of the touch sensitive screen 304 that are
`
`capable of receiving input from the user.
`
`[0108] One or more display controllers 316 may be provided for controlling the
`
`operation of the screen 304. The display controller 316 may control the operation of the
`
`touch sensitive screen 304, including input (touch sensing) and output (display) functions.
`
`The display controller 316 may also control the operation of the screen 304 and may
`
`interface with other inputs, such as infrared and/or radio input signals (e.g., door/gate
`
`controllers, alarm system components, etc.). In accordance with still other embodiments,
`
`the functions of a display controller 316 may be incorporated into other components, such
`
`as a processor 364.
`
`[0109]
`
`The processor 364 may comprise a general purpose programmable processoror
`
`controller for executing application programmingor instructions. In accordance with at
`
`Icast some embodiments, the processor 364 may include multiple processor cores, and/or
`
`implement multiple virtual processors. In accordance with still other embodiments, the
`
`processor 364 may include multiple physical processors. As a particular example, the
`
`processor 364 may comprise a specially configured application specific integrated circuit
`
`(ASIC)or other intcgrated circuit, a digital signal processor, a controller, a hardwired
`
`electronic or logic circuit, a programmable logic device or gate array, a special purpose
`
`computer, or the like. The processor 364 gencrally functions to run programming code or
`
`instructions implementing various functions of the Intelligent TV 100.
`
`[0110]
`
`In support of connectivity functions or capabilitics, the Intelligent TV 100 can
`
`include a module for encoding/decoding and/or compression/decompression 366 for
`
`recciving and managing digital television information. Encoding/decoding
`
`compression/decompression module 366 enables decompression and/or decoding of
`
`analog and/or digital information dispatched by a public television chain or in a private
`
`television network and received across antenna 324, I/O module 348, wireless connectivity
`
`module 328, and/or other wircless communications module 332. The television
`
`information may be sent to screen 304 and/or attached speakers receiving analog or digital
`
`reception signals. Any encoding/decoding and compression/decompression is performable
`
`on the basis of various formats (e.g., audio, video, and data). Encrypting module 324 is in
`
`21
`
`EX. 1002
`LG Electronics, Inc. / Page 2408 of 3394
`
`EX. 1002
`LG Electronics, Inc. / Page 2408 of 3394
`
`
`
`WO 2014/028067
`
`PCT/US2013/036678
`
`communication with encoding/decoding compression/decompression module 366 and
`
`enables the confidentiality of all the data received or transmitted by the user or supplier.
`
`[0111]
`
`In support of communications functions or capabilities, the Intelligent TV 100
`
`can include a wireless connectivity module 328. As examples, the wireless connectivity
`
`module 328 can comprise a GSM, CDMA, FDMAand/oranalog cellular telephony
`
`transceiver capable of supporting voice, multimedia and/or data transfers over a cellular
`
`network. Alternatively or in addition, the Intelligent TV 100 can include an additional or
`
`other wireless communications module 332. As examples, the other wireless
`
`communications module 332 can comprise a Wi-Fi, Blutooth™, WiMax,infrared, or other
`
`wireless communications link. The wireless connectivity module 328 and the other
`
`wireless communications module 332 can each be associated with a shared or a dedicated
`
`antenna 324 and a shared or dedicated I/O module 348.
`
`[0112] An input/output module 348 and associated ports may be included to support
`
`communications over wired networksor links, for example with other communication
`
`devices, server devices, and/or peripheral devices. Examples of an input/output module
`
`348 include an Ethernet port, a Universal Scrial Bus (USB) port, Thunderbolt™or Light
`
`Peak interface, Institute of Electrical and Electronics Engineers (IEEE) 1394 port, or other
`
`interface.
`
`[0113] An audio input/output interface/device(s) 344 can be included to provide analog
`
`audio to an interconnected speaker or other device, and to reccive analog audio input from
`
`a connected microphoneor other device. As an example, the audio input/output
`
`interface/device(s) 344 may comprise an associated amplificr and analog-to-digital
`
`converter. Alternatively or in addition, the Intelligent TV 100 can include an integrated
`
`audio input/output device 356 and/or an audio jack for interconnecting an external speaker
`
`or microphone. For example, an integrated speaker and an integrated microphone can be
`
`provided, to support ncar talk or spcaker phone opcrations.
`
`[0114] A port interface 352 may be included. The port interface 352 may include
`
`proprietary or universal ports to support the interconnection of the device 100 to other
`
`devices or components, such as a dock, which may or may not include additional or
`
`different capabilitics from those intcgral to the device 100. In addition to supporting an
`
`exchange of communication signals between the device 100 and another device or
`
`component, the docking port 136 and/or port interface 352 can support the supply of
`
`powerto or from the device 100. The port interface 352 also comprises an intelligent
`
`element that comprises a docking module for controlling communications or other
`22
`
`EX. 1002
`LG Electronics, Inc. / Page 2409 of 3394
`
`EX. 1002
`LG Electronics, Inc. / Page 2409 of 3394
`
`
`
`WO 2014/028067
`
`PCT/US2013/036678
`
`interactions between the Intelligent TV 100 and a connected device or component. The
`
`docking module may interface with software applications that allow for the remote control
`
`of other devices or components (e.g., media centers, media players, and computer
`
`systems).
`
`[0115] An Intelligent TV 100 mayalso include memory 308 for use in connection with
`
`the execution of application programmingor instructions by the processor 364, and for the
`
`temporary or long term storage of program instructions and/or data. As examples, the
`
`memory 308 may comprise RAM, DRAM, SDRAM, orothersolid state memory.
`
`Alternatively or in addition, data storage 312 may be provided. Like the memory 308, the
`
`data storage 312 may comprise a solid state memory device or devices. Alternatively or in
`
`addition, the data storage 312 may comprise a hard disk drive or other random access
`
`memory.
`
`[0116] Hardware buttons 358 can be included for example for use in connection with
`
`certain control operations. One or more image capture interfaces/devices 340, such as a
`
`camera, can be included for capturing still and/or video images. Alternatively or in
`
`addition, an image capture intcrface/device 340 can include a scanner, code reader, or
`
`motion sensor. An image capture interface/device 340 can include or be associated with
`
`additional elements, such as a flash or other light source. The image capture
`
`interfaces/devices 340 may interface with a user 1D module 350 that assists in identifying
`
`uscrs of the Intelligent TV 100.
`
`[0117]
`
`The Intelligent TV 100 can also include a global positioning system (GPS)
`
`recciver 336. In accordance with embodiments of the present invention, the GPS receiver
`
`336 may further comprise a GPS module that is capable of providing absolute location
`
`information to othcr components of the Intelligent TV 100. As will be appreciated, other
`
`satellite-positioning system receivers can be used in lieu of or in addition to GPS.
`
`[0118]
`
`Power can be supplicd to the components of the Intelligent TV 100 from a power
`
`source and/or power control module 360. The power control module 360 can, for
`
`example, include a battery, an AC to DC converter, power control logic, and/or ports for
`
`interconnecting the Intelligent TV 100 to an external source of power.
`
`[0119]
`
`Firmware and Software:
`
`[0120] An embodimentof the software system components and modules 400 is shown
`
`in Fig. 4. The software system 400 may comprise one or more layers including, but not
`
`limited to, an operating system kernel 404, one or morelibraries 408, an application
`
`23
`
`EX. 1002
`LG Electronics, Inc. / Page 2410 of 3394
`
`EX. 1002
`LG Electronics, Inc. / Page 2410 of 3394
`
`
`
`WO 2014/028067
`
`PCT/US2013/036678
`
`framework 412, and one or more applications 416. The one or more layers 404-416 can
`
`communicate with cach other to perform functions for the Intelligent TV 100.
`
`[0121] Anoperating system (OS) kernel 404 contains the primary functions that allow
`
`the software to interact with hardware associated with the Intelligent TV 100. Kernel 404
`
`can includea collection of software that manages the computer hardware resources and
`
`provides services for other computer programsor software code. The operating system
`
`kernel 404 is the main componentof the operating system and acts as an intermediary
`
`between the applications and data processing done with the hardware components. Part of
`
`the operating system kernel 404 can include one or more device drivers 420. A device
`
`driver 420 can be any code within the operating system that helps operate or control a
`
`device or hardware attached to or associated with the Intelligent TV. The driver 420 can
`
`include code for operating video, audio, and/or other multimedia components of the
`
`Intelligent TV 100. Examplesof drivers include display, camera,flash, binder (IPC),
`
`keypad, WiFi, and audio drivers.
`
`[0122] Library 408 can contain code or other components that may be accessed and
`
`implemented during the opcration of the software system 400. The library 408 may
`
`contain one or more of, but is not limited to, an operating system runtime library 424, a
`
`TV services hypertext application language (HAL)library 428, and/or a data service
`
`library 432. The OS runtime library 424 may contain the code required by the operating
`
`system kernel 404 or other opcrating system functions to be executed during the runtime
`
`of the software system 400. The library can include the code that is initiated during the
`
`running of the software system 400.
`
`[0123]
`
`The TV services hypertext application language 428 can include code required
`
`by TV services cither exccuted in the application framework 412 or an application 416.
`
`The TV services HAL library 428 is specific to the Intelligent TV 100 operations that
`
`control different functions of the Intelligent TV. The TV service HALlibrary 428 can
`
`also be formed from other types of application languages or embodimentsof different
`
`types of code or formats for code beyond the hypertext application language.
`
`[0124]
`
`The data services library 432 can include the one or more components or codes
`
`to implement components for the data scrviccs function. The data services function can be
`
`implemented in the application framework 412 and/or applications layer 416. An
`
`embodiment of a function of the data services and the type of components that may be
`
`included is shown in Fig.6.
`
`24
`
`EX. 1002
`LG Electronics, Inc. / Page 2411 of 3394
`
`EX. 1002
`LG Electronics, Inc. / Page 2411 of 3394
`
`
`
`WO 2014/028067
`
`PCT/US2013/036678
`
`[0125]
`
`The application framework 412 can include a general abstraction for providing
`
`functionality that can be selected by one or more application 416 to provide specific
`
`application functions or software for those applications. Thus, the framework 412 can
`
`include one or more different services, or other applications, that can be accessed. by the
`
`applications 416 to provide general functions across two or more applications. Such
`
`functions include, for example, management of one or more of windowsorpanels,
`
`surfaces, activities, content, and resources, The application framework 412 can include
`
`one or more, but is not limited to, TV services 434, TV services framework 440, TV
`
`resources 444, anduser interface component 448.
`
`[0126]
`
`The TV services framework 440 can provide an additional abstraction for
`
`different TV services. TV services framework 440 allows for the general access and
`
`function of services that are associated with the TV functionality. The TV services 436
`
`are general services provided within the TV services framework 440 that can be accessed
`
`by applicationsin the applications layer 416. The TV resources 444 provide code for
`
`accessing TV resources including any types of storage, video, audio, or other functionality
`
`provided with the Intelligent TV 100. The TV resources 444, TV services 436, and TV
`
`services framework 440 provide for the different implementations of TV functionality that
`
`may occur with the Inte