United States Patent
`Hidary etal.
`
`US005778 181A
`5,778,181
`[113 Patent Number:
`ou»
`[45] Date of Patent:
`Jul. 7, 1998
`
`
`[54] ENHANCED VIDEO PROGRAMMING
`SYSTEM AND METHOD FOR
`INCORPORATING AND DISPLAYING
`RETRIEVED INTEGRATED INTERNET
`INFORMATION SEGMENTS
`
`[75]
`
`Inventors: Jack D. Hidary. New York; Craig
`Ullman. Brooklyn. both of N.Y.
`
`[73] Assignee: ACTY, Inc., New York, N.Y.
`
`1/1996 Logston et al. wc...eseessesesseeeres 348/7
`5,481,542
`7/1996 Majeti et al.
`oesccssseseseeseseeeseneeeee 348/7
`5,534,913
`11/1996 Schulhof et al.
`...-scoseseseeen 364/514 C
`5,572,442
`
`ssccsssssssssseessssesnee 348/731
`5,589,892 12/1996 Knee et al.
`3/1997 Lewis secssssceeuessseeeuceeteeetseee 348/8
`5,612,730
`
`Primary Examiner—Parshotam §.Lall
`Assistant Examiner—Viet Vu
`Attorney, Agent, or Firm—Dorsey & Whitney LLP
`
`[21] Appl. No.: 615,143
`
`[57]
`
`ABSTRACT
`
`[22] Filed:
`
`Mar. 14, 1996
`
`Related U.S. Application Data
`
`A system for integrating video programming with the vast
`information resources of the Internet. A computer based
`system receives a video program with embedded uniform
`resource locators (URLs). The URLs.the effective addresses
`[63] Continuation-in-part of Ser. No. 613,144, Mar. 8, 1996,
`of locations or Web sites on the Internet, are interpreted by
` abandoned.
`the system and direct the system to the Website locationsto
`Int. CLS coe GO6F 13/00, HO4N 5/50
`(S51)
`retrieve related Web pages. Upon receipt of the Web pages
`[52] WS. Ch. ees cececcceseseneneseneneaens 395/200.48; 395/200.49;
`by the system, the Web pages are synchronized to the video
`348/12
`content for display. The video program signal can be dis-
`(58] Field of Search o......ccscssse 395/200.3, 200.48,
`played on a video window on a conventional personal
`395/200.47. 327, 200.49; 348/7, 8. 10,
`13, 564, 906, 461, 12; 455/3.1, 5.1.6.1,|computer screen. The actual retrieved Web pages are time
`6.3
`stamped to also be displayed. on another portion of the
`display screen, when predetermined related video contentis
`displayed in the video window.
`
`16]
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`5,014,125
`
`5/1991 Pocock et al. uccsssssscsssssesseerees 348/7
`
`23 Claims, 2 Drawing Sheets
`
`SYSTEM DESIGN
`
`CONTENT
`CREATION
`
`4
`
`18
`
`DISPLAY
`MONITOR
`
`
`
`
`
`32
`
`SERVER PATH
`
`SERVER
`
`24
`
`28
`
`Petitioner Hyundai Ex-1023, 0001
`
`Petitioner Hyundai Ex-1023, 0001
`
`

`

`US. Patent
`
`Jul. 7, 1998
`
`Sheet 1 of 2
`
`5,778,181
`
`FIG.
`1
`
`CONTENT
`CREATION
`
`
` VIDEO
`
`WITH
`URLs
`
`SUBSCRIBER SITE
`
`12
`
`
`
`
`FIG. 2
`SYSTEM DESIGN
`
`18
`
`CREATION
`
`8
`
`
`
`
`SERVER
`URL
`DECODER
`
` 24
`
`18
`
`28
`
`DISPLAY
`
`MONITOR
`
`
`
`
`
`Petitioner Hyundai Ex-1023, 0002
`
`Petitioner Hyundai Ex-1023, 0002
`
`

`

`U.S. Patent
`
`Jul. 7, 1998
`
`Sheet 2 of 2
`
`5,778,181
`
` SEND NETSCAPE
`
`GOTO COMMAND
`
`SOFTWARE DESIGN
`
`FIG. 3
`
`Petitioner Hyundai Ex-1023, 0003
`
`Petitioner Hyundai Ex-1023, 0003
`
`

`

`5.778.181
`
`1
`ENHANCED VIDEO PROGRAMMING
`SYSTEM AND METHOD FOR
`INCORPORATING AND DISPLAYING
`RETRIEVED INTEGRATED INTERNET
`INFORMATION SEGMENTS
`
`This application is a continuation-in-part of application
`Ser. No. 08/613.144.
`filed Mar. 8, 1996, entitled “AN
`INTEGRATED INTERACTIVE VIDEO AND INTERNET
`SYSTEM”now abandoned.
`
`BACKGROUND OF THE INVENTION
`
`Today, the capabilities of computers to provide massive
`amounts of educational and entertainment information has
`exploded with the Internet. The Internet has the power to
`transform society through unprecedented levels of informa-
`tion flow between members. Currently, on-line systems offer
`a variety of different services to users, including news feeds,
`electronic databases (either searchable by the user directly
`on the on-line system, or downloadable to the users own
`computer), private message services, electronic newsletters,
`real time games for play by several users at the same time,
`and job placement services. to name a few. However, today.
`most on-line communications occur merely through text.
`This currently stands in great contrast to the audio/visual
`presentation of the alternative electronic medium, television.
`However,
`it is expected that as multi-media’s incessant
`growth continues. audio/visual programswill proliferate and.
`text will become less and less dominant in the on-line
`environment. Even though these programs will be
`introduced,
`the Internet, will remain essentially user
`unfriendly due to its very massiveness, organization, and
`randomness. Simply stated, there is no order or direction in
`the Internet. Specific pieces of information are many times
`hard to find, and harder yet, is the ability to put that piece of
`information into a meaningful context.
`Television, on the other hand. has beencriticized for being
`a passive medium—“chewing gum for the eyes,” as Fred
`Allen once observed. Television has always been something
`you watched, not something you do. Many social critics
`believe that the passivity television depends on has seeped
`into our entire culture, turning a nation of citizens into a
`nation of viewers. While interactive television systems have
`increased the level of user interaction, and thus, provided
`greater learning and entertainment opportunities, vast infor-
`mation resources such as databases are inaccessible from
`such a medium.
`
`Whatis needed is a meansto close the gap between video
`programming and the information superhighway of the
`Internet. What
`is needed is a wider, richer experience
`integrating audio/visual and textual database elements into
`an organized unique interactive. educational, entertainment
`experience. Currently, the Internet is a repository of infor-
`mation on virtually any subject. However, what is needed is
`a mechanism for combining the user-friendly visual expe-
`rience of television with the vast information resources of
`the Internet.
`
`SUMMARYOF THE INVENTION
`
`The system of the present invention combines broadcast
`television programming and/or video programming which
`appears on a VHS or Beta tape, CD-ROM. DVDorother
`medium, or video programming at a video server
`(hereinafter “video programming”) with the massive
`Internet, creating a new and powerful educational and enter-
`tainment medium. The system allows consumersto receive
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`45
`
`30
`
`55
`
`65
`
`2
`more information in a more efficient manner than either
`television or the Internet alone. Consumers not only can see
`a news report on television, but they can also read pertinent
`information about
`the report. as well as explore related
`information about
`the story. The program becomes the
`introduction to a particular subject, rather than the entire
`subjectitself. The act of viewing a program has now become
`a more engaging. enriching experience.
`The system can also create a more intimate relationship
`between the viewer and the program. The user might be
`solving problems or performing virtual experiments on the
`Internet site that a teacher is discussing in an educational
`television program. Similarly, the consumer might be solv-
`ing problems that the fictional characters in a television
`program mustsolve. In both cases. the consumer is an active
`participant in the process, rather than a passive observer.
`Instead of an undirected and unfocused exploration of
`Internet sites. by synching specific Internet pages to the
`video signal, the system puts the Internet in context. The
`television program producers now can decide what addi-
`tional information to offer their audience. This material can
`now be seen in the context of the television program.
`An additional advantage is that consumers don’t have to
`search throughtheliterally hundreds of millions of pages on
`the Internet to find appropriate material. The material has
`already beenfiltered by the program producers and delivered
`to the consumer automatically.
`Another advantage of the system is that it changes the
`nature of advertising. Since additional information can be
`given to consumers automatically, advertising can now be
`more substantive. allowing customers to make more
`informed choices. Now,the act of purchasing a product seen
`on television can be streamlined—the consumer can be
`given the choice of buying the product instantly using the
`two-way capabilities of the system.
`Another advantage of the current system is that in the
`alternative embodiment.
`the local user need not have a
`vertical blanking interval (VBI) reader to receive the uni-
`form resource locators (URLs). Therefore, digital video can
`be used as the video source. The Interacast, by comparison,
`is an analog video product.
`By marrying the appeal of television with the two-way
`data transfer capabilities of the Internet, the system creates
`a powerful new medium:Television producers and Internet
`site creators can enhance their content, advertisers can speak
`more directly to consumers, and consumers can gain a new
`level of interest and interactivity over a video-based
`medium.
`
`Now, several media companies have joined to create a
`system for linking the Internet andtelevision on the personal
`computer, called “Intercast.” In this system, content will be
`provided simultaneously with the TV video signal. This
`system, however, requires that stripped down Web pages be
`sent in the vertical blanking interval (VBI) of the video
`signal, using up to three scan lines limiting effective band-
`width to approximately 28.8 kbps. This approach, however.
`requires specialized hardware to both insert the Web pages
`into the VBI and extract these codes at each PC sinceit takes
`up to three scan lines of the VBI. Thus, the complexity and
`cost of the PC is increased. Because the Web pages are
`transmitted with the video signal. the Intercast system is not
`a true “two-way”system, but merely a one-way “piggyback”
`system.
`The system of the present invention, on the other hand,is
`a much more flexible, but less complex, system. First, the
`actual Web pages are not forced into the very limited
`
`Petitioner Hyundai Ex-1023, 0004
`
`Petitioner Hyundai Ex-1023, 0004
`
`

`

`5,778,181
`
`3
`bandwidth of the vertical blanking interval (VBI). Instead.
`merely eight fields of line 21 of the VBIare used to deliver
`the relevant Internet Web page addresses to the PC. These
`addresses are called “uniform resource locators” (URLs).
`The system then directs the particular Web browser to
`retrieve the identified Web pages from the Internet. Upon
`receipt of the particular Web page(s). the system syncs the
`Web page(s) to the video signal. and at the appropriate times,
`presents the Web pages on one portion of the computer
`screen with the television video signal. shown in a window
`on another portion of the screen, and thus, provides the
`synergistic Internet and television experience. One of the
`advantages of the system of the present invention is that no
`specialized chip set need be produced and implemented into
`the standard PC. Thus. complexity is kept to a minimum.
`Thus, it is an object of the present invention to provide
`order and direction to the Internet by using television signals
`to place, orient and control such information in a meaningful
`context.
`
`It is an object of the present invention to create a more
`intimate relationship between the viewer and the program by
`enriching the learning experience through the provision of
`more indepth information.
`
`DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a diagram of the system design, showing the
`receipt and decoding of video signals at the subscriber
`location using the method of the present invention.
`FIG. 2 is a diagram showing an alternative system
`embodimentto achieve the integration of the Internet infor-
`mation with the video content by decoding the uniform
`resource locators at a server site and then transmitting the
`URLsto the subscriber stations via the Internet.
`
`FIG. 3 is a flow diagram of the basic software design of
`the present invention.
`PREFERRED EMBODIMENT
`
`The system of the present invention combines the rich
`visual capabilities of television with the vast resourcesof the
`Internet. As shown in FIG. 1, the present invention is a
`computer based system for receiving a video program along
`with embedded uniform resource locators (URLs)—which
`direct the user’s computer 16 to address locations, or Web
`sites. on the Internet 2¢ to retrieve related Web pages. These
`Web pages correspond to the video presentation. The par-
`ticular video programming can be delivered in analog.
`digital or digitally compressed formats (e.g.. MPEG2) via
`any transmission means, including satellite. cable. wire, or
`television broadcast.
`
`The video programming is preferably created at a cen-
`tralized location, i.e., content creation 4 as shown in FIG.1,
`for distribution to subscribers in their homes, for example.
`Program creation is accomplished according to any conven-
`tional means known in the art. After a video program is
`created, uniform resource locators are embedded,preferably,
`into the vertical blank interval of the video programming by
`the URL encoder 8, shown in FIG. 1. In the preferred
`embodiment, the URLs are encoded onto eightfields of line
`21 of the VBI. Line 21 is the line associated with close
`captioning, among other things. However. the URLs could
`also be embedded in other fields of the VBI, in the horizontal
`portion of the video, as part of the audio channel, or in any
`subcarrier to the video. Preferably. the URLs have associ-
`ated time stamps which indicate to the subscriber stations
`when, during the video program, to display the particular
`Web pages addressed by the URLs.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`45
`
`50
`
`35
`
`65
`
`4
`The particular information in line 21 is not part of the
`visual part of the program, and thus, is not perceptible to the
`human eye. thereby makingit ideal to send data information
`to the users. While the bandwidth capacity of line 21 is
`limited, because the system of the present invention trans-
`mits only the uniform resource locators (URLs). and notfull
`Web pages,
`there is more than enough capacity.
`Furthermore. no additional hardware is necessary at the PCs
`16 to implementthe elements of the present invention. Thus,
`the present invention has the additional advantages of being
`very efficient and takes advantage of conventional hardware.
`Once the video program is created, it can be transmitted
`to user sites over any transmission means.
`including
`broadcast, cable, satellite. or Internet. and may reside on
`video servers. Furthermore, the video program, with embed-
`ded URLs, can be encoded on a VHSor Beta tape. DVD or
`other medium.
`
`Preferably, each receiver station comprises any Intel x86
`machine (preferably a 486 processor. pentium processor.
`etc.), an Apple Computer. UNIX or any other type of
`standard computer workstation. The local PC 16 is prefer-
`ably connected to either a cable and/or broadcast television
`connection or to a local VCR or other video source. At each
`subscriber site. the local personal computer 16 preferably
`receives the cable transmission by cable connection on the
`back of the personal computer 16. The video/audio program
`can then be processed for display on the computer screen
`using any conventional PC card capable of displaying NTSC
`signals on a computer monitor, such as a WinTV card. In
`addition to the cable connection, however, in the present
`invention there is also an Internet 20 connection created
`concurrently with the cable connection.
`TheInternet 20 connection can be via high-speed line, RF,
`conventional modem or by way of two-way cable carrying
`the video programming. The local PC 16 has internet access
`via any of the current ASCII software mechanisms. In the
`preferred embodiment, at each subscriber home, an associ-
`ated local URL decoder 12 receives the cable video televi-
`sion program, as shown in FIG. 1. The local URL decoder
`12 extracts the URLs, preferably embedded in the vertical
`blanking interval, with the use of any conventional VBI
`decoder device. The URL decoder 12 may be either a
`standalone unit or a card which is implemented into the
`personal computer 16.
`In an alternative system shown in FIG. 2, the uniform
`resource locators (URLs) are encoded into the video in the
`same manner as described above. Again.
`the URLs are
`preferably encoded onto eight fields of line 21 of the VBL
`However, the URL decoder 24 is located at the serversite.
`as opposed to the subscriber location. When the decoder 24
`receives the video program signal. it strips out the URL
`codes on line 21 of the VBI and delivers these codes
`independently to an Internet server 28. The URL code is then
`subsequently delivered over the Internet 20 to the user PC
`16. Simultaneously. the video is broadcast over conventional
`broadcast or cable transmission means 36 to the user’s
`personal computer 16.
`
`System Operation
`
`Once the URLs have reached the personal computer 16,
`system operation is the same for both of the embodiments
`diagramed in FIGS. 1 and 2.
`In the preferred embodiment. a JAVA enabled browser as
`well as specialized software for performing part of the
`method of the present invention are installed on the com-
`puter. The JAVA enabled browser allows the computer 16 to
`
`Petitioner Hyundai Ex-1023, 0005
`
`Petitioner Hyundai Ex-1023, 0005
`
`

`

`5.778.181
`
`5
`retrieve the Web pages andis preferred software, since it is
`platform independent, and thus. enables efficient and flexible
`transfer or programs, images, etc., over the Internet 20. The
`specialized interface software (hereinafter. “client
`software”), attached as Appendix A, acts as an interface
`between the video programming and the Internet functions
`of the present invention. The client software retrieves URLs
`from the video program, interpret these URLs and direct the
`JAVAenabled browserto retrieve the particular relevant web
`pages, and synchronizes the retrieved Web pages to the
`video content for display, as shown in FIG. 3 and explained
`in more detail below.
`
`the URLs are encoded and
`In the preferred method,
`embedded into the video signal by inserting them into the
`vertical blanking interval (VBI), as mentioned above.
`The method of the present invention has the capability to
`detect identical URLssent directly after one another which
`causes the browser not to fetch URLs in these particular
`cases. As shown in FIG. 3, once the URL code is received
`at the computer, the client software first interprets the URL
`and determines whether the particular URL has been
`received previously 42. If it has already been received, the
`next received URL is interpreted for determination of prior
`receipt. If the particular URL has not been detected before,
`the software checks for misspelling 46 and any othererrors,
`and if errors exist. corrects these particular errors. Once
`again, it is determined whether the URL has been previously
`detected. If it has, the next URL is accessed 38. If the URL
`has not been detected, the specific URL is added to the URL
`list 54. The specific URL is then sent to the Web browser,
`preferably a Java enabled browser. Upon receipt of the URL.
`the browser will access the Website address indicated by the
`URL andretrieve the cited Web page(s) 58 via the Internet.
`Viewers can view the integrated presentation in the fol-
`lowing manner. As mentioned above, the video signal is
`processed and displayed on a video window on the PC
`screen using a Win TV card, for example. The corresponding
`audio is forwarded to the audio card and sent to the PC
`speakers.
`The actual retrieved Web pages. referenced by the URL,
`are preferably time stamped to be displayed on the computer
`screen when predetermined related video content is dis-
`played in the video window,thus, enlightening and enhanc-
`ing the video presentation by providing indepth information
`related to the video content thereto. Another section on the
`screen is also preferably used to represent an operational
`control panel. This control panel provides a list of the URLs
`that have been broadcast and correspondingly received by
`the computer 16. This control panel is updated to add a URL
`code each time a new URL code is received by the PC 16.
`This list gives the subscriber the flexibility to go back and
`retrieve particularly informative or interesting Web pages
`that have already been displayed earlier in the program, or
`alternatively,
`to print
`them out for future reference.
`Furthermore, the list could include URLsreferring to Web
`pages not displayed with the broadcast program. but that
`provide further information on a certain topic of interest to
`the viewer.
`
`The present invention can best be understood with refer-
`ence to an example. A viewer can begin watching a musical
`
`6
`video featuring a new band, for example. As the video is
`received by the PC 16, URLsare being extracted from the
`vertical blanking interval and are being interpreted by the
`client software. Upon direction and command. the JAVA
`enabled browser retrieves particular Web pages from Inter-
`net 20 Web sites identified in the URLs. These Web pages
`will then be displayed on the video screen at particular
`times. Thus, for example, while the viewer is watching the
`music video, biographical information on the band can also
`be displayed adjacently to the video window. Web pages
`could also include an upcoming concert schedule, or even
`audio clips of the band’s music may be downloaded from the
`Internet 20. As another example. a user could be watching a
`program relating to financial news. While the narrator is
`shown discussing high tech stocks, Web pages correspond-
`ing to detailed financial performance information on high
`tech stocks, environment and characteristics can be dis-
`played with the video on the computer screen. When the
`program narrator switches to a discussion on the weekly
`performance of the Dow Jones. Web pages presenting
`related financial performance information can be simulta-
`neously displayed. Thus. it is evident that the present inven-
`tion profoundly enriches the viewing and learning experi-
`ence.
`
`It is understood that there can exist alternative embodi-
`ments for use with the present invention. For example, the
`user can view the interactive program using a television set
`or other display monitor in conjunction with the display
`screen of the personal computer 16. In this embodiment, the
`relevant Web pages are shown on the personal computer 16
`while the video program is displayed on the television
`monitor. In this alternative embodiment, a cable set top box
`receives the television program from the multichannelcable.
`The personal computer 16 also receives the video program
`from the multi-channel cable and extracts the URLs, pref-
`erably embedded in the vertical blanking interval of the
`video signal. The computer software extracts the URLs and
`retrieves the particular web pages as described above. The
`web pages are then synchronized with the particular video
`frames and presented to the user. It is understood that a
`hyperlink may exist on the Web site that will allow the user
`to automatically load the client software and call up the
`specific television channel referenced in the Web site. For
`example, someone browsing the Internet 20 may come upon
`a major television network’s Web site. They scroll to an
`interesting story then click on an hyperlink to turn on the
`software which tunes the TV window to the network to
`enhance the information residing at the Web site.
`
`Furthermore, instead of receiving the video program from
`a transmission means, the video program can be addressed
`directly from the user site if the video program. with
`embedded URLs, is stored on a VHS, Beta, DVD or other
`medium. In this embodiment. the user PC 16 and/or televi-
`sion are connected to a VCR, DVDplayer or other appro-
`priate device.
`
`Using the foregoing embodiments, methods and
`processes, the system of the present invention creates a
`synergistic experience combining the vast resources of the
`internet with the presentation capabilities of television.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`45
`
`50
`
`55
`
`Petitioner Hyundai Ex-1023, 0006
`
`Petitioner Hyundai Ex-1023, 0006
`
`

`

`5.778.181
`
`APPENDIX A
`
`At
`
`Petitioner Hyundai Ex-1023, 0007
`
`Petitioner Hyundai Ex-1023, 0007
`
`

`

`5.778.181
`
`nativeinputStream. java
`
`EEI ITO ARRi ar a Ge RIC Re re KE #
`
`opyright Notice: This source code is [{C) Copyright 1996, EarthWeb LLC.
`
`* C
`
`All Rights Reserved. Distribution of this document or it's resuiting
`compiled code is granted for non-commercial use, with prior approval of
`FarthWeb LLC. Distribution of this document or
`its resulting compiled
`code,
`for commercial use,
`is granted only with prior written approval 9
`
`to info@earthweb.com.
`send email
`information,
`arthWeb, LLC. For
`EEA RO RA I IOI AO RR RR Kk Rok RR eK RK
`éi
`public class nativeInputStream extends java.io.InputStream {
`public native int read();
`public native void nativeinit();
`public nativeInputStream(} {
`super ();
`nativeinit();
`
`f E
`
`}s
`
`}
`
`tatic {
`System. loadLibrary ("instream");
`
`Page
`
`AZ
`
`
`Petitioner Hyundai Ex-1023, 0008
`
`Petitioner Hyundai Ex-1023, 0008
`
`

`

`11
`
`12
`
`5,778,181
`
`nativeInputStreamCode.cpp
`
`~
`
`A IO I ERI ITO BI OR ROK RS SE EER wee
`
`Copyright Notice: This source code is iC} Copyright 1996, EarthWeb LLC.
`All Rights Reserved. Distribution of this document or it's resulting
`compiled code is granted for non-commercial use, with prior approval of
`EarthWeb LLC. Distribution of this document or its resulting compiled
`code,
`for commercial use,
`is granted only with prior written approval o
`
`to info@earthweb.com.
`information, send enail
`warthWeb, LLC. For
`Ge TT FR RR RRR Ri tk sk aR rR si de ie eeI i ter
`
`#include <StubPreamble.h>
`#include “nativeInputStream.h"
`#include <Windef.h>
`#include <Winbase.h>
`Hinclude <stdio.h>
`
`HANDLE hj
`
`long nativeInputStream_read(struct HnetiveTnputStream *)
`DWORD evttype;
`unsigned long nread = 0; // the number of characters read
`unsigned char result; // the character read
`while (nread == ©) ReadFPile(h,
`(LPvoID}éresult, 1, &nread, NULL);
`return (long) result;
`
`{
`
`i v
`
`(LPVOID) comcode, 2, &nwritten, NULL
`
`princtft("veah!"};
`
`Page i
`
`A}
`
`Petitioner Hyundai Ex-1023, 0009
`
`oid nativeInputStream_nativeinit (struct HnativeInputStream *)
`h = CreateFile("COM1", GENERIC READ|GENERICWRITE, 0, NULL,
`CPEN_EXISTING, 9, NULL);
`
`{
`
`DCB dcb;
`GetCommStateih, &dcb);
`dcb.BaudRate
`= 9600;
`deb. ByteSize
`= 8;
`deb. Parity
`= NOPARITY;
`dcbh.StopBits
`= ONESTOPBIT;
`SetCommState(h, &dcb);
`SetCommMask(h, EV_RXCHAR);
`char *comcode = "\1B";
`unsigned long nwritten = 0;
`while {nwritten<2}) WriteFile(h,
`
`Petitioner Hyundai Ex-1023, 0009
`
`

`

`13
`
`14
`
`5.778.181
`
`Serial.cpp
`
`~
`
`LE RE EE ETE RR a an a nen RR RE EER EEN SS BES
`
`opyright Notice: This source code is (C) Copyright 1996, BarthWeb LLC.
`All Rights Reserved. Distribution of this document or it’s resulting
`compiled code is granted for non-commercial use, with prior approval of
`EarthWeb LLC. Distribution of this document or its resulting compiled
`code,
`for commercial use,
`is granted only with prior written approval o
`arthweb, LLC. For information, send email
`to info@earthweb.com.
`BETAR III RO IO TOR IO HR IIR EIR ER REE
`
`t E
`
`* C
`
`#include <Wintypes.h>
`#include <Winbase.h>
`f#include <Windef.h>
`#include <stdio.h>
`#include <conio.h>
`
`U
`//#define COM1L = Ox3F8
`aI rywo
`OQ
`/f4#define COM2 =
`Ox2
`
`HANDLE h;
`{
`int main()
`unsigned char result;
`unsigned long nread;
`
`if (nh
`
`h = CreateFile("COM1", GENERIC_READ|GENERIC_WRITE, 0, NULL,
`OPENEXISTING, 0, NULL);
`== INVALID_HANDLE_VALUE)
`{
`printf ("NOOO00!");
`CB dcb;
`GetCommState th, &dcbh);
`deb. BaudRate
`= 9600;
`deb. ByteSize
`= B;
`dcb.Parity
`= NOPARITY;
`deb.StopRits
`= ONESTOPBIT;
`SetCommState(h, &dcb);
`
`}D
`
`SetCommMask(h, EV_RACHAR);
`printf("Reading serial portivn");
`
`DWORD evttype;
`while (1)
`{
`{
`printfi™sc", nativeinputStream_read()
`WaitCommEvent(h, gevttype, NULL);
`while (ReadFileith,
`{(LeVOLD) &result, 1, &nread, NULL) }
`printfé"3c", result); +f
`
`\ r
`
`eturn 0;
`
`ix
`
`AT
`
`Page l
`
`Petitioner Hyundai Ex-1023, 0010
`
`Petitioner Hyundai Ex-1023, 0010
`
`

`

`15
`
`16
`
`5,778,181
`
`Serial.cpp
`
`{
`
`long nativeinputStream_read({)
`DWORD evttype;
`// the number of characters read
`unsigned long nread;
`// the character read
`unsigned char result;
`WaitCommEvent(h, sevttype, NULL);
`ReadFileth,
`(LPVOID)&result, 1, &nread, NULL);
`return (long}result;
`
`> Rt)
`
`
`ho
`
`Petitioner Hyundai Ex-1023, 0011
`
`Petitioner Hyundai Ex-1023, 0011
`
`

`

`17
`
`18
`
`5.778.181
`
`TVcontrol.java
`
`~
`
`I IER TKII TTI ER A EKER EE
`
`* C
`
`opyright Notice: This source code is (C) Copyright 1996, EarthWeb LLC.
`All Rights Reserved. Distribution of this document or it's resulting
`compiled code is granted for non-commercial use, with prior approval of
`EarthWeb LLC. Distribution of this document or its resulting compiled
`code,
`tor commercial use,
`is granted only with prior written approval o
`ft
`EarthWeb, LLC. For
`information, send email
`to info@earthweb.com.
`er er LeI I RI IT OR IRR III II KA AOR ERS II Oe B®
`
`y i
`
`mport java.applet.*;
`import
`java.awt.*;
`import
`java.io.*?
`import
`java.net.URL;
`ompert
`java.net .MalformedURLException;
`import java.util.Hashtable;
`
`{
`-lass blackPanel extends Panel
`{
`public void paint (Graphics g)
`g.setColor(Color.black);
`g.filiRect (0, 0, size().width, size({).height);
`
`i c
`
`lass displayFrame extends Panel
`int xoffset = 30;
`int yoffset = 40;
`
`implements Runnable {
`
`ff
`
`List URLIist;
`TextField textl;
`Checkbox autobrowse;
`String teatlStr = "";
`int rlz, xly;
`AppletContexzt ape;
`
`Thread thread;
`InpucStream din;
`Hashtable dict;
`Hashtable visited;
`
`// HACK ALERT
`boolean periodbefore;
`t
`0 displayframe (String frameName, AppletConteat apc,
`publi
`
`Inputs
`
`super (frameName) ;
`this.ape = apc?
`agin = ins
`dict = new Hashtable();
`yisited = new Hashtable(};
`
`Face 1
`
`Aé
`
`
`Petitioner Hyundai Ex-1023, 0012
`
`Petitioner Hyundai Ex-1023, 0012
`
`

`

`19
`
`20
`
`5,778,181
`
`TVcontrol.iava
`
`~
`
`thread = new Thread(this);
`thread.starti),;
`
`resize(106 + xoffset, 156 + yoffset);
`
`rlx = -{size()-width/4);
`rly = size() -height/4;
`
`setLayout! new BorderLayout(} );
`addi "South", autobrowse = new Checkbox ("Autobrowse")};
`autobrowse.setState (true);
`
`URLlist = new List);
`add("Center", URLlist);
`//ri.setConstraint (URLlist, auteobrowse, RelativeLayout.
`
`//rl.setConstraint (URLlist, pbuttond, RelativeLayout.und
`
`/
`/
`f
`
`URLlist.setBackground( Color.cyan }):
`Font newfont = new Font("TimesRoman", Font.PLAIN, 10);
`URLlist.setFont{ newfont };
`
`ublic synchronized void turnToURL (String s, String target)
`System.out.printin("Turning to URL " + 8 + target);
`visited.put(s,
`this};
`try apc.showDocument (new java.net.URLis},
`catch (Exception e);
`
`target);
`
`{
`
`} p
`
`} p
`
`ublic void turnToTitle(String s, String target} {
`System.out.printin("Turning to Title "+ s + target);
`turnToUR! ( (String) (dict.get(s})},
`target);
`
`} p
`
`ublic synchronized void addURL (String title, String url)
`String previous = (String) (cict.get/title));
`if (! (dict.containsKey(title})} URLList.addTtem(title);
`dict.put (title, url};
`
`{
`
`public void runi)
`
`{
`
`Thread. currentThread({).setPriocrity( Thread.MiN PRIORITY |;
`System.out.printin("Context: "“tapcon);
`char buff]
`= new char[128];
`int bufidx = @;
`boolean capture = false;
`String cturrentTitle = null;
`
`Petitioner Hyundai Ex-1023, 0013
`
`Petitioner Hyundai Ex-1023, 0013
`
`

`

`21
`
`22
`
`5.778.181
`
`T¥Vcontrol. java
`
`_
`
`// Listener loop
`
`int c
`
`periodbefore = false;
`
`dx};
`
`resulti:
`
`} i
`
`entTitle, result);
`
`d.containskey(result)))
`
`{
`
`ms ()-1);
`
`!= -1} {
`
`while ({(c = (din.read()))
`if {c == '.') {
`if (capture && periodbefore)
`bufidx--;
`c = (byte) '>';
`periodbefore = false;
`} else periodbefore = true;
`} else periodbefore = false:
`if ({char)
`e= T>ty
`{
`capture = false;
`String result = new String(buf, 0, bufi
`
`{
`
`System.out.println("Remote found tag “+
`
`if (result.startsWith("URL:"))
`result = result.substring (4);
`if (currentTitle != null) addURLi(curr
`
`{
`
`if jautobrowse.getState(} &&
`
`! (visite
`
`URLList.select(URLList.countite
`
`turnToURL(result, “browser");
`
`urrentTitle = null;
`
`}c
`
`}e
`
`lse if (result.startsWith("Title:")})
`currentTitle = result-substring(6)};
`
`{
`f (capture)
`buf [bufidzt++] = (char)c;
`if (pufidx >= Buf. length)
`capture = false;
`
`}a
`
`f
`
`{
`f{f{charjc == '<'")
`captures =
`true;
`bufidx = 0;
`
`}
`
`}
`./ This is an acceptable exception
`catch! EOFException e ) System.out.printin( "“URLClient: eof" };
`¢/ This is probably not.
`catch( TOException e
`) System.out.printin( “URLClient.run:
`}
`
`"+e };
`
`if
`
`public void paint (Graphics g)
`
`{
`
`arc.
`
`3
`
`ad
`
`
`Petitioner Hyundai Ex-1023, 0014
`
`Petitioner Hyundai Ex-1023, 0014
`
`

`

`23
`
`24
`
`5,778,181
`
`TVcontrol. java
`
`—
`
`q.setColor(Color.black);
`g.fillRect(0, 6, size().width, size(). height};
`
`} p
`
`ve
`iy
`if
`
`} p
`
`ublic void update(Graphics g)
`repaint();
`
`{
`
`ublic boolean action{Event evt, Object what)
`URL where;
`
`{
`
`turnToTitle((Stringjwhat, “browser");
`repaint();
`return true;
`
`} p
`
`{
`ublic class TVcontrol extends Applet
`static displayFrame remoteFrame = null;
`
`{
`public void init{)
`InputStream in;
`AppletContext ape = getAppletContext{);
`
`in = new nativeInputStream();
`setLayout (new BorderLayout());
`
`if (remoteFrame == null}
`remoteFrame = new displayFrame ("Remote Control”
`
`, apc,
`
`in);
`
`add("Center"”, remoteFrame} ;
`remot