a2, United States Patent
`US 6,789,263 B1
`(10) Patent No.:
`Sep. 7, 2004
`(45) Date of Patent:
`Shimadaet al.
`
`US006789263B1
`
`(54) DATA CONVERSION METHOD AND
`APPARATUS
`
`(75)
`
`Inventors: Takao Shimada, Yokohama(JP);
`Naoko Iwami, Machida (JP); Tomohisa
`Kohiyama, Yokohama (JP); Mitsuo
`Hayashi, Koshigaya (JP); Yasuyuki
`Kuwahara, Hadano (JP)
`
`JP
`JP
`JP
`JP
`JP
`
`(73) Assignee:
`
`Hitachi, Ltd. (JP)
`
`........... 709/203
`4/2000 Theriault et al.
`6,049,821 A *
`2/2001 Tso etal. wee 709/247
`6,185,625 B1 *
`FOREIGN PATENT DOCUMENTS
`
`57174769
`63086655
`7044687
`8006875
`8083157
`
`10/1982
`4/1988
`2/1995
`1/1996
`3/1996
`
`OTHER PUBLICATIONS
`
`(*)
`
`Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`US.C. 154(b) by 0 days.
`
`(21)
`
`(22)
`
`Appl. No.:
`Filed:
`
`08/878,259
`
`Jun. 18, 1997
`
`Related U.S. Application Data
`
`(63) Continuation-in-part of application No. 08/633,311, filed on
`Apr. 15, 1996.
`
`(30)
`
`Foreign Application Priority Data
`
`May 17, 1995
`(IP)
`eccecccceeceeccstestestestestestestestenens 7-118673
` Jun. 27,1995
`(JP)
`....
`.. 7-160972
`Jul. 18, 1995
`(JP)
`....
`.. 7-181550
`Jun. 20, 1996
`(IP)
`oeeeeeeeeccessccesseeesesecnsenseeeesaes 8-159487
`
`TInt, C7 eee cecessseeeneeneeneeneeneeneeneees HO4N 7/173
`(SL)
`(52) US. Ch. oe 725/119; 725/95; 725/105;
`725/37; 709/246
`(58) Field of Search oo... cece 725/119, 118,
`725/120, 114, 116, 91, 93, 97, 98, 105,
`121, 95; 709/219, 203, 206, 207, 246; HO4N 7/16,
`7/173
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`T. Berners—Lee, et al., The Wordl-Wide Web, Communica-
`tion of the ACM,vol. 37, No. 8, Aut. 1994, pp. 76-82.
`L. Lemay, Teach YourselfMore Web Publishing with HTML
`in a Week, Appendix D, Dec. 1995, pp. 506-519.
`M. E. S. Morris, HTML for Fun and Profit, SunSoft Press,
`A Prentice Hall Title, 1995, pp. 207-212.
`
`* cited by examiner
`
`Primary Examiner—Chris Grant
`(74) Attorney, Agent, or Firm—Sofer & Haroun, LLP
`
`(57)
`
`ABSTRACT
`
`A data conversion apparatus included an information input
`device, a holder for holding information designating a
`method of the conversion processing from input portion
`when the kind of the input information is examined and is
`judged as predetermined data for executing a data conver-
`sion processing, a convertor for executing the data in accor-
`dance with a predetermined rule, a synthesizer for generat-
`ing new data by combining the input information with a
`predetermined data content, and an information output
`device for outputting the new data so generated. When the
`kind of the data is screen configuration data describing
`configuration of the screen output of an information pro-
`cessing unit, the predetermined rule adds a display area of
`the screen configuration and converts it to a screen configu-
`ration data capable of displaying a plurality of screen
`configurations on the same screen.
`
`4,574,305 A *
`5,729,281 A *
`
`3/1986 Campbell etal. ........... 725/119
`3/1998 Utsumiet al. 0.00.0... T25/119
`
`23 Claims, 39 Drawing Sheets
`
`STRUCTURAL EXAMPLE
`OF THIS INVENTION
`
`t-101
`
`SERVER
`
`
`
`
`102
`
`
`
`CONFIGURATION |-_-403
`EXPANDING
`DEVICE
`
`
`
`
`
`
`CLIENT
`
`
`
`
`[105
`
`SAMSUNG 1008
`
`IPR2024-00145
`Apple EX1008 Page 1
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 1 of 39
`
`US 6,789,263 B1
`
`FIG. 4
`
`STRUCTURAL EXAMPLE
`OF THIS INVENTION
`
`
`
`SCREEN
`CONFIGURATION
`EXPANDING
`DEVICE
`
`103
`
`
`
`6101
`
`
`
`NETWORK
`
`104
`
`CLIENT
`
`
`
`
`FIG. 1
`
`STRUCTURAL EXAMPLE
`OF THIS INVENTION
`
`SERVER
`
`101
`
`
`
`
`SCREEN
`CONFIGURATION
`EXPANDING
`DEVICE
`
`103
`
`104
`
`CLIENT
`
`105
`
`IPR2024-00145
`Apple EX1008 Page 2
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 2 of 39
`
`US 6,789,263 B1
`
`FIG. 2
`
`EXAMPLE OF CONSTRUCTION OF SCREEN CONFIGURATION
`EXPANDING DEVICE
`
`103
`
`102
`
`
`
`CPU
`
`MEMORY
`DEVICE
`
`
`
`
`
`COMMUNI-
`CATION
`CONTROL
`
`
`PORTION
`
`
`
`201
`
`202
`
`203
`
`
`
`204
`
`207
`
`205
`
`206
`
`COON.
`AUXILIARY
`EXTERNAL
`Boe
`MEMORY
`MEMORY
`PORTION
`DEVICE
`VO
`
`
`
`208
`
`
`
`CD-ROM
`DRIVE
`
`209
`
`
`
`104 ~—
`
`
`
`210 MEGNETIC
`
`
`
`TAPE
`STREAMER
`
`
`
`
`
`
`211
`
`
`
`DVD-ROM
`
`IPR2024-00145
`Apple EX1008 Page 3
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 3 of 39
`
`US6,789,263 B1
`
`FIG. 3
`EXAMPLE OF FUNCTIONAL BLOCK OF
`SCREEN CONFIGURATION EXPANDING DEVICE
`
`103
`
`312
`
`REQUEST PROCESSING
`PORTION
`394
`
`COMMAND
`ANALYSIS
`
`
`a PORTION,|
`
`
`SERVERSIDE
`
`CLIENTSIDE
`
`emcee
`Se
`
`DATAKINDDETECTION
`
`ANALYSIS
`INFORMATIN
`
`SCREEN
`CONFIGURATION
`TEMPLATE
`
`SETTING
`MANAGEMENT
`TABLE
`
`313
`
`PORTION
`
`319
`
`SCREEN CONFIGURATION
`EXPANDING PORTION
`
`
`306 ~
`
`DATA CONVERSION
`PORTION
`
`RESPONSE PROCESSING PORTION
`
`303
`
`IPR2024-00145
`Apple EX1008 Page 4
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 4 of 39
`
`US6,789,263 B1
`
`FIG. 5
`EXAMPLE OF SCREEN CONFIGURATION DATA
`
`508
`
`CLASSIC CAR MUSEUM <BR >
`
`SUPER-SPORTS 20<BR>
`/CENTER>
`O-XPASS OF EARLY SUMMER WAS PHOTOGRAPHED
`‘ DURING DRIVING. < B R>
`THE IMAGE CAN BE VIEWED BY SELECTING BUTTON. <BR>
`‘<IMG SRCG="pictA gif’><BR>
` — }
`}
`
`<A HREF="pictC. gif" > RUNNING SCENE 2</A>t .-902
`
`_- 903
`
`.- 504
`
`_- 905
`
`_- 906
`
`IPR2024-00145
`Apple EX1008 Page 5
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 5 of 39
`
`US 6,789,263 B1
`
`FIG. 6
`DISPLAY EXAMPLE 1 OF CLIENT SCREEN
`
`601
`
`602
`
`603
`
`604
`
`
`
`CLASSIC CAR MUSEUM
`
`SUPER-SPORTS 20
`
`OX PASS OF EARLY SUMMER WAS
`
`PHOTOGRAPHED DURING DRIVING.
`THE IMAGE CAN BE VIEWED BY
`SELECTING BUTTON.
`
`
`
`
`
`
`606
`
`RUNNING
`SCENE _1
`
`RUNNING
`SCENE 2
`
`605
`
`CONTINUED TO
`NEXT PAGE
`
`701
`
`702
`
`FIG. 7
`DISPLAY EXAMPLE 2 OF CLIENT SCREEN
`
`
`
`
`
`IPR2024-00145
`Apple EX1008 Page 6
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 6 of 39
`
`US6,789,263 B1
`
`FIG. 8
`EXAMPLE OF EXPANDED SCREEN CONFIGURATION DATA
`
`507
`
`CENTER>
`CLASSIC CAR MUSEUM <BR>
`
`SUPER-SPORTS 20<BR>
`
`CONTINUED TO NEXT PAGE </A>
`
`OXPASS OF EARLY SUMMER WAS PHOTOGRAPHED
`
`DURING DRIVING.< B R >
`
`THE IMAGE CAN BE VIEWED BY SELECTING BUTTON. <BR>
`
`'<A HREF="pictB. gif” >RUNNING SCENE 1</A>}
`'<A HREF="pictB. small gif” >
`small</A>
`
`CA HREF="pictB. small. gif” >
`small</A>
`
`<A HREF="next html” >
`
`IPR2024-00145
`Apple EX1008 Page 7
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 7 of 39
`
`US 6,789,263 B1
`
`FIG. 9
`DISPLAY EXAMPLE 1 OF CLIENT SCREEN
`UTILIZING DATA CONVERTING DEVICE
`
`901
`
`602
`
`CLASSIC CAR MUSEUM
`SUPER-SPORTS 20
`
`MAXIMUM OUTPUT : 145ps
`MAXIMUM TORQUE : 17kg-m
`CAR WEIGHT: 1500kg
`OX PASS OF EARLY SUMMER WAS
`PHOTOGRAPHED DURING DRIVING.
`THE IMAGE CAN BE VIEWED BY
`SELECTING BUTTON.
`
`902
`
`604
`
`RUNNING
`
`605
`03
`RUNNING
`SCENE 2
`
`FIG. 10
`DISPLAY EXAMPLE 2 OF CLIENT SCREEN
`
`CONTINUED TO
`UTILIZING DATA CONVERTING DEVICE
`
`IPR2024-00145
`Apple EX1008 Page 8
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 8 of 39
`
`US6,789,263 B1
`
`FIG. 11
`EXAMPLE OF SCREEN CONFIGURATION TEMPLATE
`
`1201
`PrTTTTTTeg DLLI Lilie WALID III IITTTTerePrewry
`
`
`|TARGET=PAGE>|
`</A>!
`1202
`
`‘
`
`1203
`
`
`
`1206 °
`
`1207 °
`
`FIG. 12
`EXAMPLE OF SETTING MANAGEMENT TABLE
`
`UI BUTTON|._PAGE|CONFIGU- [IMAGE
`
`SET NO, RATION|REFERENCENAME. |REFERENCE|
`
`
`
`
`EXPANDER|EXPANDER|EXPANDER
`
`1301
`
`FIG. 13
`
`EXAMPLE OF ADDITIONAL SCREEN CONFIGURATION DATA
`
`1401 <A HREF=menu.p-quick.html
`
`TARGET=PAGE>QUICK</A>
`Ree eee eee He ee ee ee ee ee te ene ee ee ee ee ee a ee a eee ee ee ee ee ee eee '
`
`IPR2024-00145
`Apple EX1008 Page 9
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 9 of 39
`
`US6,789,263 B1
`
`FIG. 14
`DISPLAY EXAMPLE OF ADDITIONAL SCREEN
`
`CONFIGURATION DATA
`
`1501
`
`NORMAL||QUICK
`
`FIG. 15
`EXAMPLE OF SCREEN CONFIGURATION TEMPLATE
`
`1606
`
`1601
`1701
`
`FIG. 16
`EXAMPLE OF EXPANDED SCREEN CONFIGURATION DATA
`
`IPR2024-00145
`Apple EX1008 Page 10
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 10 of 39
`
`US6,789,263 B1
`
`FIG. 17
`EXAMPLE OF CONVERTED SCREEN CONFIGURATION DATA
`(QUICK MODE)
`
`509
`
`1801
`
`507
`
`CENTER>
`
`CLASSIC CAR MUSEUM< BR>
`
`SUPER-SPORTS 20<BR>
`
`</CENTER>
`
`OXPASS OF EARLY SUMMER WAS PHOTOGRAPHED
`
`DURING DRIVING.< BR >
`
`THE IMAGE CAN BE VIEWED BY SELECTING BUTTON. <BR>
`eeera ee eee ee ee ies
`
`508
`
`<A HREF="pictB. small gif” >
`RUNNING SCENE 1</A>
`pt srr frre rrr ri rrr rrr iss irre rrr rer rss rrririsrs
`
`PESTISITIT IIIA TTI IL ATI AIT TILT TLIC ILIA IIIS III IIIT III IIIT ror rsrr6r6ot
`
`<A HREF="pictC. small. gif” >
`RUNNING SCENE 2</A>
`
`<A HREF="next html” >
`CONTINUED TO NEXT PAGE </A>
`
`r-t_- 802
`
`_- 1802
`
`.- 1803
`
`.- 1804
`
`11
`
`IPR2024-00145
`Apple EX1008 Page 11
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 11 of 39
`
`US6,789,263 B1
`
`FIG. 18
`
`EXAMPLE 1 OF CLIENT SCREEN
`
`1905
`
`OX PASS OF EARLY SUMMER WAS
`PHOTOGRAPHED DURING DRIVING.
`THE IMAGE CAN BE VIEWED BY
`SELECTING BUTTON.
`
`CLASSIC CAR MUSEUM
`SUPER-SPORTS 20
`
`1902
`
`602
`
`1903
`
`RUNNING
`SCENE 2
`
`1904
`
`CONTINUED TO
`
`IPR2024-00145
`Apple EX1008 Page 12
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 12 of 39
`
`US6,789,263 B1
`
`1502
`
`FIG. 19
`EXAMPLE 2 OF CLIENT SCREEN
`
`| NORMAL||QUICK
`
`IPR2024-00145
`Apple EX1008 Page 13
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 13 of 39
`
`US6,789,263 B1
`
`CLASSIC CAR MUSEUM <BR>
`
`SUPER-SPORTS 20<BR>
`
`/CENTER>
`
`FIG. 20
`EXAMPLE OF CONVERTED SCREEN CONFIGURATION DATA
`(NORMAL MODE)
`
`| CONTINUED TO NEXT PAGE </A>
`
`OXPASS OF EARLY SUMMER WAS PHOTOGRAPHED
`
`! DURING DRIVING.<BR>
`' THE IMAGE CAN BE VIEWED BY SELECTING BUTTON. <BR>
`
`<A HREF="next. normal. html” >
`
`14
`
`IPR2024-00145
`Apple EX1008 Page 14
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 14 of 39
`
`US 6,789,263 B1
`
`FIG. 21
`EXAMPLE 3 OF CLIENT SCREEN
`
`CLASSIC CAR MUSEUM
`SUPER-SPORTS 20
`
`OX PASS OF EARLY SUMMER WAS
`PHOTOGRAPHED DURING DRIVING.
`THE IMAGE CAN BE VIEWED BY
`SELECTING BUTTON.
`
`
`
`RUNNING
`SCENE _1
`
`RUNNING
`SCENE 2
`
`-605
`
`CONTINUED TO
`NEXT PAGE
`
`2203
`
`IPR2024-00145
`Apple EX1008 Page 15
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 15 of 39
`
`US6,789,263 B1
`
`[roma|[on
`
`FIG. 22
`DISPLAY EXAMPLE 4 OF CLIENT SCREEN
`
`2301 1301
`
`701
`
`702
`
`IPR2024-00145
`Apple EX1008 Page 16
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 16 of 39
`
`US 6,789,263 B1
`
`FIG. 23
`
`EXAMPLE 5 OF CLIENT SCREEN
`
`CLASSIC CAR MUSEUM
`SUPER-SPORTS 20
`
`OX PASS OF EARLY SUMMER WAS
`PHOTOGRAPHED DURING DRIVING.
`THE IMAGE CAN BE VIEWED BY
`SELECTING BUTTON.
`
`
`
`RUNNING
`SCENE 2
`
`1904
`
`CONTINUED TO
`
`NEXT PAGE
`
`1905
`
`IPR2024-00145
`Apple EX1008 Page 17
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 17 of 39
`
`US6,789,263 B1
`
`FIG. 24
`EXAMPLE 6 OF CLIENT SCREEN
`
`
`
`CLASSIC CAR MUSEUM
`SUPER-SPORTS 20
`
`OX PASS OF EARLY SUMMER WAS
`PHOTOGRAPHED DURING DRIVING.
`THE IMAGE CAN BE VIEWED BY
`SELECTING BUTTON.
`
`
`
`1503
`2503
`
`(=NJ
`NORMAL
`QUICK
`
`
`
`
`
`
`
`
`2208
`
`
`603
`
`604
`
`RUNNING
`SCENE _1
`
`RUNNING
`SCENE 2
`
`605
`
`CONTINUED TO
`
`IPR2024-00145
`Apple EX1008 Page 18
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 18 of 39
`
`US6,789,263 B1
`
`FIG. 25
`EXAMPLE 7 OF CLIENT SCREEN
`
`_ THE ORIGINAL IMAGE CAN BE VIEWED BY
`SELECTING IMAGES.
`
`2601 2603
`
`IPR2024-00145
`Apple EX1008 Page 19
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 19 of 39
`
`US6,789,263 B1
`
`FIG. 26
`EXAMPLE 8 OF CLIENT SCREEN
`
`CLASSIC CAR MUSEUM
`SUPER-SPORTS 20
`
`OX PASS OF EARLY SUMMER WAS
`PHOTOGRAPHED DURING DRIVING.
`THE IMAGE CAN BE VIEWED BY
`SELECTING BUTTON.
`
`NEXT PAGE
`
`RUNNING
`SCENE 1
`
`RUNNING
`SCENE 2
`
`1904
`
`CONTINUED TO
`
`1905
`
`20
`
`IPR2024-00145
`Apple EX1008 Page 20
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 20 of 39
`
`US6,789,263 B1
`
`FIG. 27
`EXAMPLE 9 OF CLIENT SCREEN
`
`THE ORIGINAL {MAGE CAN BE VIEWED BY
`
`| [roma |ouce
`
`SELECTING ICONS.
`
`21
`
`IPR2024-00145
`Apple EX1008 Page 21
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 21 of 39
`
`US6,789,263 B1
`
`FIG. 28
`EXAMPLE 10 OF CLIENT SCREEN
`
`NEXT PAGE
`
`1902
`
`602
`
`CLASSIC CAR MUSEUM
`SUPER-SPORTS 20
`
`OX PASS OF EARLY SUMMER WAS
`PHOTOGRAPHED DURING DRIVING.
`THE IMAGE CAN BE VIEWED BY
`SELECTING BUTTON.
`
`RUNNING
`
`RUNNING
`
`22
`
`IPR2024-00145
`Apple EX1008 Page 22
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 22 of 39
`
`US 6,789,263 B1
`
`FIG. 29
`EXAMPLE 11 OF CLIENT SCREEN
`
`3005
`
`2703
`
`3001
`
`1402
`
`1403
`
`Graph.
`QUICK Navi
`
`CLASSIC CAR MUSEUM
`SUPER-SPORTS 20
`
`OX PASS OF EARLY SUMMER WAS
`PHOTOGRAPHED DURING DRIVING.
`THE IMAGE CAN BE VIEWED BY
`SELECTING BUTTON.
`
`RUNNING|[RUNNING
`
`SCENE 1||SCENE 2 3009
`
`[PRETPAGESJ+1905
`
`CONTINUED TO
`
`23
`
`IPR2024-00145
`Apple EX1008 Page 23
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 23 of 39
`
`US6,789,263 B1
`
`FIG. 30
`PROCESSING FLOWCHART OF SCREEN
`
`CONFIGURATION EXPANDING DEVICE
`
`FIG. 32
`FLOWCHART OF COMMAND
`ANALYSIS PROCESSING
`
`
`EXTRACTION OF DATA
`IDENTIFIER AND EXPANDER
`AND ADDRESS CONVERSION
`
`
`
`
`3307
`
`EXIST ?
`
`
` YES
`WRITE TO PROCESSING
`SETTING TABLE
`
`
`
`3308
`
`24
`
`IPR2024-00145
`Apple EX1008 Page 24
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 24 of 39
`
`US6,789,263 B1
`
`FIG. 31
`FLOWCHART OF CONFIGURATION EXPANDING PROCESSING
`
`3201
`
`e
`
`3202
`
`INITIALIZATION
`
`3203
`
`3204
`
`ESTABLISHEMENT
`OF CONNECTION
`WITH CLIENT
`
`COMMAND
`ANALYSIS
`PROCESSING
`
`3205
`
`3207
`
`3208
`
`
`CLASSIFICATION =
`GENERATION ?
`
`
`
`ESTABLISHEMENT
`OF CONNECTION
`
`WITH SERVER
`
`
`
`TRANSMISSION
`OF COMMAND
`
`TO SERVER
`
`
`3209
`
`PROCESSING CONENT
`
`= NON-CONVERSION
`?
`
`3206
`
`REPLY DATA
`GENERATION
`PROCESSING
`
`
`
`NO
`
`
`DATA
`DATA RELAY
`
`CONVERSION
`FROM SERVER
`TO CLIENT
`PROCESSING
`
`
`
`
`
`3210
`
`8212
`
`CUTOFF OF
`CONNECTION
`
`3213
`
`C)
`
`25
`
`IPR2024-00145
`Apple EX1008 Page 25
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 25 of 39
`
`US6,789,263 B1
`
`FIG. 33
`
`FLOWCHART OF REPLY DATA GENERATION PROCESSING
`
`3401
`
`PROCESSING
`
`CONTENT = CONFIGURATION
`
`FRAME GENERATION
`
`
`PROCESSING
`9
`YES
`
`
`
`GENERATION OF
`CONFIGURATION
`
`EXPANDING FRAME
`
`
`GENERATION OF
`Ul FRAME
`
`3405
`
`OF
`
`FIG. 35
`UlGENERATION
`FLOWCHART
`3601
`
`
`
`READ OF TEMPLATE
`
`
`
`INSERTION OF
`CONVERSION ADDRESS
`
`
`AND BUTTON NAME
`
`
`
`
`
`FIG. 34
`EXPANDING FRAME GENERATION
`FLOWCHART OF CONFIGURATION
`3501
`~9
`
`
`INSERTION OF DATA
`
`CONVERSION EXPANDE
`AND WRITE
`
`
`
`3602
`
`26
`
`IPR2024-00145
`Apple EX1008 Page 26
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 26 of 39
`
`US6,789,263 B1
`
`FIG. 36
`FLOWCHART OF DATA CONVERSION PROCESSING
`
` PROCESSING
`CONTENT = IMAGE
`REDUCTION
`?
`
`YES
`
`3701
`
`
`
`CONFIGURATION
`DESCRIPTION
`CONVERSION
`PROCESSING
`
`FIG. 37
`EXAMPLE OF SETTING TABLE
`
`3801
`
`CONTENT
`
`PROCESSING
`
`27
`
`IPR2024-00145
`Apple EX1008 Page 27
`
`

`

`Sep. 7, 2004
`
`Sheet 27 of 39
`
`US 6,789,263 B1
`
`U.S. Patent
`
`LO6E
`
`
`
`
`
`qalaWVuVdNOILYOISISSV10|~YSONVdx3WIVLO3PO1osrgOONISS3200¥d
`
`
`
`02NRVanbnoo|Nouweanzo[PP|uy
`A1aviLOArPAOONISSAODOYd4OAldWVX>A8“Sls
`
`
`
`
`
`
`
`
`
`
`G30NVdX4NOILVYENDISNOO
`
`
`
`NOILVHANSDSNVeS
`
`YSIsILNAdI
`
`28
`
`IPR2024-00145
`Apple EX1008 Page 28
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 28 of 39
`
`US6,789,263 B1
`
`. 39
`EXAMPLE OF U! SETTING TABLE
`
`NUMBER
`
`INSERTED IDENTIFIER
`4002
`
`
`4003
`
`FIG. 40
`EXAMPLE OF CONVERSION RULE TABLE
`
`4101
`
`FIG. 41
`EXAMPLE OF CONVERSION PARAMETER TABLE
`
`
`
`
`
`29
`
`4201
`
`
`
`
`
`
`
`IPR2024-00145
`Apple EX1008 Page 29
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 29 of 39
`
`US6,789,263 B1
`
`FIG. 42
`PROCESSING SEQUENCE
`
`SERVER
`101
`
`CONFIGURATION
`EXPANDING DEVICE
`103
`
`CLIENT
`105
`
`ESTABLISHMENT
`OF CONNECTION
`
`GET menu. html
`SCREEN
`CONFIGURATION DATA 1701
`
`CUTOFF OF CONNECTION
`
`ESTABLISHMENT
`OF CONNECTION
`
`GET menu.ui. htm!
`SCREEN
`CONFIGURATION DATA 1401
`
`CUTOFF OF CONNECTION
`
`ESTABLISHMENT
`OF CONNECTION
`
`4301
`
`4302
`
`4303
`
`4304
`
`4305
`
`4306
`
`4307
`
`4308
`
`4309
`
`ESTABLISHMENT
`OF CONNECTION
`GET menu. html
`SCREEN
`4312
`SCREEN
`CONFIGURATION DATA 501
`4313
`CONFIGURATION DATA 1801
`4314
`4315-~[xCUTOFE_OF CONNECTIONFcurorrOFCONNECTION|CUTOFF OF CONNECTION 4316
`
`4310
`
`
`
`4311
`
`
`
`ESTABLISHMENT
`OF CONNECTION
`
`SCREEN DATA 603
`
`4319
`
`4324
`
`4323
`
`ESTABLISHMENT
`OF CONNECTION
`
`GET _pictA.small.gif
`
`4317
`
`4318
`
`CUTOFF OF CONNECTION
`
`4324
`
`IPR2024-00145
`Apple EX1008 Page 30
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 30 of 39
`
`US 6,789,263 B1
`
`FIG. 43
`EXAMPLE OF BUTTON TEMPLATE
`
`4402
`
`, 4403
`
`
`
`<A HREF={[X1]i TARGET=PAGE>([X2]!</A>
`
`FIG. 44
`PROCESSING SEQUENCE
`
`SERVER
`101
`
`CONFIGURATION
`EXPANDING DEVICE
`103
`eoTaBLISHMENT
`OF CONNECTION
`
`CLIENT
`S
`10
`
`4501
`
`ESTABLISHMENT
`OF CONNECTION
`
`GET menu. p-quick. html
`
`CUTOFF OF CONNECTION
`
`GET menu. html
`SCREEN
`CONFIGURATION DATA 501
`
`CUTOFF OF CONNECTION
`
`ESTABLISHMENT
`OF CONNECTION
`
`GET pictA.gif
`
`SCREEN DATA 603
`
`CUTOFF OF CONNECTION
`
`ESTABLISHMENT
`OF CONNECTION
`
`GET pictA.gif
`
`CUTOFF OF CONNECTION
`
`IMAGE DATA 603
`
`31
`
`IPR2024-00145
`Apple EX1008 Page 31
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 31 of 39
`
`US 6,789,263 B1
`
`
`yum|>pinb-d©|NOLLVUNDIINODNOISHSANODNNN|jewou-d©NOISH3ANODNOWdIHOSSC|oiguaanog|pewuou-dpuny|NOILVENDISNOO
`
` SNVUs|ewou-d*CAGNYdX3NOWWHNDINOD|NOWVESNS9}yewuou|HALSWVeVd
`
`
`
`LIN3LNOOONISSSIOWdNOILVOISISSV1O}~YAONVdxX3
`
`.TINNOLLNG“IVNBWNHLNOLWHANSOPum|cOSv
`
`TINNOILLWHSNSDAWVHSINNOILYH3SN39omfu|GO6E
`
`
`gq.|NOISHSANODNOILdIdOS3C
`G3qNvdXx3NOLWHNDIINOD|NOULWHANSO
`
`NOLVUSNGD
`
`
`A1aViLOAFEOONISSSOOYdJOAIdWVXS
`NOILYYSNS5
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`ViVdLOsreoO
`
`HSIsILNAG!
`
`LOOP
`
`SyDis
`
`
`
`NOLVUaNSOSNVUS
`
`32
`
`IPR2024-00145
`Apple EX1008 Page 32
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 32 of 39
`
`US6,789,263 B1
`
`FIG. 46
`EXAMPLE OF CONVERSION PARAMETER TABLE
`
`4701
`
`FIG. 47
`EXAMPLE OF CONVERTED SCREEN CONFIGURATION DATA
`
`4801
`
`(QUICK MODE) 509
`
`.- 002
`
`.- 802
`
`_ 4802
`
`4803
`
`-- 1804
`
`t ‘
`
`CLASSIC CAR MUSEUM <BR>
`| SUPER:SPORTS 20<BR>
`
`1 OX PASS OF EARLY SUMMER WAS PHOTOGRAPHED
`DURING DRIVING.< B R>
`
`Be ee ea ee eea ee ee ee ee a ee ae ee ee ee te ee ee eet
`
`|THE IMAGE CAN BE VIEWED BY SELECTING BUTTON.<BR>
`
`<A HREF="pictB. thumb. gif” >
`RUNNING SCENE 1 </A>
`
`<A HREF="pictC. thumb. gif” >
`' RUNNING SCENE 2</A>
`
`i<A HREF="next quick. htmi" >
`| TO NEXT PAGE </A>
`
`33
`
`IPR2024-00145
`Apple EX1008 Page 33
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 33 of 39
`
`US 6,789,263 B1
`
`FIG. 48
`
`FLOWCHART OF RESPONSE DATA GENERATION PROCESSING
`
`4902
`
`
`PROCESSING
`CONTENT = THUMB
`NAIL BUTTON
`GENERATION
`
`YES
`
`4901
`
`
`
`?
`
`
`
`CONTENT=
`
`CONFIGURATION
`
`
`EXPANDED FRAME
`GENERATION
`
`
`
`
`GENERATION OF
`
`
`
`
`
`GENERATION OF
`CONFIGURATION
`
`EXPANDED FRAME
`
`
`THUMB NAIL BUTTON
`
`34
`
`IPR2024-00145
`Apple EX1008 Page 34
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 34 of 39
`
`US6,789,263 B1
`
`EXAMPLE OF THUMB NAIL TIMPLATE
`5001
`
`ORIGINAL IMAGE CAN BE VIEWED BY SELECTINGIMAGE <BR >
`b</A>
`be eee meme ee ewes
`
`
`
`5002~
`
`5003”
`
`FIG. 50
`EXAMPLE OF THUMB NAIL BUTTON
`SCREEN CONFIGURATION DATA
`5101
`
`
`ORIGINAL IMAGE CAN BE VIEWED BY SELSCTING IMAGE <BR>
`
`
`i<A HREF= pictBgif><IMG_SRC =pictB.smallgif></A>'
`
`5102”
`
`FIG. 51
`EXAMPLE OF Ul SETTING TABLE
`5201
`
`
`
`
`PN. INSERTION EXPANDER
`
`
`
`
`BUTTON NAME
`
`35
`
`IPR2024-00145
`Apple EX1008 Page 35
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 35 of 39
`
`US 6,789,263 B1
`
`1OardO
`
`
`
` SWVusIN|Nouvuango|HALSWVuvd|ONISSSOOYd|NOILVOISISSV1O)LNALNOOYSONVdXS
`oR]oso.|WNNOILVYSN3S9
`
`
`LOGEqF1aviLOArPAOONISSBZOOY"dAOFIdWVXS
`
`oSOld YalsILNAdG!
`
`
` NOISH3ANO039VdLSI|NOISHSANOD|NOLLONGSYN3SdOS[woisannoo|Aun|
`NOILONGSYN3avOS|Noiswannoo|yews~
`
`
`
`
`Viva
`
`36
`
`IPR2024-00145
`Apple EX1008 Page 36
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 36 of 39
`
`US 6,789,263 B1
`
`FIG. 53
`EXAMPLE OF SCREEN CONFIGURATION DATA
`
`5401
`
`Ree mee ee ee nee ee ee ee eee ee ee ee ew ee ee ee ee ee ae a ee ee ae ee ee ee ne ee wr er ee 1
`ORIGINAL IMAGE CAN BE VIEWED BY SELECTING ICON. <BR>
`
`<A HREF=menu.list.html TARGET=PAGE>LIST</A>
`
`FIG. 54
`EXAMPLE OF LIST PAGE TEMPLATE
`
`5501
`
`FIG. 55
`EXAMPLE OF THUMB NAIL TEMPLATE
`
`5601
`
`
`
`5602”
`
`5603”
`
`FIG. 56
`EXAMPLE OF THUMB NAIL SCREEN CONFIGURATION DATA
`
`ORIGINAL IMAGE CAN BE VIEWED BY SELECTING ICON.<BR>
`
`5702--f
`
`5701
`
`37
`
`IPR2024-00145
`Apple EX1008 Page 37
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 37 of 39
`
`US 6,789,263 B1
`
`LO8s
`
`1g‘Sls
`
`H3L3WVHVd
`
`LINSLNODONISSSOO¥d
`
`NOILVOISISSV10)HAGNYdx4
`
`
`
`VivaLosrao
`
`YAIsILN3O!
`
`
`
`FoamNOILONGSYNOISHSANOOPyews|806ESDVWI
`
`
`~|NOISHSANODNOldidOS3q]
`
`
`AlaviLOArdOONISSAOOYUdAOAldWVXS
`NOLLYHNDIINODNOISHSANOD
`
`
`
`
`
`
`
`
`
`NOISHSANO0NOILdldOS3d
`
`NOILVENDISNOO
`
`38
`
`IPR2024-00145
`Apple EX1008 Page 38
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 38 of 39
`
`US 6,789,263 B1
`
`FIG. 58
`EXAMPLE OF SCREEN CONFIGURATION DATA
`
`5904
`
`CLASSIC CAR MUSEUM < BR >—”_09
`
`507
`
`_- 1804
`
`5
`
`S UPER-SPORTS 20<BR>
`
`508
`
`: OXPASS OF EARLY SUMMER WAS PHOTOGRAPHED
`: DURING DRIVING.< B R >
`‘THE IMAGE CAN BE VIEWED BY SELECTING BUTTON. <BR>
`
`<A HREF="pictB. small. gif” >
`| RUNNING SCENE 1</A>
`<A HREF=’"pictC. small. gif” >
`| RUNNING SCENE 2 </A>
`
`b-t_--802
`
`1802
`
`1803
`
`39
`
`IPR2024-00145
`Apple EX1008 Page 39
`
`

`

`U.S. Patent
`
`Sep. 7, 2004
`
`Sheet 39 of 39
`
`US 6,789,263 B1
`
`FIG. 59
`EXAMPLE OF CLIENT SCREEN
`
`CLASSIC CAR MUSEUM
`SUPER-SPORTS 20
`
`OX PASS OF EARLY SUMMER WAS
`PHOTOGRAPHED DURING DRIVING.
`THE IMAGE CAN BE VIEWED BY
`SELECTING BUTTON.
`
`1905
`
`RUNNING
`SCENE 2
`
`1904
`
`CONTINUED TO
`
`NEXT PAGE
`
`40
`
`IPR2024-00145
`Apple EX1008 Page 40
`
`

`

`US 6,789,263 B1
`
`1
`DATA CONVERSION METHOD AND
`APPARATUS
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`
`This application is a continuation-in-part of co-pending
`application Ser. No. 08/633,311 entitled as MULTIMEDIA
`DATA PROCESSING SYSTEM IN NETWORKfiled by T.
`Shimada et al. on Apr. 15, 1996, the contents of which are
`incorporated herein by reference.
`
`BACKGROUND OF THE INVENTION
`
`This invention relates to a data converting device for
`converting the size, etc, of inputted data. More particularly,
`the present invention relates to a data converting device
`functioning as a relay for relaying multimedia data trans-
`mitted through a plurality of kinds of transmission media,
`such as image, speech data, sound-attached moving-picture
`data etc, a data transmission method, and an information
`storage medium storing a data conversion function.
`In network systemsin general, services are offered among
`a plurality of information processing units connected to the
`network.
`
`10
`
`15
`
`20
`
`25
`
`2
`plicated than the normal button selection operations, and
`another problem arises in that operation efficiency drops
`whenthe user frequently desires to switch the utilization and
`to stop the data converting device.
`When a large numberof buttons for looking up the static
`image are disposedin the screen display, the display area of
`the screen becomes lack of information, and still another
`problem occurs in that the screen display becomes redundant
`for the user who seldom makes access to the additional
`buttons.
`
`SUMMARYOF THE INVENTION
`
`It is an object of the present invention to provide a data
`converting device which converts data transmitted from a
`server to data which considers performanceofthe client, a
`transmission medium connectedto the client, etc, and causes
`the client to receive this data, a network system equipped
`with such a data converting device, and a data transmission
`method.
`
`It is another object of the present invention to provide a
`data converting device which instructs a user of a client to
`control a conversion processing of multimedia data and
`enables the user to carry out the data conversion processing
`in accordance with this instruction, a network system
`equipped with such a network, and a data transmission
`method.
`
`In this case, the information processing unit on the service
`requesting side is referred to as a “client” and the informa-
`tion processing unit on the service offering side, a “server”.
`T. Berners-Lee et al., “Communications of ACM”, Vol.
`37, No. 8, pp. 76-82(1994) published by ACM Press
`describes an example of multimedia network systems for
`describing screen configuration mainly by character strings
`in a wide area network system.
`Such a multimedia network system has spread in world-
`wide networks and access to world-wide information can be
`
`To accomplish the objects described above, a data relay
`apparatus connected between a server device and a client
`device includes a commandanalysis portion for analyzing a
`command inputted from the client device, which analysis
`portion reads out and stores conversion instruction informa-
`tion when the command contains the conversion instruction
`information instructing a predetermined data conversion
`processing; a request portion for deleting the conversion
`instruction information from the command and sending it to
`acquired by making access to the servers in the world.
`the server device; a detection portion for receiving data sent
`The capacity of data handled in the multimedia network
`from the server device, which detection portion converts the
`system, such as static images, moving images, speech, and
`data on the basis of the conversion instruction information
`so forth, is by far greater than that of texts.
`stored and add the conversion instruction information to the
`Therefore, when the multimedia network system is uti-
`reference address included in the description referring to a
`lized in the environment having a small network transmis-
`text data included in other data; and a transmission portion
`sion capacity, the problem develops in that an extremely
`for transmitting the data and the result of the added infor-
`long time is necessary for the data transfer.
`mation to the client device.
`When the amount of data transmitted from the server to
`The conversion instruction information can contain a
`the client is reduced, the data access time can be reduced
`screen configuration command for instructing to divide the
`particularly when the transmission rate of the network is
`area of the screen displayed on the client device into a
`low, and the user can gain access to a greater amount of
`reception data display area for the data received from the
`information within a predetermined time.
`server device and an operation area for the screen operation.
`50
`Whenthe data converting device described aboveis used,
`The data relay apparatus can further containafirst expansion
`the data access time can be reduced as a result of the
`portion for expanding the display data from the server
`reduction of the data transmission amount between the
`device on the reception data display area on the basis of the
`server and the client, but layout of the screen display is
`screen configuration command and a second expansion
`changed when button display is employedfor indicating the
`portion for expanding the operation buttons corresponding
`reduction of a static image in the screen display, etc.
`to another screen configuration command indicating con-
`If layout of the screen display itself has information such
`tents of transformation on data in the operation area in
`accordance with the conversion instruction information on
`as a table, such a change of layout means the loss of
`information and deteriorates appearance of the design. See
`the basis of the screen configuration command from the
`FIG. 9 (902, 903 and 904). In FIG. 8, screen configuration
`client device. When the image data is contained in the
`data 801, description 802 of the image tag, and descriptions
`response command, the conversion instruction information
`can be a deletion instruction command which instructs to
`803 and 804 of the anchor tags are shown.
`To look up the screen display in accordance with original
`screen configuration information transmitted by the server,
`the user of the client must stop utilization of the data
`converting device. Because the method of stopping the
`utilization of the data converting device requires the change
`of setting of the client, this operation is much more com-
`
`30
`
`35
`
`40
`
`55
`
`60
`
`65
`
`A1
`
`delete a part of pixels of the image data in a predetermined
`pattern.
`According to the present invention, there is also provided
`a data relay apparatus connected to a client device through
`a first network and to a server device through a second
`network, which includes means for analyzing a command
`
`IPR2024-00145
`Apple EX1008 Page 41
`
`

`

`US 6,789,263 B1
`
`3
`inputted from the client device, means for separating con-
`version instruction information from the command whenthe
`command contains the conversion instruction information
`
`instructing a conversion processing; means for transmitting
`the command after deletion of the conversion instruction
`
`information to the server device; means for receiving data
`responding to the commandafter deletion of the conversion
`instruction information from the server device; means for
`generating a conversion command by converting the data on
`the basis of the conversion instruction information; and
`means for transmitting the conversion command with the
`conversion instruction information to the client device.
`
`According to the present invention, there is further pro-
`vided a data transmission method of a network system
`including a data relay apparatus connected to a client device
`connected through a first network and to a server device
`through a second network, wherein the data relay apparatus
`analyzes a command inputted from the client device, deletes
`conversion instruction information from the command when
`the command contains the conversion instruction informa-
`
`tion instructing a conversion processing, and transmits the
`command to the server device,
`the server device which
`receives the command after deletion of the conversion
`instruction information transmits data responding to the
`command after deletion of the conversion instruction
`information, and the data relay apparatus which receives the
`data converts the data to generate a conversion command on
`the basis of the conversion instruction information, and
`transmits the conversion command with the conversion
`instruction information to the client device.
`
`According to the present invention, there is further pro-
`vided an information storage medium storing a data con-
`version function for data relay for use in a data relay
`apparatus connected to a client device through a first net-
`work and to a server device through a second network,
`wherein the information storage medium stores a program
`having a function of analyzing a commandinputted from the
`client device, a function of deleting conversion instruction
`information from the command when the commandcontains
`
`the conversion instruction information instructing a conver-
`sion processing to the command,and transmitting the com-
`mand to the server device, a function of receiving a data
`responding to the command after removal of the conversion
`instruction information from the server device, a function of
`generating conversion data by converting the data on the
`basis of the conversion instruction information, and a func-
`tion of transmitting the conversion command with the con-
`version instruction information to the client device.
`
`According to the present invention, there is further pro-
`vided a data converting device having information output
`means for outputting the data after the conversion process-
`ing described above is executed and data that is newly
`generated.
`When the kind of data is screen configuration data
`describing configuration of a screen output of an information
`processing unit, a predetermined rule provides not only mere
`data conversion but list display, etc. so that efficiency of
`grasping the content of data can be improved.
`Existing servers and clients can be as such utilized. When
`a new function or functions are added to the present
`invention, these servers and clients need not be changed, and
`the maintenance cost can be kept low, in consequence. Since
`a specific server is not necessary, utility by the screen
`configuration expansion by the present invention can be
`improved for all the pages of a large number of servers to
`which access can be made by everyone of the world.
`
`4
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a block diagram showing an structural example
`of the present invention;
`FIG. 2 is a block diagram showing an example of the
`construction of a screen configuration expanding device;
`FIG. 3 is a functional block diagram showing an example
`of the screen configuration expanding device;
`FIG. 4 is a block diagram showinga structural example of
`the present invention;
`FIG. 5 shows an example of screen configuration data;
`FIG. 6 shows an example 1 of client screen display;
`FIG. 7 shows an example 2 of the client screen display;
`FIG. 8 shows an example of expanded screen configura-
`tion data;
`FIG. 9 shows an example 1 of client screen display
`utilizing a data converting device;
`FIG. 10 shows an example 2 of client screen display
`utilizing the data converting device;
`FIG. 11 shows an example of a screen configuration
`template;
`FIG. 12 showsan example of a setting managementtable;
`FIG. 13 shows an example of additional screen configu-
`ration data;
`FIG. 14 shows a display example of the additional screen
`configuration data;
`FIG. 15 shows an example of a screen configuration
`template;
`FIG. 16 shows an example of expanded screen configu-
`ration data;
`FIG. 17 shows an example of converted screen configu-
`ration data;
`FIG. 18 shows an example of a client screen according to
`the present invention;
`FIG. 19 shows another example of the client screen
`according to the present invention;
`FIG. 20 shows an example of converted screen configu-
`ration data;
`FIG. 21 shows another example of the client screen
`according to the present invention;
`FIG. 22 showsstill another example of the client screen
`according to the present invention;
`FIG. 23 showsstill another example of the client screen
`according to the present invention;
`FIG. 24 showsstill another example of the client screen
`according to the present invention;
`FIG. 25 showsstill another example of the client screen
`according to the present invention;
`FIG. 26 showsstill another example of the client screen
`according to the present invention;
`FIG. 27 showsstill another example of the cl