United States Patent [191
`Kinebuchi et al.
`
`[54] TERMINAL DEVICE
`
`[75] Inventors: Tadashi Kinebuchi; Hirnyuki Baba;
`Masanori Konishi; Akihiro Gomi, all
`of Suwa, Japan
`
`[73] Assignee: Seiko Epson Corporation, Tokyo,
`Japan
`
`[21] Appl. No.: 08/664,463
`[22] Filed:
`Jun. 14, 1996
`[30]
`Foreign Application Priority Data
`
`[JP]
`Jun. 16, 1995
`[JP]
`Jul. 27, 1995
`Sep.22,1995 [JP]
`
`Japan .................................. .. 7-150619
`Japan
`..
`Japan .................................. .. 7-269354
`
`H04N 1/32
`[51] Int. Clf'
`[52] US. Cl. ........................ .. 358/442; 358/468; 345/348;
`434/428
`[58] Field of Search ................................... .. 358/400, 434,
`358/442, 468; 395/114-116, 967; 345/173,
`145, 146, 400, 441, 348, 349; 434/428,
`429; H04N 1/32
`
`[56]
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`8/1984 Chamoff et al. .
`4,468,750
`4,547,851 10/1985 Kurland .
`4,553,222 11/1985 Kurland et al. .
`4,851,994
`7/1989 Toda et al. .
`5,003,472
`3/1991 Perrill et a]. .
`
`USO05912743A
`{11] Patent Number:
`[45] Date of Patent:
`
`5,912,743
`Jun. 15, 1999
`
`7/1992 Mueller .
`5,128,862
`8/1993 Mueller et al. .
`5,235,509
`5,262,938 11/1993 Rapoport et al. .
`5,377,319 12/1994 Kitahara et al. .
`5,454,721 10/1995 Kueh .
`5,566,069 10/1996 Clark, Jr. et al. .
`5,594,920
`1/1997 Ehina et al. .
`5,606,374 2/1997 Bertram .
`5,657,461
`8/1997 Harkins et a]. .
`
`FOREIGN PATENT DOCUMENTS
`
`0 140 302 A2 5/1985 European Pat. 01f. .
`WO 89/00321
`1/1989 France .
`
`OTHER PUBLICATIONS
`
`InformationWeek, Aug. 16, 1993, USA, p. 49 XP002037298
`Wilson L: “Arby’s IT: rare and Well done” See ‘Here’s the
`beef’ and ‘Behind the scenes’.
`
`Primary Examiner-Kim Yen Vu
`Attorney, Agent, or Firm—Mark P. Watson
`[57]
`ABSTRACT
`
`An order-taking terminal device enables a customer to order
`food, but can respond rapidly to changes and additions to the
`menu. When this terminal device starts up, it receives an
`operating program and image data from main management
`equipment. The order-taking terminal device stores the thus
`received operating program and image data and displays a
`menu screen on a display screen on the basis of the thus
`stored operating program and image data.
`
`32 Claims, 26 Drawing Sheets
`
`Apple, Exhibit 1041, Page 1
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 1 of 26
`
`5,912,743
`
`TOM
`
`
`
`wo_>mo |_<Z=2m..E,
`
`
`
`0232c... mmomo
`
`mJmE.
`
`02527530
`
`
`
`m§>mo 32.2%;
`
`\ 6E
`
`$55? 8 ~ N h
`
`
`
`ANHIV 5:82 5150 E5528 2 8 E565
`
`
`
`
`0-23228 “E .517: 50:
`\2
`
`mm vw h wwp ONLF
`L259
`
`.22
`
`85mm
`
`
`
`mm £0.52
`
`Apple, Exhibit 1041, Page 2
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 2 0f 26
`
`5,912,743
`
`1:020...
`
`m>_.:mzwm
`
`4mz<n_
`
`
`
`
`
`oHmoEmEE5:586-oo._oaa<
`
`ow
`
`NV
`
`ommm
`
`owo_>
`
`S_<m
`
`mm
`
`wo<s=
`
`0H02_mmm_oomn_
`
`m>Eomm
`
`ZOwam
`
`
`
`w0<m0._.m<._.<o
`
`Om
`
`3n.
`
`mm>_momz<m._.
`
`.EZD
`
`um
`
`Apple, Exhibit 1041, Page 3
`
`Apple, Exhibit 1041, Page 3
`
`
`
`
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 3 of 26
`
`5,912,743
`
`F/G . 3
`
`DEMO DISPLAY
`’
`
`“'6
`
`I00
`
`CORRESPONDENCE
`WITH MENU
`SCREENS
`-------- --F|G.6,T,ond a
`
`END
`KEY
`
`ITOUCHEASNEEJESTIVE
`"O
`
`FIG-8 (TOUCH_
`SENSITIVE PANEL)
`
`_______ n
`
`MENU SCREEN
`
`DISPLAY PROCESSING
`
`
`
`MENU SELECTION F's-9m’
`and II
`
`[NO]
`
`SELECTION
`END
`
`CONFIRMATION I20
`SCREEN
`'
`
`[(0K)
`
`I30
`
`COMMUNICATION
`WITH HOST
`
`COMMUNICATING
`
`vCOMMUNICATION END
`
`END
`PROCESSING
`
`I40
`
`Apple, Exhibit 1041, Page 4
`
`

`

`“mNm:mo:mAm.9“:
`m>Emzmmuxo=E»m%a8“.52.8.82253mmno24%.?zummom
`
`
`
`
`US. Patent
`
`n.m
`
`
`
`
`
`N?8.2“:zummomozmono:25
`
`3v6Q
`
`
`zofiozzh:zmmmom0.23 :35m«.0.C67,:.zo;<z<.Exun, mo.#25mo“.
`
`
`
`
`
`
`IIUDOF>mmmomam
`
`LoZOrrOmjmm
`
`EE
`
`.50NEE.
`
`3473
`
`p.Il9.,Exu>EmzmmlzuoE53298.5
`...o5.55%
`
`.mmomoo»
`
`>9.
`
`coonno2253mm.m9...
`
`
`>mv.m>_.:mzmm
`
`Apple, Exhibit 1041, Page 5
`
`Apple, Exhibit 1041, Page 5
`
`
`
`

`

`US. Patent
`
`Jun. 15, 1999
`
`Sheet 5 of 26
`
`5,912,743
`
`m:
`
`Hillllllllllllll.lllllJ\0on.Fl1lIhmulzfi;
`
`
`
`zmwwE52010!IlL
`
`
`
`AZOC.<.._I_MQZ<Omomwomomulkmnmv
`
`
`
`
`
`
`
`02.4km]Foaoomn.mo><|Em_n=zmwmomZOF<2EEZOQ
`
`fioEm43.0%
`
`
`
`mus—C.Lomum—232>m<mmmomz
`
`
`
`
`
`mmmoomn.ozEwomobummmm
`
`
`
`:-|-|..nn..r|-mmomomeo_Iommomommomam»-Nnv:
`
`
`
`TV:
`
`
`
`
`
`mum:Tm:
`
`ZOFUmem
`
`mmmoomn.bxmznommmoomn.hxuzno
`
`
`
`
`2707..A079...
`nozwmmom.mo2mmmom.
`
`ZOCbMJMm
`
`mv6Q
`
`Apple, Exhibit 1041, Page 6
`
`Apple, Exhibit 1041, Page 6
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jun. 15, 1999
`
`Sheet 6 0f 26
`
`5,912,743
`
`FIG. 5
`
`,62
`
`COMMUNICA
`IONS WITH HEAD—
`OFFICE HOST
`
`COMMUNICA
`TIONS WITH TER—
`MINAL DEVICES
`
`/
`/ REGISTER
`I
`PROCESSING
`\
`
`\
`\
`,
`
`/
`
`.
`
`I68
`
`I70
`
`COMMUNICA
`TIONS WITH HEAD
`OFFICE HOST
`
`INTERRU PT
`FROM TERMINAL DEVICE
`
`COMMUNICA
`TIONS WITH TER
`MINAL DEVICE
`
`COMMUNICATING
`
`I74
`
`I76
`
`PROCESSING
`RELATING
`TO ORDER
`
`BINARY
`OR
`RESTAU -
`RANT
`
`FAST- FOOD
`RESTAURANT
`
`REGISTER
`PROCESSING
`
`Apple, Exhibit 1041, Page 7
`
`

`

`U.S. Patent
`
`Jun. 15,1999
`
`Sheet 7 of 26
`
`5,912,743
`
`FIG. 6
`
`Apple, Exhibit 1041, Page 8
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 8 0f 26
`
`5,912,743
`
`DUHUZ
`
`202 2: 32a
`
`
`
`£98380 zoom
`
`
`
`
`
`C853 :25 o._.
`
`Apple, Exhibit 1041, Page 9
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 9 0f 26
`
`5,912,743
`
`Com
`
`Apple, Exhibit 1041, Page 10
`
`

`

`US. Patent
`
`Jun. 15, 1999
`
`Sheet 10 or 26
`
`5,912,743
`
`[JIUIUIQIQL
`
`
`
`
`
`5253 5:26 o._.
`
`28. 2: $95
`
`
`
`£26028 zoom
`
`-_ 1 COM
`
`&. 00 N
`
`\mIOON
`
`38m
`
`Apple, Exhibit 1041, Page 11
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 11 of 26
`
`5,912,743
`
`,m. 22 $21
`
`
`
`awlmk $20 2
`502 25
`
`m ‘NIOON
`
`0000 LrOON
`
`\MIOON
`
`Apple, Exhibit 1041, Page 12
`
`

`

`U.S. Patent
`
`Jun. 15,1999
`
`Sheet 12 of 26
`
`5,912,743
`
`Apple, Exhibit 1041, Page 13
`
`

`

`US. Patent
`
`Jun. 15, 1999
`
`Sheet 13 0f 26
`
`5,912,743
`
`F/G. /2
`
`MA IN
`MANAGEMENT
`EQUIPMENT
`
`I0
`
`I (NETWORK)
`l
`
`G ATE WAY
`
`7
`
`TERMINAL
`DEVICE
`
`TERMINAL
`DEVICE
`
`TERMINAL
`DEVICE
`
`TERMINAL
`DEVI CE
`
`I
`40-!
`
`I
`4o~2
`
`S
`40-3
`
`40-n
`
`Apple, Exhibit 1041, Page 14
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 14 0f 26
`
`5,912,743
`
`FIG. I3
`
`52
`l
`
`5|
`3
`
`so
`3
`
`20
`
`49
`1
`
`ROM
`
`R A M
`
`(IF U
`
`INTERFACE
`
`SRAM
`PSRAM
`FLASH
`54/
`
`46
`
`I
`J‘
`ssl
`F" “"}__-
`>?’°.
`'
`b
`L_-__O.1
`
`56
`5
`
`v D P
`
`5a)
`
`VRAM
`
`62
`)
`AUDIO
`CIR-
`CUITRY
`
`so
`)
`' LCD
`WERFACE
`
`44
`)
`TOUCH
`SENSITIVE
`PANEL
`
`LC D
`
`142
`
`Apple, Exhibit 1041, Page 15
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 15 0f 26
`
`5,912,743
`
`F/G. /4
`
`RI
`‘
`
`R2
`
`R3
`
`R4
`
`N1
`
`N2 N3
`
`N4
`
`Apple, Exhibit 1041, Page 16
`
`

`

`US. Patent
`
`Jun. 15, 1999
`
`Sheet 16 0f 26
`
`5,912,743
`
`h\oust8%22m
`
`
`
`
`
`zo.—L.Dmomz.QNm
`
`
`
`
`
`.sag...enEAdd.0—“::tflozzz:COOLU_m<mQummmmm
`
`32m.)—ZOFFDmmmamoZOFFDmmm<0mm
`
`
`
`Qmmmmmm00m
`
`5.9...Nam
`
`$35...285m
`
`A‘4
`
`m1<omm
`
`mmomo
`
`»<..Em_o
`
`>ZOOMF<U
`
`IO:&:02><n_n_m_o
`
`m2<m2.1:;FODQ
`oz.zz=»-mo§32m:
`o_N<mm<20:.0m4mm
`
`omwmmmu
`
`
`
`
`
`oummummZOFFDmmmomo
`
`,
`
`hxmz.20:52.26.mo...
`>m00m._.<o
`
`>4.._n_m_o
`
`
`
`
`
`
`
`.o.m<mzmmmom59.008225..«mmq5mm.0...:
`
`.umOFmommmumm
`
`zo_._.<_2mo.._z.
`
`Dzm—z
`
`zo_._.omn_mm22m:moi.
`
`
`
`
`
`.mm..m0...:E05:2.
`
`
`
`honooma
`
`
`
`
`
`24%.?.oEmoE0.3m><..n.m.o33%...8%E05SNa...
`
`
`
`
`
`3535«6285m@706zotpm._.:mqumqazim
`
`
`
`Ema......__m.58.
`
`
`
`
`
`
`us..pFzm>m20.2592..mm.or...><..n.m.oenamenmoz:23E855
`
`
`
`
`
`20.55%:52Fzm>mommm><4n_m.om2<m
`9mm2_It>>Hosooma
`
`Apple, Exhibit 1041, Page 17
`
`
`
`Apple, Exhibit 1041, Page 17
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`US. Patent
`
`Jun. 15, 1999
`
`Sheet 17 0f 26
`
`5,912,743
`
`FIG/6
`
`DISPLAY MESSAGE TO
`NOTICE THAT THE
`ORDERED FOOD IS READY ‘FIG-31>
`
`S230
`
`Apple, Exhibit 1041, Page 18
`
`

`

`US. Patent
`
`Jun. 15, 1999
`
`Sheet 18 0f 26
`
`5,912,743
`
`MENU
`STRUCTURE
`
`F76‘. l7
`SANDWICH MENU
`SCREEN I
`
`TOP ANIMATION
`
`SANDWICH MENU
`L SCREEN 2
`
`MENU N
`
`SANDWICH MENU
`SCREEN 3
`
`MENU N
`
`DRINKS MENU
`SCREEN 1
`
`I DRINKS MENU
`
`DRINKS MENU
`SCREEN 2
`
`SCREEN 3
`
`TOP ANIMATION
`
`MENU N
`
`MENU N
`
`Ir_
`
`V
`
`CHICKEN MENU
`SCREEN 1
`
`TOP ANIMATION
`
`CHICKEN MENU
`SCREEN 2
`
`MENU N
`
`CHICKEN MENU
`SCREEN 3
`
`MENU N
`
`SALAD MENU
`SCREEN 1
`
`TOP ANIMATION
`
`SALAD MENU
`SCREEN 2
`
`MENU N
`
`SALAD MENU
`SCREEN 3
`
`MENU N
`
`Apple, Exhibit 1041, Page 19
`
`

`

`U.S. Patent
`
`Jun. 15,1999
`
`Sheet 19 0f 26
`
`5,912,743
`
`FIG. /8A
`
`4330
`
`.
`
`500
`
`FOOD
`M ENU
`
`IN FORMATION
`MENU
`
`W
`
`FIG‘. I85
`
`EVENTS
`
`RIDES
`
`Apple, Exhibit 1041, Page 20
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 20 0f 26
`
`5,912,743
`
`FIG. /9
`
`To switch
`
`press the icons
`
`between each
`categories,
`
`Apple, Exhibit 1041, Page 21
`
`Apple, Exhibit 1041, Page 21
`
`

`

`US. Patent
`
`Jun.1s, 1999
`
`Sheet 21 on6
`
`5,912,743
`
`Press here I I
`
`this food!
`
`to order
`
`Apple, Exhibit 1041, Page 22
`
`Apple, Exhibit 1041, Page 22
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 22 of 26
`
`5,912,743
`
`F/G.2/
`
`
`
`
`FIGZZ
`
`Apple, Exhibit 1041, Page 23
`
`Apple, Exhibit 1041, Page 23
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 23 of 26
`
`5,912,743
`
`FIG. 234
`
`10
`
`Please wait
`
`Apple, Exhibit 1041, Page 24
`
`Apple, Exhibit 1041, Page 24
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 24 of 26
`
`5,912,743
`
`FIG. 24
`
`Now Serving
`
`Finished!
`
`Apple, Exhibit 1041, Page 25
`
`Apple, Exhibit 1041, Page 25
`
`

`

`US. Patent
`
`Jun. 15,1999
`
`Sheet 25 of 26
`
`5,912,743
`
`FIG. 25
`
`270
`
`
`
`Apple, Exhibit 1041, Page 26
`
`Apple, Exhibit 1041, Page 26
`
`

`

`US. Patent
`
`Jun. 15, 1999
`
`Sheet 26 of 26
`
`5,912,743
`
`FIG. 26‘
`
`420
`
`Apple, Exhibit 1041, Page 27
`
`Apple, Exhibit 1041, Page 27
`
`

`

`5,912,743
`
`1
`TERMINAL DEVICE
`
`BACKGROUND OF THE INVENTION
`
`The present invention relates to a terminal device, in
`particular, to a terminal device by which a user can transmit
`data while viewing a screen on the terminal device.
`DESCRIPTION OF THE PRIOR ART
`
`The system generally used for administering orders in a
`restaurant or the like is such that a waiter or waitress takes
`each customer’s order and conveys it
`to the kitchen.
`However, an order management system of this type has a
`problem in that the expenses involved in employing waiting
`stafi' increases the unit price of the food.
`In establishments such as fast-food restaurants that have
`recently become common, a system is used in which the
`customer has to approach a counter to order and again to
`pick up the ordered food
`However, an order management system of that type has a
`problem in that
`it places a large burden on customers
`because they have to return to the counter every time they
`order, and they have to wait in line at the counter if the
`restaurant is busy,
`In order to solve these problems, the use of an order
`management system has been considered in which a main
`piece of management equipment for order management (a
`host computer) is combined with a plurality of terminal
`devices for ordering that are provided at the customers’
`tables. Since this order management system makes it pos-
`sible for a customer to make an order while viewing image
`data for ordering that is displayed on a terminal device, and
`the resultant order can be processed by the main manage-
`ment equipment, it can solve both of the previously men-
`tioned problems concerning statI expenses and the load on
`the customers.
`
`Unfortunately, it is not possible for a customer to Obtain
`a good visualization of the dishes available for order, simply
`from an order list displayed on a terminal device. In such a
`case, a problem occurs in that customers become reluctant to
`use this system to order food.
`
`SUMMARY OF THE INVENTION
`
`In the light of the above described problems, a first
`objective of the present invention is to provide a terminal
`device which can manage with only a small quantity of data
`to transfer, and which enables a user to input data to be
`transferred in an easy-to-understand fashion.
`Another objective of the present invention is to provide a
`terminal device which is capable of transferring interactive
`data to and from another device, wherein this data is easy for
`a user to understand and is also small in quantity.
`A further objective of the present invention is to provide
`a terminal device which is capable of responding flexibly to
`changes in the image data used for data transfer manage—
`ment.
`
`ID
`
`15
`
`20
`
`25
`
`3D
`
`35
`
`40
`
`45
`
`50
`
`In order to achieve the above objectives, a first aspect of
`the present invention relates to a terminal device for trans-
`mitting data to another device, comprising:
`input means;
`display means;
`storage means for storing image data for a data transmis-
`sion management screen wherein at least part of the
`image data is presented as a dynamic image, and an
`operating program for reproducing the image data in
`
`60
`
`65
`
`2
`accordance with predetermined rules and managing
`data transmission; and
`computation control means for managing data transmis-
`sion;
`wherein the computation control means, comprises:
`image displaying means for reading the image data and
`displaying a data transmission management screen
`on the display means based on the operating pro~
`gram; and
`control means for generating transfer data based on the
`operating program and input from the input means in
`response to the data transmission management
`screen, and managing the transmission of data to the
`other device.
`In accordance with the terminal device of the present
`invention, a data transmission management screen is dis-
`played on the display means to enable a user to visually
`verify the details of data to be transmitted to another device
`and the procedure required for transmitting this data.
`In particular, since part of the data for these management
`screens is presented as a dynamic image, this aspect of the
`invention makes it possible to use dynamic animations and
`cartoon characters to express the data transmission proce-
`dure and details of this data in a visual form that is easy for
`a user to understand.
`The user can easily input data from the input means in
`response to this data transmission management screen, while
`receiving visual confirmation of this data to be transmitted.
`The thus-input data is sent as transmit data to the other
`device.
`From the above description, it is clear that the terminal
`device in accordance with this aspect of the invention
`displays the relationship between the displayed screens and
`the data to be transmitted, so that the user can check the
`details of the data to be sent and the operating sequence for
`sending this data in a visual, easy-to-understand manner, and
`thus the terminal device is extremely convenient to use.
`Moreover, since the basic concept of this terminal device
`is such that the image data itself is not transmitted during
`data transfer, only data relating to that
`image data is
`transmitted, the quantity of data transferred is small and thus
`the data can be transmitted rapidly.
`invention relates to a
`A second aspect of the present
`terminal device for transferring interactive data to and from
`another device, comprising:
`input means;
`display means;
`storage means for storing image data for a data transmis-
`sion management screen wherein at least part of the
`image data is presented as a dynamic image, and an
`operating program for reproducing the image data in
`accordance with predetermined rules and managing
`data transmission; and
`computation control means for managing data transmis-
`sion;
`wherein the computation control means, comprises:
`image displaying means for reading the image data and
`displaying a data transmission management screen
`on the display means based on the operating pro—
`gram; and
`control means for generating first order data based on
`the operating program and an input from the input
`means in response to the data transmission manage-
`ment screen, transmitting the first data to the other
`device, and managing to display a screen with details
`corresponding to interactive second data on the
`
`Apple, Exhibit 1041, Page 28
`
`Apple, Exhibit 1041, Page 28
`
`

`

`5,912,743
`
`3
`image displaying means based on the second data
`received from the other device.
`The terminal device of this aspect of the invention enables
`the interactive transfer of data to and from another device,
`in a manner that is easy for the user to understand and
`requires little data.
`This terminal device is particularly characterized in that at
`least part of a data transfer management screen is presented
`as a dynamic image such as an animation. This makes it
`possible to manage the transfer of data that is visually easy
`for the user to understand, and thus enable the implemen-
`tation of a terminal device that is extremely easy for the user
`to understand and use.
`In a third aspect of the present invention:
`the image data is image data for an order management
`screen;
`the operating program reproduces image data for order
`management in accordance with predetermined rules
`and manages data transmission for order management;
`the image displaying means reads out the image data
`based on the operating program and displays the order
`management screen on the display means; and
`the control means generates order management data based
`on the operating program and an order input from the
`input means in response to the order management
`screen, and controls the transmission of the order to the
`other device.
`In a fourth aspect of the present invention:
`the image data is image data for an order management
`screen;
`the operating program reproduces image data for order
`management in accordance with predetermined rules
`and manages data transmission for order management;
`the image displaying means reads out the image data
`based on the operating program and displays the order
`management screen on the display means; and
`the control means generates first order management data
`based on the operating program and an order input from
`the input means in response to the order management
`screen, transmits the first order management data to the
`other device, and manages to display an order manage»
`ment screen with details corresponding to interactive
`second data on the image displaying means based on
`the second data received from the other device.
`In accordance with this aspect of the invention, since the
`user can input an order while viewing an order management
`screen wherein at least part is presented as a dynamic image,
`an order-taking terminal device can be implemented that is
`extremely easy to understand and convenient to use.
`In particular, this aspect of the invention makes it possible
`to transfer data for order management in an interactive form
`to and from another device. Thus, when food has been
`ordered, for example, data communications can be used to
`inform the user that the ordered food is ready. In addition, if
`the user orders the fetching of predetermined data, the thus
`ordered data can be received from the other end of the
`system.
`In a fifth aspect of the present invention:
`the input means is a touch-sensitive panel disposed on the
`display means in a predetermined mutual relationship
`with the management screen.
`Disposing a touch-sensitive panel on the display means in
`a predetermined mutual relationship with the management
`screen in this manner enables the user to input order data
`easily, merely by touching a predetermined position on the
`displayed order management screen. This makes it possible
`to implement a terminal device that is convenient for a user
`to use.
`
`4
`In a sixth aspect of the present invention:
`the image data displays a menu screen representing a
`plurality of management categories as the management
`screen.
`
`Displaying the management screen as a menu screen in
`this manner makes it possible to implement a terminal
`device that is even more convenient to user
`In this regard, it is preferable that managemental details,
`such as details of the data to be sent, are displayed on the
`menu screen by using readily understandable animations or
`photographs.
`In a seventh aspect of the present invention;
`the storage means stores image data for an order menu
`screen representing a plurality of ordering categories as
`the management screen; and
`the control means converts an ordering category selected
`by the input means into code data and transmits the
`code data as the first data, and displays an order
`management screen with details which are code data
`received as the second data from the other device on the
`image displaying means.
`The terminal device ofthis aspect of the present invention
`enables the input of data to be transmitted by simply
`selecting a desired ordering category, thus making it possible
`to implement a terminal device that is extremely convenient
`to use.
`In particular, since the transmitted data is transferred to
`and from the other device in a converted form as code data,
`the terminal device of this aspect of the invention has the
`advantage of managing with an extremely small quantity of
`data to he transferred.
`In an eighth aspect of the present invention:
`the storage means stores a plurality of sets of the image
`data and operating programs; and
`the control means manages data transmission based on
`remaining sets of image data and operating program
`during a waiting time during which data transmission is
`being managed based on a predetermined set of image
`data and operating program.
`In accordance with this aspect of the terminal device of
`the present
`invention, another data transfer management
`operation can be performed during the waiting time of a
`predetermined data transfer management operation, so that
`the user can make use of the waiting time to transfer other
`data effectively.
`In a ninth aspect of the present invention:
`the storage means stores a plurality of sets of the image
`data and associated display operating programs for
`product ordering and information ordering; and
`the control means performs ordering control based on
`image data for information ordering and an associated
`display operating program from a time at which the first
`code data is transmitted until when the second code
`data is received, during ordering control based on
`image data for product ordering and an associated
`operating program.
`It often happens that the time required to transfer an order
`for information through a circuit and receive that informa~
`tion is shorter that the time taken between placing the order
`for a dish until the food is ready. This aspect of the invention
`makes use of the Waiting time that occurs when a product
`such as a food dish is being ordered, between the ordering
`of‘the dish and the time that the food is ready, to provide
`ordering control for information. This ensures that the user
`does not waste this waiting time, and can use it efficiently to
`obtain other information.
`
`5
`
`10
`
`15
`
`25
`
`3t]
`
`35
`
`4O
`
`45
`
`50
`
`SD
`
`65
`
`Apple, Exhibit 1041, Page 29
`
`Apple, Exhibit 1041, Page 29
`
`

`

`5,912,743
`
`5
`In a tenth aspect of the present invention:
`the control means comprises means for writing into the
`storage means the image data and an associated display
`operating program which are received from the other
`device.
`The terminal device in accordance with this aspect of the
`present
`invention receives image data and an associated
`operating program for a screen to be displayed from an
`external apparatus, and controls the writing of this data into
`the storage means. In other words,
`the image data and
`operating program that arrive from the external apparatus
`are in a over-writable form.
`Since the present invention makes it possible to respond
`rapidly to changes in the images to be displayed, it enables
`the implementation of a terminal device that is extremely
`applicable to a wide range of applications and is convenient
`to use.
`
`It is preferable that this transfer and writing of the image
`data and operating program is performed during a time band
`in which the terminal device is not usually in use.
`In a eleventh aspect of the present invention:
`the image data displays hierarchical menu screens repre-
`senting a plurality of management items as the man-
`agement screen.
`The use of hierarchical menus in this manner makes it
`possible to utilize a limited display space efficiently and
`display screens that are easy for the user to understand.
`In a twelfth aspect of the present invention:
`the image data includes transmission items divided into a
`number of major categories according to type, items
`belonging to each of the major categories further
`divided into a tree structure within that major category,
`so as to display order management menu screens are
`displayed in a hierarchy; and
`the operating program displays a menu screen represent-
`ing items in a level next to a hierarchical level corre-
`sponding to one of root and node portions of the
`displayed tree structure, the next level belonging to a
`category selected by a user from categories of the
`hierarchical level, and the operating program switches
`menu screens representing each of items belonging to
`a same leaf portion of the tree structure to display a
`menu screen based on screen changing order from the
`second control means.
`In a thirteenth aspect of the present invention:
`display contents of each item belonging to a hierarchical
`level corresponding to the one of root and node por-
`tions is an image acting as an index representing the
`contents of the item, at least parts of the index data
`function as icons; and
`the image displaying means displays a menu containing
`the item corresponding thereto when one of the icons is
`selected by means of the input means.
`Displaying parts of the menu screen as icons in this
`manner makes it possible to provide an input operation that
`is even more convenient for the user to use.
`In a fourteenth aspect of the present invention:
`the image displaying means identifies and displays a
`selected icon and a non-selected icon.
`Displaying highly recognizable icons in this manner
`makes it possible to provide the user with an accurate input
`operation.
`In a fifteenth aspect of the present invention:
`the image displaying means displays a display change
`area on a screen and switches the image which is
`displayed when the display change area is selected by
`
`6
`the input means so as to display plurality of items
`corresponding to a leaf portion of the tree structure.
`This makes it possible to switch smoothly between hier—
`archical menu screens.
`In a sixteenth aspect of the present invention:
`the image displaying means displays explanatory infor-
`mation for explaining details of information displayed
`on a display screen so as to overlay the display infor-
`mation with the explanatory information, and causes
`the explanatory information to move so that the con-
`tents of the display information in the overlaid area are
`recognizable.
`least part of a data transmission
`In other words, at
`management screen in the terminal device of the present
`invention is presented as a dynamic image. When explana-
`tory information for explaining details of information dis—
`played on the display screen is presented as a dynamic image
`that overlays the information on the display screen in this
`manner, it is preferable that the explanatory information is
`made to move to ensure that the display information in the
`overlaid area can be seen. This makes it possible to provide
`an image display that is even easier for the user to under—
`stand.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is an explanatory view of the order management
`system of a preferred first embodiment of the present
`invention;
`FIG. 2 is a functional block diagram showing the specific
`configuration of the order-taking terminal device in the
`system of FIG. 1;
`FIG. 3 is a flowchart of the operation of the order-taking
`terminal device;
`FIG. 4 is a detailed flowchart of the operation of the
`order-taking terminal device FIG. 4 consist of FIGS. 4A and
`4B;
`FIG. 5 is a flowchart of the operation of the on—site POS
`system;
`FIG. 6 is an explanatory view of the display screen of the
`order-taking terminal device;
`FIG. 7 is another explanatory View of the display screen
`of the order—taking terminal device;
`FIG. 8 is yet another explanatory view of the display
`screen of the order-taking terminal device;
`FIG. 9 is an explanatory view of the order screen of the
`order-taking terminal device;
`FIG. ll) is another explanatory view of the order screen of
`the order—taking terminal device;
`FIG. 11 is yet another explanatory view of the order
`screen of the order-taking terminal device;
`FIG. 12 is an explanatory view of the order management
`system of another embodiment of the present invention;
`FIG. 13 is a functional block diagram of the terminal
`device used in the order management system of FIG. 12;
`FIG. 14 is an explanatory view of the operation of the tree
`structure of hierarchical menu screens used in the system;
`FIG. 15 is a flowchart of the operation of the order
`management system of the second embodiment of the
`present invention;
`FIG. 16 is another flowchart ofthe operation of the second
`embodiment;
`FIG. 17 is an explanatory View of the menu structure of
`the second embodiment;
`FIGS. 18A and 18B are explanatory Views of a basic
`menu screen and a basic information menu screen of the
`second embodiment respectively;
`
`LA
`
`10
`
`25
`
`30
`
`35
`
`4o
`
`45
`
`SD
`
`55
`
`60
`
`65
`
`Apple, Exhibit 1041, Page 30
`
`Apple, Exhibit 1041, Page 30
`
`

`

`5,912,743
`
`7
`FIG. 19 is an explanatory view of a basic food menu
`screen;
`
`FIG. 20 is an explanatory View of a menu selection
`screen;
`
`FIG. 21 is an explanatory View of an order screen;
`FIG. 22 is another explanatory View of an order screen;
`FIGS. 23A and 23B are explanatory views of a total
`charge screen and waiting time display screen respectively;
`FIG. 24 is an explanatory view of an order-ready message
`screen;
`
`FIG. 25 is an explanatory view of a basic ride menu
`screen; and
`FIG. 26 is an explanatory View of a display screen for ride
`information.
`
`DESCRIPTION OF PREFERRED
`EMBODIMENTS
`
`Preferred embodiments of the present invention will now
`be described with reference to the accompanying drawings.
`First Embodiment
`
`A first preferred embodiment of the present invention is
`shown in FIG. 1. This order management system controls
`orders at a restaurant located at a site such as an amusement
`park. Specifically, it is configured to comprise an on-site
`(i.e., installed at the restaurant) point-of-sales (POS) system
`10 that functions as a main piece of management equipment
`for order management and a plurality of order—taking termi-
`nal devices 40-1, 40-2 .
`.
`. located on each of the tables 30-1,
`30-2 .
`.
`. of the restaurant.
`
`This on-site POS system 10 is connected by a line 29 to
`a host computer (not shown in the figure) at the head office
`of the restaurant chain that handles all of the restaurants. A
`network is configured of the head-office host computer and
`a host computer 20 at each restaurant.
`The POS system 10 is configured to comprise the host
`computer 20, an input-output terminal device 22 that func-
`tions as an input-output means, and a register 24 that keeps
`track of all money transactions. This POS system 10 uses an
`RF module 26 as a relay terminal to keep in contact with the
`order-taking terminal devices 40—1, 40—2 .
`.
`. on the tables 30
`within the restaurant.
`
`The host computer 20 is configured to comprise a memory
`28. Programs that enable the on—site host computer 20 to
`function as a main piece of management equipment for order
`management are stored in this memory 28.
`In addition, an operating program and image data for
`order screens are stored in the memory 28 for the order-
`taking terminal devices 40. That is to say, this memory 28
`also functions as storage means for data to be transferred to
`the terminal devices 40.
`
`In this case, the operating program and image data are
`generated to enable order management of the food served at
`this restaurant.
`
`The operating program and image data for order screens
`that are stored in the memory 28 for the terminal devices are
`read out when the system starts up, then are transferred to
`each of the order—taking terminal devices 40-1, 402 .
`.
`. via
`the RF module 26.
`
`When an order is placed from one of the order-taking
`terminal devices 40, the on-site POS system 10 temporarily
`stores details of that order in the memory 28 and also outputs
`a printout of the order from the input-output terminal device
`22. If this restaurant is a fast-food restaurant, when an order
`
`8
`is received, details of that order are processed at the register
`24 to compute the bill, then those details are output as a
`printout from the input-output terminal device 22.
`When the ordered food has been prepared, the restaurant
`staff inputs notice data that the ordered food is ready to the
`on-site POS system 10 by means of the input-output termi—
`nal device 22. When this input
`is performed,
`the host
`computer 20 sends an order-ready message to the order—
`taking terminal device 40 on the corresponding table 30, as
`second data.
`When an order for information is input from one of the
`order-taking terminal device 40, as will be described later
`with reference to a second embodiment of the present
`invention, the on-site POS system 10 temporarily stores the
`contents of that order in the memory 28. If the thus-ordered
`information is already in the memory 28, that information is
`transferred as second data to the appropri