v
`fiawa
`‘kfipza
`
`wvfififi
`
`§f§"‘§T‘5§l
`
`§e$%w%
`
`L-. '§,J--!".5--
`fivwfi
`
`150- display lyrics of sclcctcd downloaded track, 2-hcar also using tclcphonc receiver, 3-
`operation of selected button, 110- integrated control section, 120- memory section used
`for telephone number registration, 130-power supply section, 140- electromagnetic Wave
`reception control section, 160- display control section, 162- display section, 170—sending
`andiecehdngconuolsecfion,172-receher,174-Uflnsnnfien 180-bufioninputconuol
`
`179App|e—CA0019654
`
`Samsung Ex. 1211 p. 401
`
`

`
`section, 182- button input section, 200-music controller, 210- amplification section for
`music, 220- rcccivcr jack, 240-memory scction for music, 250- memory mcdia for music
`
`179App|e—CAOO19655
`
`Samsung Ex. 1211 p. 402
`
`

`
`(19) JAPANESE PATENT OFFICE (JP)
`(12) PUBLICATION OF UNEXAMINED PATENT APPLICATIONS (A)
`(11) K0/Caz‘ (Unexamined, Laid—Open) Patent Disclosure Number:
`H8—6875
`(43) Date ofLaid-Open Disclosure: January 12, 1996
`
`(51) Int. Cl.5
`G 06 P
`13/00
`17/30
`
`H 04 M
`
`Idcntif. Symbol
`351 G
`
`Intra-officc File Number
`7368-5E
`
`F1
`
`Technology Display
`
`302
`
`9194-5L G 60 F 15/403
`
`320 A
`
`Examination Requested: not yet requested
`Number of Claims 9 0L (total of9 pages)
`
`(21) Application Number:
`(22) Filing Date:
`
`I16-136973
`June 20, 1994
`
`(71) Applicant:
`
`(72) Inventor:
`
`(72) Inventor:
`
`(72) Inventor:
`
`(74) Agent:
`
`000004226
`Nippon Telegraph & Telephone Corporation
`3-19-2, Nishi Shinjuku, Shinjuku-ku, Tokyo
`Kumi Taishinji
`Nippon Telegraph & Telephone Corporation
`1-1-6, Uchi Saiwai-cho, Chiyoda-ku, Tokyo
`Kuni Kasahara
`Nippon Telegraph & Telephone Corporation
`1-1-6, Uchi Saiwai-cho, Chiyoda-ku, Tokyo
`Tomohiko Arikawa
`Nippon Telegraph & Telephone Corporation
`1-1-6, Uchi Saiwai-cho, Chiyoda-ku, Tokyo
`\/Iasataka Yoshida, Patent Agent
`
`(54) [Title of the Invention] Multimedia Communication System and Terminal Apparatus Thereof
`
`(57) [Abstract]
`[Purpose] In order to match all media to a scale corresponding to a transmission capacity, to provide
`a multimedia communication system capable of creating representative infonnation for which some
`information is thinned out by the information transfer side.
`[Constitution] Representative information, with the amount of information reduced on the
`communication terminal device 11 to an extent that the original-like attribute of the received
`infomiation is not lost, is extracted, and when requested by a mobile wireless communication
`terminal device 12, the representative information is transferred from the communication terminal
`device 11 to the mobile wireless communication terminal device 12 via the communication network
`14 and the wireless base station 13.
`
`[Effects] By receiving representative information, the mobile wireless communication terminal
`device 12, too, that has a limited information retention capacity, can easily keep track of the content
`of the information itself.
`
`179App|e-CAO014745
`
`Samsung Ex. 1211 p. 403
`
`

`
`flfifiififii
`
`Reply
`Request
`Information
`
`Representative information
`Communication network
`Wireless base station
`Portable wireless communication terminal device
`Communication terminal device
`
`179App|e—CAOO14746
`
`Samsung Ex. 1211 p. 404
`
`

`
`[What ls Claimed ls]
`[Claim 1]
`A multimedia communication system, comprising: at least one first communication
`terminal device, at least one second communicationterminal device, and a communication network
`that connects said first and second communication terminal devices; wherein said first
`communication terminal device comprises: a communication unit that sends and receives various
`types of infomiation to and from the communication networks, a high— function processing unit that
`extracts representative information with a reduced amount of information from the received
`information to an extent that does not lose the original- like attribute, a communication recording
`unit that records in time-series the representative information obtained from said high-function
`processing unit, and a database unit that stores the received information and the representative
`information acquired from said high-function processing unit by associating them, such that
`keyword searches can be made on said stored information; wherein said second communication
`terminal device, which is portable, comprises: a communication unit that receives information and
`transmits new information, an icon display unit that separates media information from the received
`information and displays different types oficons based on the types of said media information, and
`a communication processing unit that performs the processing of selecting communication means
`and communication media from instructions input that corresponds to said icons and that is
`interactive.
`
`The multimedia communication system of Claim 1, wherein said first
`[Claim 2]
`communication terminal device has an information transfer means that transfers extracted
`
`representative information to another communication terminal device.
`[Claim 3]
`The multimedia communication system of Claim 1 or 2, wherein said first
`communication tenninal device has an information transfer means that transfers the original
`information corresponding to the representative information based on instructions from said second
`communication tenninal device to any communication terminal device.
`[Claim 4]
`The multimedia communication system of Claim 1, 2, or 3, wherein said
`communication network and said first or second communication terminal device send and receive
`
`data wirelessly.
`[Claim 5]
`The multimedia communication system of Claim 1, 2, 3, or 4, wherein the
`multimedia communication system comprises a video distribution center connected to said
`communication network, and wherein
`said first communication terminal device comprises a set top that makes it possible to display the
`video information from said video distribution center on a display unit as well as a means of
`extracting representative information from said video information.
`[Claim 6]
`A multimedia communication terminal device, comprising: a communication unit
`that sends and receives various types of information to and from communication networks,
`a high-function processing unit that extracts representative information with a reduced amount of
`information from the received information to an extent that does not lose the original-like attribute,
`a communication recording unit that records in time-series the representative information obtained
`from said high-function processing unit,
`and a database unit that stores the received information and the representative information acquired
`from said high-function processing unit by associating them, such that keyword searches can be
`made on said stored information.
`
`The multimedia communication terminal device of Claim 6, wherein the device has
`[Claim 7]
`an information transfer means that transfers said representative information to another
`communicationterminal device.
`
`The multimedia communication terminal device of Claim 6, wherein the tenninal
`[Claim 8]
`device has an information transfer means that transfers the original information corresponding to
`
`179App|e—CAOO14747
`
`Samsung Ex. 1211 p. 405
`
`

`
`the representative information based on instructions from another communication terminal device to
`any communication terminal device.
`[Claim 9]
`A multimedia communication terminal device, which is portable, comprising: a
`communication unit that receives information and transmits new information, an icon display unit
`that separates media information from the received information and displays different types of icons
`based on the types of said media information, and a communication processing unit that perfomis
`the processing of selecting communication means and communication media from instructions
`input that corresponds to said icons and that is interactive.
`[Detailed Description of the Invention]
`[0001]
`[Field of Industry] This invention is directed to a multimedia communication system that performs
`information transfer services in multimedia communications and terminal devices thereof.
`
`[0002]
`[Prior Art] In recent years, there have been rapid advances in information transfer services in
`multimedia communications, leading to the provision of various services. For example, pagers (e.g.,
`pocket bells) that call a person wirelessly and cause him or her to contact a given place, and pagers
`that implement bidirectional communications through the addition of a function that transmits
`handwritten characters and data have come to be provided, and the following services as
`information transfer services that use such pagers are known:
`[0003]
`l. Voice mail service, wherein when the caller dials a number assigned by a center, the
`center rings the pager that is called, and the call-receiving party accesses (telephones) a number
`assigned by the center to listen to the message. (Recruit “Delta Mail”, TTM Coinin-Net “Bell
`Voice”, and the like). 2. A voice mail service, wherein a center on a network transfers and records
`an answering—machine—recorded message to the same company, and simultaneously uses a pager to
`call the away—from—phone party wirelessly. The called party can telephone the center to listen to
`said transferred and recorded message. (MIT Systems Laboratories, “Call Any where”).
`3. A monitoring system, wherein, when a machine that runs on an unattended basis fails, the event
`is conveyed to a pager through a modem, eight types of failures are recognized, and different codes
`corresponding to these failures are transmitted. (Kyowa System, “Communications Expert”,
`Energy Support, “Pocket Bell Monitor.)
`[0004]
`[Problems to Be Solved by the Invention] In the conventional multimedia communication system
`described above, however, due to a transmission limited capacity of the pager to which information
`is transferred, the type of information that can be transferred is limited to voice and small amounts
`of data, and the conventional system is up against a first problem: the inability to transfer large-
`volume data and video information. There is also a second problem: the requirement that the
`terminal used to receive incoming calls in wireless calls be different from the terminal that makes a
`call in order to obtain an actual message. Also there is a third problem in that, because the
`communication is basically a bidirectional communication, it is not possible for the user to request
`repeated deliveries of a message if details on the first delivery were missed. Also, there is a fourth
`problem in that, whereas a bidirectional pager can make and receive calls using the same terminal
`equipment, a log of calls received cannot be saved. Also, there is a fifth problem in that the system
`does not provide a user interface that would permit initialing a new call based on log information on
`received calls.
`
`[0005] In view of the above problems, an objective of the present invention, in order to match all
`media to a scale corresponding to a transmission capacity, is to provide a multimedia
`communication system capable of creating representative information for which some information
`is thinned out by the infomiation transfer side. A second objective of the present invention is to
`
`179App|e—CA0014748
`
`Samsung Ex. 1211 p. 406
`
`

`
`provide a multimedia communication system capable of transmitting new detailed information
`based on log infonnation on incoming calls as well as requests for detailed information; a third
`objective of the present invention is to provide a multimedia communication system capable of
`associating representative information, a communications log, and incoming call data itself by
`storing a communications log. And a fourth objective of the present invention is to provide a
`multimedia communication system in which the user interface is structured in tenns of information
`and that uses an icon display means for an easy-to-see display.
`[0006]
`[Means of Solving the Problems] In order to accomplish the above objectives, Claim 1 proposes
`the following multimedia communication system: a multimedia communication system,
`comprising: at least one first communication terminal device, at least one second communication
`terminal device, and a communication network that connects said first and second communication
`terminal devices; wherein said first communication terminal device comprises: a communication
`unit that sends and receives various types of information to and fron1 the communication networks,
`a high-function processing unit that extracts representative information with a reduced amount of
`infonnation from the received information to an extent that does not lose the original-like attribute,
`a communication recording unit that records in time—series the representative information obtained
`from said high-function processing unit, and a database unit that stores the received information and
`the representative information acquired from said high-function processing unit by associating them,
`such that keyword searches can be made on said stored information; wherein said second
`communication terminal device, which is portable, comprises: a communication unit that receives
`infonnation and transmits new infonnation, an icon display unit that separates media information
`from the received information and displays different types oficons based on the types of said media
`information, and a communication processing unit that performs the processing of selecting
`communication means and communication media from instructions input that corresponds to said
`icons and that is interactive.
`
`[0007] Claim 2 proposes: in the multimedia communication system of Claim 1, said first
`communication terminal device has an information transfer means that transfers extracted
`
`representative information to another communication terminal device.
`[0008] Claim 3 proposes: in the multimedia communication system of Claim 1 or 2, said first
`communication terminal device has an information transfer means that transfers the original
`infonnation corresponding to the representative information based on instructions from said second
`communication terminal device to any communication terminal device.
`[0009] Claim 4 proposes: in the multimedia communication system of Claim 1, 2, or 3, said
`communication network and said first or second communication terminal device send and receive
`
`data wirelessly.
`[00l0] Claim 5 proposes: in the multimedia communication system of Claim 1, 2, 3, or 4, the
`multimedia communication system comprises a video distribution center connected to said
`communication network, and said first communication terminal device comprises a set top that
`makes it possible to display the video information from said video distribution center on a display
`unit as well as a means of extracting representative infonnation from said video infonnation.
`[001 l] Claim 6 proposes: a multimedia communication terminal device, comprising: a
`communication unit that sends and receives various types of information to and from
`communication networks, a high-function processing unit that extracts representative information
`with a reduced amount of information from the received information to an extent that does not lose
`
`the original-like attribute, a communication recording unit that records in time—series the
`representative information obtained from said high-function processing unit,
`
`179App|e—CAOO14749
`
`Samsung Ex. 1211 p. 407
`
`

`
`and a database unit that stores the received information and the representative information acquired
`from said high-function processing unit by associating them, such that keyword searches can be
`made on said stored information.
`
`[0012] Claim 7 proposes: in the multimedia communication terminal device of Claim 6, the device
`has an information transfer means that transfers said representative information to another
`communication terminal device.
`
`[0013] Claim 8 proposes: in the multimedia communication teiminal device of Claim 6, the
`terminal device has an information transfer means that transfers the original information
`corresponding to the representative information based on instructions from another communication
`terminal device to any communication terminal device.
`[0014] Claim 9 proposes: a multimedia communication terminal device, which is portable,
`comprising: a communication unit that receives information and transmits new information, an icon
`display unit that separates media information from the received information and displays different
`types of icons based on the types of said media information, and a communication processing unit
`that performs the processing of selecting communication means and communication media from
`instructions input that corresponds to said icons and that is interactive.
`[0015]
`[Operation of the Invention] According to the multimedia communication system of Claim 1,
`communications are conducted through a communication network between the first communication
`terminal device and the second communication terminal device, between a first communication
`terminal device and another lirst communication terminal device, or between a second
`communication terminal device and another second communication terminal device. In this case, in
`said first communication terminal device, a communication unit sends and receives various types of
`information to and from said communication networks, a high-function processing unit extracts
`representative information with a reduced amount of information from the received information to
`an extent that does not lose the original-like attribute, and a communication recording unit records
`in tiine-series the representative information obtained from said liigli-function processing unit.
`Further, a database unit stores the received information and the representative information acquired
`from said high-function processing unit by associating them, such that keyword searches can be
`made on said stored information. In addition, in said second communication terminal device, a
`communication unit receives information and transmits new information, and an icon display unit
`separates media information from the received information and displays different types of icons
`based on the types of said media information. Further, a communication processing unit selects
`communication means and communication media from instructions input that corresponds to said
`icons and that is interactive.
`
`[0016] According to Claim 2, an information transfer means transfers the representative
`information extracted in said first communication terminal device to another communication
`
`terminal device. In this manner, the second terminal device that has a small data storage capacity
`can also keep track of the contents of information by means of representative information.
`[0017] According to Claim 3, the information transfer means of said first communication terminal
`device transfers the original information corresponding to the representative information based on
`instructions from said second communication terminal device to any communication terminal
`device. In this manner, the user who has the second communication terminal device, which is
`portable, can keep track of the content of details on information by means of representative
`information and view it by means ofa handy first communication terminal device and other devices.
`[0018] According to Claim 4, between said communication network and said first or second
`communication terminal device, data is sent and received wirelessly. In this manner, there is no
`restriction on the place of installation or use of communication terminal devices.
`
`179App|e—CAOO1475O
`
`Samsung Ex. 1211 p. 408
`
`

`
`[0019] According to Claim 5, the set top for said first communication terminal device makes it
`possible to display the video information from the video distribution center on a display unit, to
`extract representative infonnation from said video infonnation, and to also transmit the
`representative information on said video infonnation to another communication terminal device.
`[0020] According to the multimedia communication system of Claim 6, a communication unit
`sends and receives various types of information to and from the communication networks, a high-
`function processing unit extracts representative information with a reduced amount of information
`from the received infonnation to an extent that does not lose the original-like attribute, a
`communication recording unit records in time-series the representative infonnation obtained from
`said high-function processing unit, and a database unit stores the received information and the
`representative information acquired from said high—function processing unit by associating them,
`such that keyword searches can be made on said stored information.
`[0021] According to Claim 7, an information transfer means transfers said representative
`information to another communication terminal device. In this manner, even portable terminal
`devices that have a limited data storage capacity, for example, can keep track of the content of
`information by means of representative information.
`[0022] According to Claim 8, information transfer means transfers the original information
`corresponding to the representative information based on instructions from another communication
`tenninal device to any communication terminal device. In this manner, the user who has a portable
`communication terminal device, for example, with a small data storage capacity can view details on
`information, about which the content was tracked by means of representative information, by using
`a communication terminal device with a large data storage capacity that is located close to him or
`her.
`
`[0023] According to the multimedia communication device of Claim 9, a communication unit
`receives information and transmits new information to another terminal device, and an icon display
`unit separates media information from the received information and displays different types ofieons
`based on the types of said media information. Further, a communication processing unit selects
`communication means and communication media from instructions input that corresponds to said
`icons and that is interactive. In addition, [SOMETHING] [Translator ’s note: the subject ofthe
`sentence missing] is carried around and used by the user.
`[0024]
`[Embodiments] The following is an explanation of an embodiment of the present invention with
`references to drawings. FIG. 1 is a configuration diagram that shows the mode of communication
`network in the multimedia communication system of Embodiment l of the present invention. In the
`figure, Reference Number 11 denotes a communication terminal device; 12, a mobile wireless
`communication terminal device; 13, a wireless base station; and 14, a communication network.
`[0025]
`The communication terminal device 11 is capable of conducting communications with the
`wireless base station 13 via the communication network 14. The portable wireless communication
`tenninal device 12 is designed to wirelessly communicate with the wireless base station 13.
`In this
`manner, the portable wireless communication terminal device 12 can communicate with the
`communication terminal device ll via the wireless base station 13 and the communication network
`14.
`
`[0026] FIG. 2 is a functional configuration diagram that depicts the communication terminal device
`l l and the portable wireless communication terminal device 12 that implement the multimedia
`communication system described above. In the figure, (a) represents the functional configuration of
`the communication tenninal device I1, and (b), the functional configuration of the portable wireless
`communication terminal device 12. The communication terminal device 11 comprises a
`communication unit 31, a high-function processing unit 32 connected to the communication unit 31,
`
`179App|e—CAOO14751
`
`Samsung Ex. 1211 p. 409
`
`

`
`a communication recording unit 33 connected to the communication unit 31 and the high-function
`processing unit 32, and a database unit 34 connected to said communication recording unit 33. The
`portable wireless communication terminal device 12 comprises a communication unit 41, an icon
`display unit connected to said communication unit 41, and a communication processing unit 43
`connected to said icon display unit 42. Also, the high-function processing unit 32 extracts
`representative information that has the amount of information to be described later.
`[0027] FIG. 3 shows an example of the graphical user interface (GUI) on the display screen of the
`icon display unit 42 for the portable wireless communication terminal device 12 described above.
`FIG. 4 shows an example ofa media-specific functional icon.
`[0028] As depicted in FIGS. 3 and 4, displayed on the icon display unit 42 are icons that
`correspond to various fianctions. When one of these icons is clicked on, icons that are lower—leve1
`than the clicked icon are displayed, and icons that are even lower in level exist.
`[0029] An explanation of the operation of the embodiment of the above—described constitution
`follows. When information arrives on the communication terminal device 11 via the
`
`communication network 14, the communication terminal device 11 extracts representative
`information from said information, and calls the portable wireless communication terminal device
`12 via the communication network 14 and the wireless base station 13.
`In this manner, the user of
`the portable wireless communication terminal device 12 confirms the call, and can view said
`representative information. Further, the user can access the communication terminal device 11 via
`the communication network 14 from the portable wireless communication terminal device 12 to
`acquire detailed information, and can reply to the sender of the message based on a call log based
`on the content of records in the communication processing unit 43.
`[0030]
`In concrete terms, when information arrives from a source external to the communication
`terminal device 11, the communication unit 31 receives it, and the high-function processing unit 32
`extracts representative information from said information. Although the infonnation amount of the
`representative information depends on the storage capacity of said portable wireless communication
`terminal device 12, as an example, the representative information is extracted as follows:
`[0031] 1. Voice, data (electronic mail): Basically, all such information is treated as representative
`information. If the amount of information involved is large, in the case of voice, the information is
`divided by time, and in the case of data, it is divided in terms of so many bytes from the beginning
`of the data.
`
`2. Fax, and still images: The image is reduced, and the scale is transformed to suit the supported
`resolution on the wireless communication terminal device. If the amount of information is large in
`all cases, only the transmission part is reduced and transmitted.
`3. Moving pictures: One scene between cut points is extracted, and the results are reduced and
`transmitted as a still image.
`4. Pager: The data is transferred as is.
`[0032]
`The extracted representative information is stored in time series in the communication
`recording unit 33, and it is transferred to the portable wireless communication terminal device 12
`through the communication unit 31. The communication recording unit 33 being located above the
`database 34 in levels, the stored data in the communication recording unit 33 is structured in terms
`of media type, time of arrival, and representative information; it is stored in association with the
`original information which is stored in the database unit 34. In this manner, information retrieval
`can be performed easily through the use of keywords. The structured information is transfened to
`the portable wireless communication terminal device 12 via the communication unit 31.
`[0033] On the portable wireless communication tenninal device 12, the communication unit 41
`receives the information transmitted from said communication terminal device 11, and the icon
`
`179App|e—CAOO14752
`
`Samsung Ex. 1211 p. 410
`
`

`
`display unit 11 displays it in the form of icons. IIere, icons are characterized by the type of
`information received, such as media type and ultra—reduced images of representative information.
`[0034]
`In concrete tenns, the icon display unit 42 is comprised of a device such as a liquid crystal
`display unit + a touch panel, and interactions with the user are input into the device. As shown in
`FIGs. 2 and 3, when an icon is selected by means of interaction, representative information and
`function keys are displayed on the icon display unit 42.
`[0035]
`The types of function keys provided vary depending on the media, as shown in FIG. 3;
`however, generally the following function keys are provided:
`1. reply: Reply
`2.
`trans: Transfer - to output moving pictures and the like to other terminal devices
`3. detail: To request detailed information from a communication terminal device
`4. delete: To delete data off the communication terminal device
`
`5. quit: The default is to erase the icons on the wireless communication terminal device and return
`to a higher—level screen (the icon display screen)
`6. save: To save the icon. After this processing, a quit will not erase the icon.
`[003 6]
`Based upon the specific function key selected, the communication processing unit 43
`performs such procedures as assigning a destination address for performing communications, and
`[SOMETHING] [Translator ’s note: the subject ofsemence missing] is transmitted from the
`communication unit 41 of the portable wireless communication terminal device 12. For example, if
`a request for detailed information is sent by return transmission from the communication terminal
`device 11, the request is received on the communication unit 31, the linked original information is
`fetched from the database unit 34 via the communication recording unit 33, and it is transmitted
`from the communication unit 31 to the portable wireless communication terminal device 12.
`[003 7] Next, an explanation of Embodiment 2 of the present invention follows. FIG. 5, which is a
`configuration diagram that shows Embodiment 2 of the present invention, depicts an embodiment in
`a video distribution service, such as CATV, or a video—on—demand service using CATV. In the
`figure, Reference Number 20 is a communication terminal device equipped with a monitor TV 21
`and a set top 22. Reference Number 23 denotes a portable wireless communication tenninal device;
`24, a wireless base station; 25, a communication network; and 26, a video distribution center.
`[0038] The set top 22, located between the monitor TV 21 and the communication network 25,
`permits the reception of videos from the video distribution center on the monitor TV 21, and
`performs communications with the wireless base station 24 and the video distribution center 26
`through the communication network 25. In addition, the portable wireless communication terminal
`device 23 is designed to perform wireless communications with the wireless base station 24. In this
`manner, the portable wireless communication tenninal device 23 can communicate with the set top
`22 through the wireless base station 24 and the communication network 25. The configuration of
`the set top 22 is virtually the same as that of the communication terminal device ll of Embodiment
`I described previously, and the configuration of the portable wireless communication terminal
`device 23 is similar to that of the portable wireless communication tenninal device 12 of
`Embodiment l.
`
`[0039] According to the foregoing configuration, the user requests video infonnation onto the set
`top 22 from the video distribution center 26 from the poitable wireless communication terminal
`device 23 via the wireless base station 24 and the communication network 25. In this manner, the
`set top 22, accessing the video distribution center 26 and acquiring video information, extracts
`representative infonnation from said video infonnation and transmits it to said portable wireless
`communication tenninal device 23. In this manner, the user can learn the video information
`acquired in terms of said representative information.
`
`179App|e—CAO014753
`
`Samsung Ex. 1211 p. 411
`
`

`
`Specifically, when there is incoming video information from the video distribution center
`[0040]
`26 onto the set top 22, the communication unit 31 receives it, and the high-function processing unit
`32 extracts representative information from said video information. The infonnation volume of this
`representative information is similar to the case in Embodiment 1 described previously.
`[0041] The extracted representative information is stored in time series in the communication
`recording unit 33, and it is transfe