`
`1111111111111111111111111111111111111111111111111111111111111
`US007580005Bl
`
`c12) United States Patent
`Palin
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,580,005 Bl
`Aug. 25, 2009
`
`(54) DISPLAY CHANGE BETWEEN MOBILE
`TERMINAL DISPLAY AND EXTERNAL
`DEVICE DISPLAY
`
`(75)
`
`Inventor: Arto Palin, Lempiiiilii (FI)
`
`(73) Assignee: Nokia Corporation, Espoo (FI)
`
`( *) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21) Appl. No.: 09/639,196
`
`(22) Filed:
`
`Aug. 15, 2000
`
`(51)
`
`Int. Cl.
`(2006.01)
`G09G 5100
`(52) U.S. Cl. .......................... 345/1.1; 345/1.2; 345/2.1;
`345/2.3
`(58) Field of Classification Search ................ 340/5.61,
`340/825.72; 345/2, 352, 1.1, 1.2, 2.1, 2.3;
`455/550, 576, 41.2, 41.3, 556, 557, 566;
`370/473, 474, 476; 348/552, 555; 715/716-718,
`715/961
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`6,453,160 B1 * 9/2002 Thomas eta!. .............. 455/419
`6,496,122 B2 * 12/2002 Sampsell ............... 340/825.69
`6,580,422 B1 * 6/2003 Reilly ........................ 345/169
`6,611,358 B1 * 8/2003 Narayanaswarny .......... 358/442
`
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`DE
`
`197 19 908 A1
`
`1111998
`
`(Continued)
`
`OTHER PUBLICATIONS
`
`EPC Article 96(2) Communication (dated Nov. 5, 2002) in EPO
`Application No. 01 660 146.0-1525.
`
`Primary Examiner-Hau H Nguyen
`(7 4) Attorney, Agent, or Firm-Locke Lord Bissell & Liddell
`LLP
`
`(57)
`
`ABSTRACT
`
`U.S. PATENT DOCUMENTS
`5,307,055 A *
`5,550,593 A *
`5,666,159 A *
`5,734,413 A *
`5,831,664 A *
`5,850,340 A
`5,880,732 A *
`6,002,450 A
`6,064,420 A *
`6,084,584 A *
`6,097,441 A *
`6,122,526 A *
`6,227,043 B1 *
`6,287,200 B1 *
`6,297,737 B1 *
`6,357,042 B2 *
`
`4/1994 Baskin eta!. ................ 345/2.2
`8/1996 Nakabayashi
`9/1997 Parulski eta!. . .. ... ... .. 348/211.2
`3/1998 Lappington eta!. ......... 725/141
`1111998 Wharton eta!.
`12/1998 York .......................... 364/188
`3/1999 Tryding ...................... 345/810
`12/1999 Darbee eta!. ............... 348/734
`5/2000 Harrison eta!. ............. 725/136
`7/2000 Nahi eta!.
`8/2000 Allport ....................... 348/552
`9/2000 Parulski eta!. ........... 455/556.1
`5/2001 Schoenbeck eta!. .......... 73/116
`9/2001 Sharma
`10/2001 Irvin
`3/2002 Srinivasan
`
`A system is provided for transmitting an image from a first
`display device having certain display capabilities to a second
`display device having different display capabilities. The
`image may be received by the first display device as data in a
`packet or plurality of packets. The packets are split by a
`splitting application into data to be displayed on the first
`display device, if any, and data to be displayed on the second
`display device. The data to be displayed on the second display
`device is reformatted at the first display device to be trans(cid:173)
`mitted over a wireless, short range communication link, such
`as a Bluetooth link. The system thereby enables the display on
`the second display device of an image that either could not be
`displayed on the first display device or could not be displayed
`with the same capabilities as on the first display device.
`
`16 Claims, 9 Drawing Sheets
`
`13
`
`33
`
`GSM/EDGE/
`WCDMA
`PROTOCOL
`STACK
`
`GSM/EDGE/
`WCDMA
`PROTOCOL
`STACK
`
`BLUETOOTH
`PROTOCOL
`STACK
`
`BLUETOOTH
`PROTOCOL
`STACK
`
`12
`
`22
`
`Samsung Ex. 1002
`
`
`
`US 7,580,005 Bl
`Page 2
`
`U.S. PATENT DOCUMENTS
`6,765,557 B1 * 7/2004 Segal eta!. ................. 345/173
`6,792,148 B1 * 9/2004 Wergeland eta!. .......... 382/232
`6,795,715 B1 * 9/2004 Kubo eta!. .............. 455/556.1
`6,968,365 B2 * 1112005 Hollstrom et al ............ 709/217
`FOREIGN PATENT DOCUMENTS
`9/1990
`0 426 966 A2
`
`EP
`
`GB
`wo
`wo
`wo
`wo
`
`2 348 083 A
`wo 98/16062
`wo 99/34564
`wo 99/34599
`wo 00/18025
`
`9/2000
`4/1998
`7/1999
`7/1999
`3/2000
`
`* cited by examiner
`
`Samsung Ex. 1002
`
`
`
`U.S. Patent
`
`Aug. 25, 2009
`
`Sheet 1 of9
`
`US 7,580,005 Bl
`
`BASE STATION
`
`10
`
`FIG. 1 (a)
`TV RECEIVER 0
`
`30
`
`GSM/EDGE/WCDMA
`TERMINAL
`
`1?
`SERVICE
`PROVIDER
`
`l
`
`GSM/EDGE/
`WCDMA
`PROTOCOL
`STACK
`1(5 i
`
`2)8
`
`t
`
`SPLITTING APPLICATION
`
`l
`
`GSM/EDGE/
`WCDMA
`PROTOCOL
`STACK
`i ~5
`
`l
`
`BLUETOOTH
`PROTOCOL
`STACK
`
`cis i
`
`)3
`TV
`APPLICATION
`
`l
`
`BLUETOOTH
`PROTOCOL
`STACK
`
`i
`
`ci6
`
`(
`22
`
`(
`12
`
`FIG. 1(b)
`
`Samsung Ex. 1002
`
`
`
`U.S. Patent
`
`Aug. 25, 2009
`
`Sheet 2 of 9
`
`US 7,580,005 Bl
`
`202
`j_
`)
`
`_. ...
`
`DISPLAY
`
`v-216
`
`~
`
`218
`_\
`SPLITTING
`APPLICATION
`
`•
`NETWORK
`TRANSCEIVER
`
`AI'
`
`A~
`
`1-"' r--
`
`206
`
`~
`
`204
`\
`SHORT RANGE
`TRANSCEIVER
`
`208
`L..,
`
`, ..
`
`4
`
`CPU
`
`~
`
`c..
`
`'I' 212
`,,. ~
`STORAGE
`
`, 21~
`
`MEMORY
`
`i
`20
`
`FIG. 2
`
`Samsung Ex. 1002
`
`
`
`U.S. Patent
`
`Aug. 25,2009
`
`Sheet 3 of9
`
`US 7,580,005 Bl
`
`40
`)
`
`RECEIVE PACKETS FROM WIRELESS
`COMMUNICATIONS NETWORK
`
`41
`_)
`
`~,
`
`SPLITTING APPLICATION
`
`42
`)
`~,
`ASSEMBLE DATA ADDRESSED TO
`EXTERNAL DISPLAY DEVICE
`RECEIVER INTO SHORT RANGE RF
`COMPLIANT PACKETS
`
`FIG. 3
`
`Samsung Ex. 1002
`
`
`
`U.S. Patent
`
`Aug. 25, 2009
`
`Sheet 4 of9
`
`US 7,580,005 Bl
`
`54
`58
`\
`\
`HEADER MOBILE PHONE
`PART
`
`56
`\
`TV RECEIVER PART
`
`50
`
`FIG. 4(a)
`
`54
`60
`58
`\
`\
`)
`HEADER MOBILE PHONE HEADER
`PART
`
`56
`)
`
`TV RECEIVER PART
`
`52
`
`FIG. 4(b)
`
`Samsung Ex. 1002
`
`
`
`U.S. Patent
`
`Aug. 25, 2009
`
`Sheet 5 of9
`
`US 7,580,005 Bl
`
`90
`
`82
`
`APPLICATIONS
`
`84
`
`80
`
`TCPIIP
`
`HID
`
`RFCOMM
`
`DATA
`
`L2CAP
`
`AUDIO
`
`88
`
`LINK MANAGER
`
`BASEBAND
`
`RF
`
`FIG. 5
`
`Samsung Ex. 1002
`
`
`
`U.S. Patent
`
`Aug. 25, 2009
`
`Sheet 6 of9
`
`US 7,580,005 Bl
`
`95
`(
`J
`
`MSB
`
`0-2745
`
`PAYLOAD
`\
`
`I
`98
`
`LSB 72
`
`ACCESS
`CODE
`\
`
`I
`96
`
`54
`
`HEADER
`\
`
`I
`97
`
`FIG. 6
`
`Samsung Ex. 1002
`
`
`
`U.S. Patent
`
`Aug. 25, 2009
`
`Sheet 7 of 9
`
`US 7,580,005 Bl
`
`ESTABLISH CONNECTION BETWEEN MOBILE
`TERMINAL AND EXTERNAL DISPLAY DEVICE
`
`f--..' 100
`
`,,
`SEND SHORT RANGE RF DATA PACKETS FROM
`MOBILE TERMINAL TO EXTERNAL DISPLAY
`DEVICE
`
`f--..' 102
`
`~,
`
`BUFFER DATA PACKETS AT EXTERNAL
`DISPLAY DEVICE
`
`__.., 104
`
`,,
`STRIP ACCESS CODE AND HEADER(S) FROM
`PAYLOAD
`
`r-----106
`
`,lr
`
`REASSEMBLE PAYLOADS INTO DATA STREAM
`
`__.., 108
`
`FIG. 7
`
`Samsung Ex. 1002
`
`
`
`U.S. Patent
`
`Aug. 25, 2009
`
`Sheet 8 of9
`
`US 7,580,005 Bl
`
`PACKET 1
`
`PACKET 2
`
`,. ,.
`
`MASTER
`(MOBILE PHONE}
`20
`
`DATA
`
`SLAVE
`(TV RECEIVER)
`30
`
`DATA .. 110
`
`.. .. .. , . . : .. ,.
`r: ..
`r(cid:173)
`~ .. ,. .: .. ,.
`
`.: ,,
`•:
`
`FIG. 8
`
`DATA
`
`Samsung Ex. 1002
`
`
`
`U.S. Patent
`
`Aug. 25, 2009
`
`Sheet 9 of9
`
`US 7,580,005 Bl
`
`PACKET 1
`
`PACKET 2
`
`MASTER
`(MOBILE PHONE)
`20
`
`SLAVE
`(TV RECEIVER)
`30
`
`.: .. ..
`. : .. .. ,.
`DATAl[ ACK
`:: ,. ,. b
`
`TIMESLOT 1 TIMESLOT 2
`
`FIG. 9
`
`I
`I
`I
`I
`I
`
`111
`
`..
`r: :: ..
`.
`DATA . NAK ~~ DATA. ACK
`..
`.:
`'
`'
`,.
`::
`:
`: h
`l
`i tJ
`~
`
`••
`
`I"
`I!
`I•
`1:
`
`f
`
`I
`I
`I
`I
`
`:~
`
`I
`I
`I
`
`Samsung Ex. 1002
`
`
`
`US 7,580,005 Bl
`
`1
`DISPLAY CHANGE BETWEEN MOBILE
`TERMINAL DISPLAY AND EXTERNAL
`DEVICE DISPLAY
`
`BACKGROUND OF THE INVENTION
`
`2
`system allows only the textual message appearing on the
`telephone display to be viewed on the remote display. The
`system does not take into consideration the different display(cid:173)
`ing capabilities of the devices such as that the remote display
`may be capable of displaying images that the mobile tele(cid:173)
`phone cannot, which makes the system inadequate for effec(cid:173)
`tive use.
`
`SUMMARY OF THE INVENTION
`
`10
`
`1. Field of the Invention
`This invention relates to the field of showing images on
`different display devices, and particularly to display devices
`which have different capabilities for viewing the content.
`2. Description of the Related Art
`Messages may be transmitted over a wireless communica(cid:173)
`tions network to a mobile terminal, such as mobile phone,
`together with, or independently of an audio signal. The mes(cid:173)
`sage may contain various types of content to serve various 15
`functions, that are already publicly available or are becoming
`available shortly. The content may consist of still pictures or
`video. These messages may be automatically sent to a recipi(cid:173)
`ent or there may be services which respond to a recipient's
`request for a specific service.
`The display capabilities of currently available mobile ter(cid:173)
`minals are limited because of the size and weight require(cid:173)
`ments on these compact devices. A mobile terminal display
`may be provided to view an incoming video signal, but
`because of the above mentioned facts, users would not enjoy 25
`watching multiformatted images or video on such a display.
`This problem with a small display is especially problematic
`for visually impaired people.
`It is therefore desirable to find a way to view the content
`received with a mobile terminal on a separate display that has 30
`better display capabilities. A television receiver display or a
`computer monitor are examples of this kind of display having
`better display capabilities. Being able to display video sent
`over a mobile terminal on a larger display device, like a
`television display, would also allow a service provider to 35
`provide additional optional services to provide a user with
`added value, and avoid unnecessarily draining of the mobile
`terminal's battery by displaying the video on a separate dis(cid:173)
`play device that has a separate power source.
`Recently, low power RF systems have been proposed for 40
`providing communications between a plurality of transceiv-
`ers through a short range communications link. One such
`short range RF technology is currently under development
`and is referred to as "Bluetooth". This system will be com(cid:173)
`mercially available in the near future and it operates in the 45
`open spectrumaround2.45 GHz. This unlicensed radio band,
`called Industrial, Scientific, Medical (ISM) band is globally
`available. The operating range of this RF system is approxi(cid:173)
`mately 10 meters for a normal power mode and has proven to
`be economically efficient. It is planned that a Bluetooth chip 50
`having these characteristics will be inserted in all kinds of
`electrical devices for enabling communication between sepa(cid:173)
`rate devices. In PCT Application No. WO 0018025, such a
`Bluetooth link between a Bluetooth enabled mobile terminal
`and a Bluetooth enabled data terminal, such as a PC, is dis- 55
`closed.
`It would be particularly advantageous to enable the user to
`view the content, such as a video clip on a larger display,
`while the user is actually holding the mobile terminal, and
`allow the user to select what is viewed using the mobile
`terminal, or to otherwise use the mobile device while viewing
`the video clip. This would be best implemented using a wire(cid:173)
`less link between the mobile terminal and the external display
`device. U.S. Pat. No. 5,880, 732 presents a method and appa(cid:173)
`ratus enabling one specific type of usage of a remote display
`device connected to a mobile telephone. However, the inven(cid:173)
`tion offers only a partial solution to the problem, because the
`
`It is therefore an object of this invention to present a system
`and method for wirelessly linking display devices having
`different display capabilities to provide better display quality
`to a user of a mobile terminal with an economic and efficient
`short range RF link.
`This invention concentrates on providing better display
`quality to a user of a mobile device. The mobile device, such
`as a mobile phone, laptop computer, or personal digital assis(cid:173)
`tant (PDA), may be provided with a Bluetooth chip conform-
`20 ing to the Bluetooth standards described in Bluetooth speci(cid:173)
`fication v.l.OB, and another display device, like a television
`apparatus in the vicinity of the mobile device, is likewise
`provided with a similar Bluetooth chip, thereby enabling a
`short range RF communications link between the two
`devices. The mobile terminal receives image data from a base
`station in a wireless communications network or from
`another device utilizing any transmission method, including,
`but not limited to GSM, EDGE, WCDMA, DAB, DVB or
`Bluetooth link. As used herein, the term "image" is used
`interchangeably with the term "video" and includes a single
`image, picture, or graphic, a stream or plurality of still pic-
`tures, or graphics, or a conventional video.
`The system in this invention consists of a first display
`device and a second display device having a communication
`link between them. The communication link is arranged
`between said display devices by a short range RF communi-
`cation link. The image on the first display is viewed as taking
`into consideration the capabilities of the first display device,
`and the image on the second display device is viewed as
`taking into consideration the different display capabilities of
`the second display device. This can be done by splitting the
`received payload at the first display device into a plurality of
`data packets with a specific splitting application and identi(cid:173)
`fYing the packets to first display device part( s) and second
`display device part(s), which takes into consideration the
`display capabilities of the first and second display devices.
`The first display device also has means for establishing a
`first wireless communication link with a communications
`network and means for establishing a second wireless com(cid:173)
`munication link with a second display device. After splitting
`the payload into a plurality of data packets, the first display
`device forwards at least one of the data packets to the second
`display device having different display capabilities.
`The image data received by the mobile terminal comprises
`data to be ultimately reassembled into an image to be dis(cid:173)
`played on a display either on the mobile device, on an another
`display device, or on both of these devices. Because the
`mobile device may or may not have a display, and at best, will
`have a relatively small display on which it is difficult to view
`60 the image, the image data is retransmitted using a short range
`RF link, such as Bluetooth link, to an external display device
`for improved viewing quality. The improved viewing quality
`also enables a service provider to provide more advanced and
`better quality services to customers, such as images and/or
`65 video movies with higher quality resolution than could be
`effectively displayed on an ordinary display of a mobile
`phone.
`
`Samsung Ex. 1002
`
`
`
`US 7,580,005 Bl
`
`3
`The image data received by the mobile terminal is included
`within the first packet or a plurality of packets of a type
`appropriate to the wireless transmission method used. In
`addition to the data to be forwarded to the external display
`device, the packets received by the mobile terminal may
`contain data that may be used exclusively at the mobile ter(cid:173)
`minal, such as voice data, control data, image data, or data for
`a displayable menu for the mobile terminal. The mobile ter(cid:173)
`minal may have an application that splits the data packets
`received by the mobile device and forwards part of the data to 10
`the mobile terminal's own display and another part of the data
`for transmission with a short range RF link in an appropriate
`format to the external display device. At the external device,
`the short range RF data packets are reassembled into an image
`or video, as originally sent, for viewing on the external dis- 15
`play device.
`Other objects and features of the present invention will
`become apparent from the following detailed description
`considered in conjunction with the accompanying drawings.
`It is to be understood, however, that drawings are designed 20
`solely for purposes of illustration and not as a definition of the
`limits of the invention, for which reference should be made to
`the appended claims. It should be further understood that the
`drawings are not necessarily drawn to scale and that, unless
`otherwise indicated, they are merely intended to conceptually 25
`illustrate the structures and procedures described herein.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`4
`Broadcasting) or DVB (Digital video broadcasting); although
`technologies with faster data transmission rates, like EDGE,
`WCDMA or DVB are preferred over GSM and DAB tech(cid:173)
`nologies.
`In FIG. 1(a) is shown the basics of this invention. A con(cid:173)
`ventional wireless connection has a wireless link 12 between
`the base station 10 of a service provider 13 and the mobile
`terminal 20 to exchange the conventional radio frequency
`(RF) signals that pass between the base station 10 of a service
`provider 13 and the mobile terminal 20. Signals may be
`received by and transmitted to base station 10 from the mobile
`terminal 20. A protocol stack 15 specific to the transmission
`method used at the base station 10 handles the transmission
`and a similar protocol stack 25 at a mobile terminal 20
`handles the received signal as shown in FIG. 1(b). A wireless
`short range RF link 22, e.g., a Bluetooth link, is also estab-
`lished between the mobile terminal and external display
`device, like a television receiver 30 or a computer monitor.
`This requires that the mobile terminal can establish this short
`range RF link. The Bluetooth link can be established with a
`Bluetooth chip manufactured according to the Bluetooth
`Specification Version LOB and standards (available on the
`internet at the "bluetooth.net" Web site).
`In one implementation, a Bluetooth chip is connected to the
`printed circuit board of the mobile terminal 20. The external
`display must also be outfitted with a Bluetooth chip, which
`may be installed on the printed circuit board of the external
`display device (television receiver 3 0 in this example), or may
`be otherwise connected to the display device, such as with an
`30 external device plugged in to the display device (not shown in
`FIG. 1(a)).
`The Bluetooth link 22 does not require the mobile terminal
`20 and the TV 30 to be within direct line-of-sight with each
`other, but the devices must be inside the transmission/recep-
`35 tion range of the Bluetooth chips for the signal from the
`mobile terminal 20 to be received in the TV 30. As earlier
`stated, the operating range of Bluetooth using normal 0 dBm
`transmission power is approximately 10 meters, which pre(cid:173)
`sents no problem for mobile terminal users who wish to view
`video on a television display and be able to control the video
`content with the terminal because users rarely watch televi-
`sion at distances farther than 10 meters. The Bluetooth stan(cid:173)
`dard presently supports an asynchronous data channel, as
`many as three synchronous voice channels, or a charmel,
`which simultaneously supports asynchronous data and asyn(cid:173)
`chronous voice. Associated with each of the Bluetooth chips
`at the mobile terminal 20 and the television receiver 30 is a
`multilayer Bluetooth protocol stack 65, 66, respectively, used
`for setting up and maintaining a Bluetooth link 22 between
`50 these Bluetooth-enabled devices.
`Where video capabilities are provided, a conventional
`communication link 12 may be set up initially as an audio
`only call with the allowance for subsequent requests for video
`or link 12 may be initially set up to transmit audio and/or
`video. At the setup of service for mobile terminal20, at a call
`setup, or at some other time, the base station 10 must be
`informed whether or not the mobile terminal 20 has a video
`capability or can transmit the video to a nearby Bluetooth
`enabled display device for viewing, and if so, the level of
`60 graphics that is enabled, such as whether high quality graph(cid:173)
`ics can be received and viewed. A user may request that a
`radio signal containing video content be transmitted from the
`communications network via a base station 10 to mobile
`terminal 20. Alternatively, the base station 10 may simply
`65 begin transmitting a video signal when it has a video to send.
`Although the discussion herein focuses on sending a com(cid:173)
`bined audio and video signal, it should be understood that the
`
`In the drawings wherein like reference numerals denote
`similar elements throughout the several views:
`FIG. 1(a) is a schematic representation of a base station,
`mobile phone and an external display device;
`FIG.1(b) is a block diagram of the basic protocol path from
`base station to television receiver, that may be used in prac(cid:173)
`ticing the present invention;
`FIG. 2 is a simplified picture illustrating the structure of the
`mobile terminal in the view of this invention;
`FIG. 3 is a flow chart of the method for handling the video
`data to be retransmitted to the external display device at the 40
`wireless device;
`FIG. 4(a) is a plan view of a first possible data frame
`structure for transmitting a combined audio and video signal;
`FIG. 4(b) is a plan view of a second possible data frame
`structure for transmitting a combined audio and video signal; 45
`FIG. 5 is a schematic representation of the Bluetooth pro(cid:173)
`tocol stack;
`FIG. 6 is a plan view of the standard Bluetooth packet
`format;
`FIG. 7 is a flow chart of the method of transmitting video
`data from the wireless device to the external display device;
`FIG. 8 is a diagrammatical view of a method for broadcast(cid:173)
`ing the video packets from the mobile device to the external
`display device; and
`FIG. 9 is a diagrammatical view of a method for transmit- 55
`ting the video packets from the mobile device to the external
`display device using a specific polling scheme.
`
`DETAILED DESCRIPTION OF THE PRESENTLY
`PREFERRED EMBODIMENTS
`
`The present invention may be implemented in conjunction
`with a wireless communications network using any wireless
`transmission methods, such as known methods like GSM
`(Global System for Mobile Communications), EDGE (En(cid:173)
`hanced Data Rates for GSM Evolution), WCDMA (Wide(cid:173)
`band Code Division Multiple Access), DAB (Digital Audio
`
`Samsung Ex. 1002
`
`
`
`US 7,580,005 Bl
`
`5
`invention is equally applicable to the transmission and han(cid:173)
`dling of a video only signal or an audio only signal. It should
`be further understood that, rather than being transmitted from
`a base station, the signal may be transmitted to a mobile
`terminal from a short range RF-enabled device over a short 5
`range RF or other wireless link.
`To handle a video feed that has a packet size larger than a
`single data frame, the mobile terminal 20 must receive a data
`stream from the service provider in a format wherein the
`video can be split into several data frames. Thus, basic infor- 10
`mation/control data may be sent by the service provider in a
`first data frame and the high quality graphics signal is split up,
`and transmitted thereafter as additional data frames.
`FIG. 2 shows a simplified picture of a mobile terminal 20
`illustrating necessary components to perform the procedures 15
`of this invention. In the mobile terminal 20 there is a network
`transceiver 206, to receive transmissions from and to transmit
`requests to the wireless communications network, a short
`range transceiver 204 to enable communication with nearby
`devices, a CPU 208 unit for controlling and executing all
`necessary procedures, a memory unit 210, a storage unit 212,
`a display 202 for displaying the images, and an antenna 216.
`In the case of DVB or DAB, the terminal must also have a
`DVB or DAB receiver (not shown). Also, inside or outside the
`CPU unit is a software-based splitting application 218, which
`enables the handling and splitting of the different data frames.
`FIG. 3. shows a flow chart illustrating the method for
`handling the video data to be sent from the service provider 13
`to the external display device 30 via mobile terminal 20. At
`step 40, the service provider 13 transmits data frames as
`packets to mobile terminal 20 over the wireless communica(cid:173)
`tions network which are received by mobile terminal 20.
`Where both audio and video are sent simultaneously via the
`packets, a packet containing video information may have a
`data frame structure that can be split into a mobile terminal
`part 54 and external display device part 56. Two possible
`basic data frame structures are data frame structure 50 shown
`in FIG. 4(a) and data frame structure 52 shown in FIG. 4(b).
`Mobile terminal part 54 may include any voice data to be
`heard over or otherwise used by the mobile terminal 20 as 40
`well as images, call feature or other data to be used by the
`mobile terminal such as textual information, caller-ID,
`e-mail, and the like, to be displayed on a display of the mobile
`terminal 20. External display device part 56 is the part to be
`forwarded to the external display device 30 and generally 45
`follows the mobile terminal part 54 within the signal sent by
`a base station 10 to allow the mobile terminal part 54 to be
`split off first and used by the mobile terminal 20. The external
`display device part 56 generally includes a video portion of
`the signal and may include an audio portion to be played with 50
`the video on the external display device. In data frame struc(cid:173)
`tures 50, 52 a header part 58 precedes mobile terminal part 54.
`In data frame structure 52, a separate header part 60 also
`precedes the external display device part 56. The precise
`length of the mobile terminal part 54 and the external display 55
`device part 56 will depend on the currently utilized transmis(cid:173)
`sionmethod, i.e. GSM, EDGE, WCDMA, DAB, DVB, Blue(cid:173)
`tooth or some other method. The external display device part
`56 is transmitted from the mobile terminal to the external
`display device, such as a TV 3 0, over wireless short range RF
`link 22, such as Bluetooth link. It should be noted that the
`various parts of the data frame structures 50, 52 shown in
`FIGS. 4(a) and 4(b) are not necessarily drawn to scale.
`In one preferred embodiment of this invention the short
`range RF link 22 is specified as a Bluetooth link and thereby 65
`the protocol stack considered in this invention is a Bluetooth
`protocol stack. The features of that particular Bluetooth pro-
`
`6
`tocol stack are shown in FIG. 5, and the various layers of the
`protocol stack (65, 66 in FIG. 1) at mobile terminal20 and at
`external display device 30 are discussed in the Bluetooth
`Specification v.l.OB. The lowest layer is the radio layer 70,
`which provides an interface between the host devices and the
`Bluetooth chip. Above the radio layer is the baseband layer 72
`which specifies the procedures to support the exchange of
`real-time voice and data information streams and networking
`between Bluetooth devices. Above the baseband layer 72 is
`the Link Manager 74 which is used for link set-up, security
`and control. The Logical Link Control and Adaptation Pro-
`tocol (L2CAP) layer 76 supports higher-level protocol mul(cid:173)
`tiplexing, packet segmentation and reassembly, and convey(cid:173)
`ing the quality of service information. An Applications layer
`90 is the highest layer in the Bluetooth protocol. Data 78
`passes between the L2CAP layer 76 and the Applications
`layer 90 via one or more of the following interfaces: TCP/IP
`80, HID (human interface device/host interface device) 82, or
`RFCOMM 84 (discussed at Part Fl of the Bluetooth Speci-
`20 fication). A control sequence 86 passes between the Link
`Manager 7 4 and Applications layer 90 to set up the Asynchro(cid:173)
`nous Connection Link (ACL) between Bluetooth devices and
`provides a pathway for the Applications layer 90 to send
`control information, such as to notify Link Manager 7 4 that a
`25 packet was lost. An audio component 88 of the multilayer
`protocol stack 65 handles any audio to be transmitted to the
`external display device.
`Returning to the method of FIG. 3, at step 41, the mobile
`terminal's splitting application 218 (shown in FIG. 1(b)) is
`30 used to split the mobile terminal part 54 from the external
`display device part 56 at the Applications layer 90. (As an
`alternative to implementing the splitting application 218 at
`the Applications layer 90, data can be processed and delivered
`through the RFCOMM protocol or another layer in the pro-
`35 tocol stack.) The splitting application 218 takes a data frame
`from a data stack (not shown) at mobile terminal20 received
`from base network 10 over communications link 12 and
`determines where the external display device part 56 is
`located within the data frame structure by knowing the fixed
`length of the mobile terminal part 54. If data frame structure
`52 is used, the separate header part 60 indicates the location of
`the external display device part 56. To provide time for the
`splitting application 218 to handle the incoming data from the
`network, the received signal is buffered at the mobile terminal
`20 ina buffer(not shown). Once the data is split, at step 42, the
`external display device part 56 is further processed by the
`Bluetooth protocol stack 65 at the mobile terminal 20 where
`one or more external display device parts are reassembled
`into one or more Bluetooth compliant packets formed in
`accordance with the Baseband Specification within the Blue(cid:173)
`tooth Specification, the number of such packets depending on
`the amount of data to be sent.
`Referring to FIG. 6, eachB!uetooth packet 95 comprises an
`access code 96 specific to a master's address in the connection
`mode and identifying each packet in one piconet, a header 97
`containing link control information, and a payload 98, which
`comprises one or more external display device parts 56 or a
`portion of an external display device part, the organization of
`the data into Bluetooth packets depending on the size of
`60 external display device part 56 and the size of the payload 98.
`These packets 95 are placed into a data stack within the
`Bluetooth chip and are then ready to be transmitted to external
`display device 30. The various parts of Bluetooth Packet 95
`shown in FIG. 6 are not necessarily drawn to scale.
`A wireless link 22 to send data between mobile terminal
`and external display device 30 is established using the Blue(cid:173)
`tooth protocols. The mobile terminal must be set up as the
`
`Samsung Ex. 1002
`
`
`
`US 7,580,005 Bl
`
`7
`"master" to control the communication with the external dis(cid:173)
`play device 30 which is a "slave". The master and slave
`communicate over shared channel and form a "piconet". The
`channel is defined in the Bluetooth Specification as a pseudo(cid:173)
`random hopping sequence through the defined RF channels
`that is unique to the piconet.
`Generally, the mobile terminal 20 becomes the master
`automatically when video service is ordered with the mobile
`terminal 20 and the connection to external display device 30
`is initiated. However, if the external display device 30 is set up
`as the master, for any reason, the master and slave must
`exchange roles, with the slave becoming the master and vice
`versa, i.e. a master-slave switch is performed in accordance
`with the Bluetooth Specification.
`Referring now to the flow chart of FIG. 7, at step 100, the
`connection is initialized by mobile terminal 20 which serves
`as a master. If an external display device 30 has been previ(cid:173)
`ously identified with a specific device address to the master
`(mobile terminal), which is the case when the same master(cid:173)
`slave relationship was previously set up, the master usually
`transmits a "Page Scan" command to page the known Blue(cid:173)
`tooth unit within the external display device 30. (If the mas(cid:173)
`ter-slave relationship was previously established and was
`maintained in "park" mode, there is no need to set up a new
`connection; a command must only be sent to exit "park" mode
`to restart the communication.) If no such external display
`device 30 has been previously identified to mobile terminal
`20 as a master, the mobile terminal20 broadcasts an "Inquiry"
`message to determine what other Bluetooth units are within
`the coverage area wherein two Bluetooth units can exchange
`messages with acceptable quality and performance. The
`Bluetooth units that capture the broadcast "Inquiry" mes(cid:173)
`sages will send a response to the mobile terminal20 providing
`information about the responding Bluetooth unit and its host
`device, which would include any Bluetooth-enabled external
`display device in the coverage area. After locating the exter(cid:173)
`nal display device, a "Connection" state is established in
`which the mobile phone 20 is the master and the external
`display device 30 is the slave, thereby preventing the external
`display device from recei