I IIIII IIIIIIII Ill lllll lllll lllll lllll lllll lllll lllll lllll 111111111111111111
`US007167703B2
`
`02) United States Patent
`Graham et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,167,703 B2
`Jan.23,2007
`
`(54) W IRELESS MOBILE IMAGE MESSAGING
`
`(75)
`
`Inventors: Tyrol R. Graham, Seattle, WA (US);
`Eric J. Hull, Seattle, WA (US);
`Jonathan 0. Nelson, Kirkland, WA
`(US)
`
`(73) Assignee: Wildseed, Ltd., Seattle, WA (US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 720 days.
`
`4/1996 Koicbi
`5,5 10,907 A
`5.848,373 A * 12/1998 DeLorme et al. ··········· 701/200
`6,249,689 Bl
`6/2001 Aizawa
`6,430,409 Bl
`8/2002 Rossmann
`6,512,448 Bl
`1/2003 Rincon et al.
`6,757,521 Bl* 6/2004 Ying ....................... 455/67.11
`6,801,793 Bl * 10/2004 Aamio et al. ............... 455/566
`6,865,386 Bl * 3/2005 Aoyama et al. ............ 455/4 15
`6,888,927 Bl * 5/2005 Cmickshank et al. .... 379/88.11
`6,920,637 Bl * 712005 Mason et al ................ 719/318
`1/2003 Ausems et al.
`.. ..... 455/556
`2003/0013483 Al*
`
`(21) Appl. No.: 10/255,860
`
`(22) Filed:
`
`Sep. 25, 2002
`
`(65)
`
`Prior Publication Data
`US 2003/0060240 Al Mar. 27, 2003
`
`Related U.S. Application Data
`
`(60) Provisional application No. 60/325,094, filed on Sep.
`25, 2001.
`
`(51)
`
`Int. Cl.
`(2006.01)
`H04M 3/42
`(2006.01)
`H04M 1/00
`(2006.01)
`H04Q 7120
`(52) U.S. Cl. ...................... 455/415; 455/466; 455/566;
`349/93.23; 349/142.17; 349/ 142.06
`(58) Field of Classification Search ................ 455/566,
`455/403, 404.2, 412.l, 412.2, 414.l, 414.2,
`455/414.4, 456.l, 456.3, 458, 463
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCutvIENTS
`
`"' cited by examiner
`
`Primary Examiner- Tony T. Nguyen
`(74) Attorney, Agent, or Finn- Schwabe, Williamson &
`Wyatt, PC
`
`(57)
`
`ABSTRACT
`
`Non-verbal conuuunications between users of wireless
`mobile devices are facilitated using image messages. An
`image message may e.g. convey infonnation about the
`sender user, in particular, current infom1ation about the
`sender user. In one aspect, a user may select an image
`message category, and select an image message among the
`image messages of the selected image message category for
`transmission, to quickly, efficiently and graphically convey
`(current) information about the user. The process may be
`performed to form a mixed media message. Received image
`message to convey current information may be aged via time
`and/or color displays.
`
`5,319,363 A •
`
`6/ 1994 Welch et al. .......... 340/825.36
`
`38 Claims, 15 Drawing Sheets
`
`SM 1
`
`504
`
`5112
`
`510
`
`503
`
`I
`
`I
`
`it,
`
`.,;;
`:4.,
`
`'
`
`l
`aw«ll IMACE1
`AC110t1LOGl110HMOODSt'MJol.
`D
`CJ Cl
`Cl
`·ii'i
`0 D D
`D
`.<;;
`'. ',t D OD D
`J?
`·:,~
`0 D D D
`·,~
`<.-OOPM
`·~":
`1---- - ---.
`, 8 0 8 1
`1 8 8 8 1
`I
`I
`1 () 8 8 1
`,o 8 8 1
`I
`I
`. ·, ~- -- --- - '
`@-J20
`
`GOOGLE EXHIBIT 1005
`
`Page 1 of 26
`
`

`

`U.S. Patent
`
`Jan. 23, 2007
`
`Sheet 1 of 15
`
`US 7,167,703 B2
`
`Q
`
`DEVICE
`(FIG. 4)
`
`0 MOBILE
`
`D EVICE
`<FIG.4)
`
`400
`
`Seroer
`Computer
`(FIG. 3)
`
`300
`
`110
`
`Wireless Network
`
`Q
`
`D EVICE
`<FIG. 4)
`
`400
`
`0 M OBILE
`
`DEVICE
`<FIG. 4)
`
`Wide Area
`Network/Local
`Area Network
`(FIG. 2)
`
`Seroer
`Computer
`(FIG. 3)
`
`300
`
`Fig.1
`
`Page 2 of 26
`
`

`

`U.S. Patent
`
`Jan.23,2007
`
`Sheet 2 of 15
`
`US 7,167,703 B2
`
`LAN
`
`LAN
`
`WIDE
`AREA
`NETWORK
`(WAN>
`
`210
`
`240
`
`210
`
`ROUTER
`
`LAN
`
`LOCAL
`AREA
`NETWORK
`(LAN)
`
`/
`
`200
`
`Fig.2
`
`240
`
`REMOTE
`COMPUTER
`
`Page 3 of 26
`
`

`

`U.S. Patent
`
`Jan.23,2007
`
`Sheet 3 of 15
`
`US 7,167,703 B2
`
`~
`5300
`--------------------------------- •1
`-·------.. ·-------------., ____ _
`----~ 0 ---
`
`-------
`----------
`
`,,,,,
`
`.
`~
`server computer
`. -- . --
`r\)12
`
`CPU
`
`--...
`~----------.
`
`322
`r---.J
`
`310
`
`;>
`
`network
`interface
`unit
`
`~
`
`~6
`~ l
`I
`320
`RAM ~ CD-ROM/ """'
`I DVD-ROM IV
`operating
`sustem
`drive
`r
`
`I
`I wwwserver
`
`Image Message
`Server
`
`330
`~ J
`
`336
`~J
`
`326
`
`input/output
`interface
`
`r\
`324
`l/
`
`hard disk r\)38
`drive
`
`332
`,::::,
`ROM
`
`318
`bios ~
`
`...... 014
`
`video
`display
`adapter
`
`~
`
`...
`
`•
`Fig.3
`
`Page 4 of 26
`
`

`

`U.S. Patent
`
`Jan.23,2007
`
`Sheet 4 of 15
`
`US 7,167,703 B2
`
`0
`
`MOBILE
`DEVICE
`
`CPU
`
`400
`y---J
`
`rv12
`422
`r---.J
`
`Power
`
`h
`
`426
`IV
`
`410
`
`~
`
`Wireless ,
`Interface ~
`unit
`
`-~
`
`~
`
`1-- Illuminator
`
`rvso
`
`Haptic
`Interface
`
`0452
`
`Audio ~454
`
`-
`
`-
`
`- Display ~456
`
`~
`
`I,
`
`416
`")
`/ r
`'
`
`I
`RAM r-. \420
`operating -
`s11stem
`
`424
`r-J
`Input/Output
`Interface
`
`["'
`
`Image Message
`Application
`
`Irr-,..,
`
`430
`
`434
`
`r~
`I Programs
`I Data Storage 1,~
`436 u 4580
`
`Keypad ...._
`
`'
`
`432
`.>
`ROM
`
`4V'
`
`Infrared
`1/0
`
`418
`
`--~
`
`BIOS
`
`'
`448
`~
`
`Memory
`
`~
`
`'
`
`'
`
`Fig.4
`
`Page 5 of 26
`
`

`

`U.S. Patent
`
`Jan.23,2007
`
`Sheet S of 15
`
`US 7,167,703 B2
`
`5011
`
`504
`
`CHANGE IMAGE?
`ACl10N LOCATION MOOD SYMBOL
`D
`D
`D
`D
`D DD D
`DODD
`DD DD
`4:00PM
`
`502
`
`510
`
`I
`
`I
`
`r-- - - - - - .
`I CJ 0 8 1
`8 8 0:
`:o 8 0:
`10 8 8 1
`~ - - - - - - -1
`~~~~20
`
`; '
`f
`
`•
`
`505
`
`Fig. 5
`
`Page 6 of 26
`
`

`

`U.S. Patent
`
`Jan.23,2007
`
`Sheet 6 of 15
`
`US 7,167,703 B2
`
`800
`~
`
`501'
`
`~
`
`504
`
`Joe DODD
`Courts DD DD
`Nina DO D D
`Fred DO DD
`Loren DODD
`Megan D DD D
`
`r-- -- - - - .
`18 0 8 1
`: 0 0 0:
`18 8 8 1
`10 8 8 1
`
`503
`
`I
`
`I
`
`'
`
`522
`
`'- +
`
`r,
`
`\}}
`
`~' '
`:it. -
`'•
`
`,
`~:
`
`I
`
`I
`
`-
`-
`'----- - - -
`8,_J,20
`
`Fig. 6
`
`Page 7 of 26
`
`

`

`U.S. Patent
`
`Jan.23,2007
`
`Sheet 7 of 15
`
`US 7,167,703 B2
`
`1000
`
`r-J
`
`+
`
`+
`
`I
`
`1010
`
`IHea:, +
`
`1020
`
`1015
`~
`Image Message + Action Image + Location Image
`Flag
`Identifier
`Identifier
`
`1025
`
`1030
`_;
`Mood Image
`Identifier
`
`1035
`,)
`+ Symbol Image +I
`
`Identifier
`
`1040
`,)
`
`Time
`
`1045
`~
`
`Other
`
`Fig. 7
`
`Page 8 of 26
`
`

`

`U.S. Patent
`
`Jan.23,2007
`
`Sheet 8 of 15
`
`US 7,167,703 B2
`
`Start
`
`1100
`
`r----J
`
`Display Selectable
`Images
`
`1120
`
`Select Images From
`Categories
`
`Include Identifiers of
`Selected Images in Image
`Message
`
`1130
`
`Send Image Message To
`Other User
`
`End
`
`Fig. 8
`
`Page 9 of 26
`
`

`

`U.S. Patent
`
`Jan.23,2007
`
`Sheet 9 of 15
`
`US 7,167,703 B2
`
`Start
`
`Receive Message
`
`1205
`
`1210
`
`I
`YES
`
`1220
`
`Parse Message
`
`1240
`
`1250
`
`NO
`
`Retrieve/Regenerate
`Included Images
`
`Display Regenerated
`Images
`
`End
`
`Fig. 9
`
`Page 10 of 26
`
`

`

`U.S. Patent
`
`Jan.23,2007
`
`Sheet 10 of 15
`
`US 7,167,703 B2
`
`Start
`
`~ - -- - -- - - -- -- - -- NO- -~
`
`600
`
`r-J
`
`Image Message Server
`Receives Image
`Messages From Users
`
`640
`
`NO
`
`Image Server
`Automatically Sends
`Requestor Updated
`Image Messages For
`Every Member Of PAL
`LIST
`
`Image Server
`Automatically Sends
`Requestor Updated
`Image Message For
`Other User
`
`Fig. 10
`
`Page 11 of 26
`
`

`

`U.S. Patent
`
`Jan.23,2007
`
`Sheet 11 of 15
`
`US 7,167, 703 B2
`
`Start
`
`700
`
`r--J
`
`Image Message Server
`Receives Image Message
`From User
`
`710
`
`NO
`
`I
`YES
`
`YES
`
`Image Server
`Automatically Sends
`Image Message To
`Every Member Of
`Enabled PAL LIST
`
`Image Server Sends
`Image Message To
`Other User
`
`Store Image
`Message For
`Later Use
`
`750
`
`760
`
`Fig. 11
`
`Page 12 of 26
`
`

`

`U.S. Patent
`
`Jan.23, 2007
`
`Sheet 12 of 15
`
`US 7,167,703 B2
`
`Start
`
`Facilitate Text Input
`
`1202
`
`Facilitate Image
`Input
`
`1208
`
`1210
`
`No
`
`Figure 12
`
`Page 13 of 26
`
`

`

`U.S. Patent
`
`Jan.23,2007
`
`Sheet 13 of 15
`
`US 7,167,703 B2
`
`1304
`
`1302
`
`1308
`
`Figure 13.a
`
`Figure 13b
`
`Page 14 of 26
`
`

`

`U.S. Patent
`
`Jan.23,2007
`
`Sheet 14 of 15
`
`US 7,167,703 B2
`
`1310
`
`1312
`
`Figure 13c
`
`Figure 13d
`
`Page 15 of 26
`
`

`

`e •
`
`00
`•
`
`Header,.... 1402
`
`Body (in full textual form),_... 1404
`
`Prologue (INSTR., IMG
`ID),.,_, 1406
`
`Figure 14
`
`Page 16 of 26
`
`

`

`US 7,167,703 B2
`
`1
`WIRELESS MOBILE IMAGE MESSAGING
`
`RELATED APPLICATION
`
`The present application is the non-provisional application
`of provisional application No. 60/325,094 filed Sep. 25,
`2001, and titled "Method and Apparatus for Connnunicating
`Image Messages between Users of Mobile Devices", and
`claims priority to said provisional application. The specifi(cid:173)
`cation of the provisional application is hereby fully incor- 10
`porated by reference.
`
`FIELD OF THE INVENTION
`
`The present invention relates to mobile connnunication
`devices, and more specifically, the invention relates to
`sending and receiving image messages between users of
`mobile devices.
`
`BACKGROUND OF THE INVENTION
`
`20
`
`2
`sender users. In particular, the image message may convey
`current information about the sender users.
`In one aspect, the invention is directed towards facilitat(cid:173)
`ing a user of a wireless mobile device in efficiently selecting
`an image message category, and selecting an image message
`among the image messages of the selected image message
`category for transmission, to quickly, efficiently and graphi(cid:173)
`cally convey information about the user, in particular, cur(cid:173)
`rent information about the user.
`The image message system may include image message
`categories such as a location image message category, a
`mood image message category, an activity image message
`category, a random image message category, and so forth.
`In another aspect, the invention is directed towards send-
`15 ing the image message in a reduced bandwidth consumption
`manner, by sending an identifier of the image message. A
`recipient employing a wireless mobile device equipped with
`the invention may locally retrieve and render the image
`message based on the image message identifier provided.
`In yet another aspect, the invention is directed towards
`tracking and indicating for a user of a wireless mobile
`device, image messages sent/received, and the amount of
`time since the image messages have been sent/received.
`In yet another aspect, the invention is directed towards,
`25 determining an illuminable input key corresponding to a
`sender of an image message, and illuminating the corre(cid:173)
`sponding illuminable input key to indicate receipt of an
`image message from the corresponding sender user.
`In various embodiments, different colors may also be
`30 employed to indicate an age of a received image message
`from the corresponding sender.
`In yet another aspect, the invention is directed towards
`requesting and receiving updates to received image mes(cid:173)
`sages to update current information about sender users.
`In yet another aspect, the invention is directed towards the
`employment of mixed media messages in connnunications.
`A mixed media message includes text and images. A mixed
`media message may also further include audio, video and
`messages of other media types.
`In various embodiments, a mixed media message is sent
`in a full text form, with the images being replaced by their
`textual equivalents. In various embodiments, the textual
`equivalents may be identified as having equivalent images.
`Resultantly, the received message may be rendered in a full
`45 text form (with images replaced by their textual equivalents)
`or a mixed media form (with the images restored), depend(cid:173)
`ing on the capabilities of the receiving wireless mobile
`device, e.g., legacy devices versus devices incorporated with
`the present invention.
`
`Since their introduction, the number of services and
`features for cellular telephones has steadily increased while
`the cost of ownership and operation has decreased. At first,
`these mobile teleconnnunication devices operated on analog
`wireless networks that enabled voice communication and
`simple paging features. Later, digital wireless networks were
`introduced for cellular telephones to provide more advanced
`features for voice and data communication, such as encryp(cid:173)
`tion, caller identification and transmitting and receiving
`short message service (SMS) text messages. More recently,
`some cellular telephones enable the browsing of web pages
`on the Internet or other on-line services.
`The functionality of cellular telephones continues to
`increase. Some cellular telephones incorporate many of the 35
`features originally provided for in handheld electronic
`devices, such as personal digital assistants (PDAs). Rela(cid:173)
`tively simple PDA features such as keeping a list of contacts,
`a calendar, appointments, and the like have been generally
`integrated into recent cellular telephone models.
`Along with the increased services and features, it is
`common for individuals to own a cellular telephone and use
`it for daily connnunications. Individuals are no longer
`restricting the use of their cellular telephone to strictly
`business or emergency calls. They are talking with their
`friends about what they are currently doing, what they are
`listening to on the radio, watching on television, viewing on
`the World Wide Web, and the like. The user may want tell
`their friends what they are current doing and experiencing,
`and to know what their friends are doing, all without having 50
`to make numerous phone calls.
`However, unlike desktop computers, laptop computers
`and PDA, cellular telephones typically have limited input
`capabilities. That is, inputs typically have to be made
`through a limited number of inputs keys, e.g. through a 55
`12-key numeric keypad. Thus, a great need exists to enable
`the rich functionalities, such as non-verbal conversing with
`users of other cellular telephones, to be consumable in an
`efficient and friendly manner under the context of limited
`input keys.
`
`40
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a schematic diagram that shows an exemplary
`system overview;
`FIG. 2 is a schematic diagram that illustrates an exem(cid:173)
`plary system overview in which local area networks and a
`wide area network are interconnected by routers;
`FIG. 3 is a schematic diagram that shows an exemplary
`server;
`FIG. 4 is a schematic diagram that illustrates an exem(cid:173)
`plary mobile device;
`FIG. 5 is a schematic diagram illustrating an exemplary
`embodiment of a mobile device arranged in an image
`message edit mode;
`FIG. 6 is a schematic diagram illustrating an exemplary
`embodiment of a mobile device arranged in a received
`image message mode;
`
`60
`
`SUMMARY OF THE INVENTION
`
`The invention is directed to towards facilitating non(cid:173)
`verbal connnunications between users of wireless mobile 65
`devices, such as cellular telephones, using image messages.
`The image message may e.g. convey information about the
`
`Page 17 of 26
`
`

`

`3
`FIG. 7 is a schematic diagram illustrating an exemplary
`image message reporting system format;
`FIG. 8 is a flow chart illustrating a process for selecting
`images and sending the selected images in a message to
`other users;
`FIG. 9 is a flow chart illustrating a process for receiving
`and displaying images from other users;
`FIG. 10 is a flow chart showing a process for polling for
`image messages from at least one other member of a list; and
`FIG. 11 is a flow chart illustrating a process for broad- 10
`casting image message updates to every other member of a
`list, in accordance with the invention.
`FIG. 12 is a flow chart illustrating a process for commu(cid:173)
`nication between users of wireless mobile stations using
`mixed media messages.
`FIGS. 13a-13d illustrate a number of example screen
`snapshots for the communication process of FIG. 12.
`FIG. 14 illustrates an example mixed media message
`format, in accordance with one embodiment.
`
`15
`
`DETAILED DESCRIPTION OF EMBODIMENTS
`OF THE INVENTION
`
`The present invention includes facilitating non-verbal 25
`communications between users of wireless mobile devices,
`using image messages.
`In the following description, various aspects of the
`present invention will be described. However, it will be
`apparent to those skilled in the art that the present invention
`may be practiced with only some or all aspects of the present
`invention. For purposes of explanation, specific numbers,
`materials and configurations are set forth in order to provide
`a thorough understanding of the present invention. However,
`it will be apparent to one skilled in the art that the present
`invention may be practiced without the specific details. In
`other instances, well-known features are omitted or simpli(cid:173)
`fied in order not to obscure the present invention.
`Parts of the description will be presented in wireless
`mobile telephony terms, such as data, flag, transmit, receive,
`and so forth, consistent with the manner commonly
`employed by those skilled in the art to convey the substance
`of their work to others skilled in the art. As well understood
`by those skilled in the art, these quantities take the form of
`electrical, magnetic, or optical signals capable of being
`stored, transferred, combined, and otherwise manipulated
`through electrical and/or optical components of a processor
`and its subsystems.
`Part of the descriptions will employ various abbrevia(cid:173)
`tions, including but are not limited to:
`
`PST
`SMS
`
`Public Switching Telephony Network
`Short Message Service
`
`Various operations will be described as multiple discrete
`steps in tum, in a manner that is most helpful in understand(cid:173)
`ing the present invention, however, the order of description
`should not be construed as to imply that these operations are
`necessarily order dependent. In particular, these operations
`need not be performed in the order of presentation.
`The phrase "in one embodiment" is used repeatedly. The
`phrase generally does not refer to the same embodiment,
`however, it may. The terms "comprising", "having" and
`"including" are synonymous, unless the context dictates
`otherwise.
`
`US 7,167,703 B2
`
`4
`Exemplary System/Environment
`
`With reference to FIG. 1, an exemplary system in which
`the invention operates includes wireless mobile devices 400
`(hereinafter simply mobile devices), wireless network 110,
`gateway 115, wide area network (WAN)/local area network
`(LAN) 200 and one or more server computers 300.
`Mobile devices 400 are coupled to wireless network 110
`and are described in more detail in conjunction with FIG. 4
`and FIG. 5. Generally, mobile devices 400 include any
`device capable of connecting to a wireless network such as
`wireless network 110. Such mobile devices include cellular
`telephones, smart phones, pagers, radio frequency (RF)
`devices, infrared (IR) devices, citizen band radios (CBs),
`integrated devices combining one or more of the preceding
`devices, and the like. Mobile devices 400 may also include
`other devices that have a wireless interface such as PDAs,
`handheld computers, personal computers, multiprocessor
`systems, microprocessor-based or progrannnable consumer
`20 electronics, network PCs, wearable computers, and the like.
`Wireless network 110 transports information to and from
`mobile devices capable of wireless communication. Wire(cid:173)
`less network 110 may include both wireless and wired
`components. For example, wireless network 110 may
`include wireless cellular sites (not shown) that are coupled
`to another wired telephone network. Typically, a cellular site
`carries communication to and from cellular telephones,
`pagers, and other mobile devices; and the wired telephone
`network carries communication to landline telephones, long-
`30 distance communication links, and the like.
`Wireless network 110 is coupled to WAN/LAN through
`gateway 115. Gateway 115 routes information between
`wireless network 110 and WAN/LAN 200. For example, a
`user using a mobile device may browse the Internet by
`35 calling a certain number or tuning to a particular frequency.
`Upon receipt of the number, wireless network 110 is con(cid:173)
`figured to pass information between the wireless device and
`gateway 115. Gateway 115 translates requests for web pages
`from mobile devices into hypertext transfer protocol (HTTP)
`40 messages, which may then be sent to resources coupled to
`WAN/LAN 200. Gateway 115 may also translate responses
`to such messages into a protocol compatible with the
`requesting mobile device. Additionally, Gateway 115 may
`be used to translate exchanges of other types of messages,
`45 e.g., SMS (short message service) messages, between
`mobile devices 400 that are facilitated by resources (servers)
`coupled to WAN/LAN 200.
`Typically, WAN/LAN 200 transmits information between
`computing devices as described in more detail in conjunc-
`50 tion with FIG. 2. One example of a WAN is the Internet,
`which connects millions of computers over a host of gate(cid:173)
`ways, routers, switches, hubs, and the like. An example of a
`LAN is a network used to connect computers in a single
`office. A WAN may connect multiple LANs. Server com-
`55 puters 300 are coupled to WAN/LAN 200 through commu(cid:173)
`nication mediums. Server computers 300 provide access to
`information and services as described in more detail in
`conjunction with FIG. 3.
`FIG. 2 shows another exemplary system in which the
`60 invention operates in which a number oflocal area networks
`("LANs") 220a-d and wide area network ("WAN") 230
`interconnected by routers 210. Routers 210 are intermediary
`devices on a communications network that expedite message
`delivery. On a single network linking many computers
`65 through a mesh of possible connections, a router receives
`transmitted messages and forwards them to their correct
`destinations over available routes. On an interconnected set
`
`Page 18 of 26
`
`

`

`US 7,167,703 B2
`
`5
`of LANs-including those based on differing architectures
`and protocols-, a router acts as a link between LANs,
`enabling messages to be sent from one to another. Commu(cid:173)
`nication links within LANs typically include twisted wire
`pair, fiber optics, or coaxial cable, while communication
`links between networks may utilize analog telephone lines,
`full or fractional dedicated digital lines including Tl, T2, T3,
`and T4, Integrated Services Digital Networks (ISDNs),
`Digital Subscriber Lines (DSLs ), wireless links, or other
`communications links known to those skilled in the art.
`Furthermore, computers, such as remote computer 240,
`and other related electronic devices can be remotely con(cid:173)
`nected to either LANs 220a-d or WAN 230 via a modem and
`temporary telephone link. The number of WANs, LANS,
`and routers in FIG. 2 may be increased or decreased without 15
`departing from the spirit or scope of this invention. As such,
`it will be appreciated that the Internet itself may be formed
`from a vast number of such interconnected networks, com(cid:173)
`puters, and routers and that an embodiment of the invention
`could be practiced over the Internet without departing from
`the spirit and scope of the invention.
`The media used to transmit information in communication
`links as described above illustrates one type of computer(cid:173)
`readable media, namely communication media. Generally,
`computer-readable media includes any media that can be
`accessed by a computing device. Computer-readable media
`may include computer storage media, communication
`media, or any combination thereof.
`Communication media typically embodies computer(cid:173)
`readable instructions, data structures, program modules, or
`other data in a modulated data signal such as a carrier wave
`or other transport mechanism and includes any information
`delivery media. The term "modulated data signal" means a
`signal that has one or more of its characteristics set or
`changed in such a manner as to encode information in the
`signal. By way of example, communication media includes
`wired media such as twisted pair, coaxial cable, fiber optics,
`wave guides, and other wired media and wireless media such
`as acoustic, RF, infrared, and other wireless media.
`The Internet has recently seen explosive growth by virtue 40
`of its ability to link computers located throughout the world.
`As the Internet has grown, so has the WWW. Generally, the
`WWW is the total set of interlinked hypertext documents
`residing on HTTP (hypertext transport protocol) servers
`around the world. Documents on the WWW, called pages or 45
`Web pages, are typically written in HTML (Hypertext
`Markup Language), or some other markup language, iden(cid:173)
`tified by URLs (Uniform Resource Locators) that specify the
`particular machine and pathname by which a file can be
`accessed, and transmitted from server to end user using 50
`HTTP. Codes, called tags, embedded in an HTML document
`associate particular words and images in the document with
`URLs so that a user can access another file, which may
`literally be halfway around the world, at the press of a key
`or the click of a mouse. These files may contain text (in a 55
`variety of fonts and styles), graphics images, movie files,
`media clips, and sounds as well as Java applets, ActiveX
`controls, or other embedded software programs that execute
`when the user activates them. A user visiting a Web page
`also may be able to download files from an FTP site and send 60
`messages to other users via email by using links on the Web
`page.
`Server computer 300, as described in regard to FIG. 3, is
`a computer connected to a network and having storage
`facilities for storing hypertext documents for a WWW site, 65
`running administrative software (WWW server) for han(cid:173)
`dling requests for the stored hypertext documents and
`
`6
`enabling a facility (image message server) to handle image
`based messages communicated between mobile devices.
`The server computer 300 may include many more compo(cid:173)
`nents than those shown in FIG. 3. However, the components
`shown are sufficient to disclose an illustrative embodiment
`for practicing the present invention.
`As shown in FIG. 3 server computer 300 is connected to
`WAN/LAN 200, or other communications network, via
`network interface unit 310. Network interface unit 310
`10 includes the circuitry for connecting WWW server 330 and
`image message server 336 to WAN/LAN 200, and is con(cid:173)
`structed for use with various communication protocols
`including TCP/IP and WAP. Typically, network interface
`unit 310 is a card contained within server computer 300.
`Server computer 300 also includes processing unit 312,
`video display adapter 314, and a mass memory, all con(cid:173)
`nected via bus 322. The mass memory generally includes
`RAM 316, ROM 332, and one or more permanent mass
`storage devices, such as hard disk drive 328, a tape drive,
`20 CD-ROM/DVD-ROM drive 326, and/or a floppy disk drive.
`The mass memory stores operating system 320 for control(cid:173)
`ling the operation of server computer 300. This component
`may comprise a general purpose server operating system
`such as UNIX, LINUX™, or Microsoft WINDOWS NT®.
`25 Basic input/output system ("BIOS") 318 is also provided for
`controlling the low-level operation of server computer 300.
`The mass memory as described above illustrates another
`type of computer-readable media, namely computer storage
`media. Computer storage media may include volatile and
`30 nonvolatile, removable and non-removable media imple(cid:173)
`mented in any method or technology for storage of infor(cid:173)
`mation, such as computer readable instructions, data struc(cid:173)
`tures, program modules or other data. Examples of computer
`storage media include RAM, ROM, EEPROM, flash
`35 memory or other memory technology, CD-ROM, digital
`versatile disks (DVD) or other optical storage, magnetic
`cassettes, magnetic tape, magnetic disk storage or other
`magnetic storage devices, or any other medium which can be
`used to store the desired information and which can be
`accessed by a computing device.
`The mass memory also stores program code and data for
`providing a WWW site and managing image messages.
`More specifically, the mass memory stores applications
`including WWW server 330 and image message server 336.
`Generally, image message server 336 includes instructions
`for facilitating the communication of image based messages
`communicated between mobile devices. WWW server 330
`includes computer executable instructions which, when
`executed on server computer 300, generate WWW browser
`displays, including performing the logic described else(cid:173)
`where in the specification.
`Server computer 300 also comprises input/output inter-
`face 324 for communicating with external devices, such as
`a mouse, keyboard, scanner, or other input devices not
`shown in FIG. 3. Likewise, server computer 300 may further
`comprise additional mass storage facilities such as CD-
`ROM/DVD-ROM drive 326 and hard disk drive 328. Hard
`disk drive 328 is utilized by server computer 300 to store,
`among other things, applications, databases, and data used
`by WWW server 330 and image message server 336.
`Image message server 336 may include a library or
`database of predetermined images that are organized by
`categories and one or more lists of preselected users desig(cid:173)
`nated to receive selected images. Additionally, image mes(cid:173)
`sage server 336 may incorporate facilities for handling
`image messages that are included in SMS messages and
`wireless protocols, such as WAP.
`
`Page 19 of 26
`
`

`

`US 7,167,703 B2
`
`7
`FIG. 4 shows an exemplary mobile device 400, according
`to one embodiment of the invention. In one embodiment,
`mobile device 400 is a cellular telephone that is arranged to
`send and receive messages. In particular, mobile device 400
`may be arranged to send and receive SMS messages that can
`include data representing an image. Of course, other mes(cid:173)
`saging services that can include data representing an image
`may also be employed with mobile device 400.
`Mobile device 400 may include many more components
`than those shown in FIG. 4. However, the components
`shown are sufficient to disclose an illustrative embodiment
`for practicing the present invention. As shown in the figure,
`mobile device 400 includes processing unit 412, memory
`448, RAM 416, ROM 432, operating system 420, image
`message application 430, programs 434, data storage 436,
`bias 418, power 426, input/output interface 424, wireless
`interface unit 410, illuminator 450, haptic interface 452,
`audio 454, display 456, keypad 458 and infrared input/
`output 460.
`Mobile device 400 may connect to WAN/LAN 200, or
`other communications network, via wireless interface unit
`410. Wireless interface unit 410 includes circuitry for con(cid:173)
`necting mobile device 400 to wireless network 110, and is
`constructed for use with various communication protocols
`including TCP/IP and WAP. Wireless interface unit 410 may
`include a radio layer (not shown) that is arranged to send and
`receive radio frequency communications. Typically, wireless
`interface unit 410 connects mobile device 400 to other
`mobile devices, via a telecommunications carrier or service 30
`provider. Also, wireless interface unit 410 may be arranged
`to communicate with other mobile devices without assis(cid:173)
`tance from a carrier or service provider. For example,
`wireless interface unit 410 may support a wireless protocol
`such as IEEE 802.11 b and the like for communicating
`directly with other mobile devices.
`Mass memory 448 generally includes RAM 416, ROM
`432, and one or more data storage units 436. The mass
`memory stores operating system 420 for controlling the 40
`operation of mobile device 400. It will be appreciated that
`this component may comprise a general purpose operating
`system such as a version of UNIX, LINUX™, or Microsoft
`WINDOWS®. Basic input/output system ("BIOS") 418 is
`also provided for controlling the low-level operation of
`mobile device 400.
`The mass memory as described above illustrates another
`type of computer-readable media, namely computer storage
`media. Computer storage media may include volatile and
`nonvolatile, removable and non-removable media imple(cid:173)
`mented in any method or technology for storage of infor(cid:173)
`mation, such as computer readable instructions, data struc(cid:173)
`tures, program modules or other data. Examples of computer
`storage media include RAM, ROM, EEPROM, flash
`memory or other memory technology, CD-ROM, digital
`versatile disks (DVD) or other optical storage, magnetic
`cassettes, magnetic tape, magnetic disk storage or other
`magnetic storage devices, or any other medium which can be
`used to store the desired information and which can be
`accessed by a computing device.
`The mass memory also stores application code and data
`used by mobile device 400. More specifically, the mass
`memory stores image message application 430, and pro(cid:173)
`grams 434. Image message application 430 may be loaded
`into memory 448 and run under control of operating system 65
`420. Also, programs 434 may include computer execut