`Case 2:22-cv-00263-JRG-RSP Document 87-2 Filed 07/21/23 Page 1 of 20 PagelD #: 5909
`
`EXHIBIT A
`EXHIBIT A
`
`
`
`Case 2:22-cv-00263-JRG-RSP Document 87-2 Filed 07/21/23 Page 2 of 20 PageID #: 5910
`I 1111111111111111 11111 1111111111 11111 11111 1111111111 11111 111111111111111111
`US008213970B2
`
`c12) United States Patent
`Beyer
`
`(IO) Patent No.:
`(45) Date of Patent:
`
`US 8,213,970 B2
`Jul. 3, 2012
`
`(54) METHOD OF UTILIZING FORCED ALERTS
`FOR INTERACTIVE REMOTE
`COMMUNICATIONS
`
`(75)
`
`Inventor: Malcolm K. Beyer, Jupiter Inlet Colony,
`FL (US)
`
`(73) Assignee: Advanced Ground Information
`Systems, Inc., Jupiter, FL (US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 367 days.
`
`(21) Appl. No.: 12/324,122
`
`(22) Filed:
`
`Nov. 26, 2008
`
`(65)
`
`Prior Publication Data
`
`US 2009/0075685 Al
`
`Mar. 19, 2009
`
`(63)
`
`(51)
`
`(52)
`
`(58)
`
`Related U.S. Application Data
`
`Continuation-in-part of application No. 11/612,830,
`filed on Dec. 19, 2006, which is a continuation-in-part
`of application No. 11/308,648, filed on Apr. 17, 2006,
`now
`Pat. No.
`7,630,724, which
`is
`a
`continuation-in-part of application No. 10/711,490,
`filed on Sep. 21, 2004, now Pat. No. 7,031,728.
`
`Int. Cl.
`H04W 4100
`(2009.01)
`U.S. Cl. .... 455/466; 455/88; 455/404.2; 455/412.1;
`455/412.2; 455/414.4; 455/415; 455/416;
`455/418; 455/419; 455/420; 455/456.1; 455/456.3;
`455/457; 455/458; 455/463; 455/500; 455/517;
`455/518; 455/519; 455/556.2; 701/213; 701/482
`Field of Classification Search ................. 455/41.1,
`455/416, 518, 519, 41.3, 88, 404.2, 412.1,
`455/414.4, 415, 418, 419, 420, 456.1, 456.3,
`455/457, 458, 463; 701/213, 482
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`7,031,728 B2
`4/2006 Beyer, Jr.
`2002/0061762 Al*
`5/2002 Maggenti et al. ............. 455/519
`2004/0082352 Al*
`4/2004 Keating et al. ................ 455/519
`2004/0192365 Al*
`9/2004 Dalton et al.
`................. 455/517
`2005/0241026 Al*
`10/2005 Esler et al. ................... D24/100
`2006/0199612 Al
`9/2006 Beyer, Jr. et al.
`2008/0076410 Al
`3/2008 Beyer
`* cited by examiner
`
`Primary Examiner - Nick Corsaro
`Assistant Examiner - Amanuel Lebassi
`(74) Attorney, Agent, or Firm -Malin Haley Dimaggio
`Bowen & Lhota, P.A.
`
`ABSTRACT
`(57)
`The system and method having a specialized software appli(cid:173)
`cation on a personal computer or a PDA/cell phone that that
`enables a participant to force an automatic acknowledgement
`and a manual response to a text or voice message from other
`participants within the same network. Each participant's
`PDA/cell phone includes a force message alert software
`application program for both creating and processing these
`forced message alerts. The system and method enabled by the
`force message alert software application program provides
`the ability to (a) allow an operator to create and transmit a
`forced message alert from a sender PDA/cell phone to one or
`more recipient PCs and PDA/cell phones within the commu(cid:173)
`nication network; (b) automatically transmit an acknowl(cid:173)
`edgement of receipt to the sender PDA cell phone upon the
`receipt of the forced message alert; ( c) periodically resend the
`message to the recipient PCs and PDA/cell phones that have
`not sent an acknowledgement; (d) provide an indication of
`which recipient PCs and PDA/cell phones have acknowl(cid:173)
`edged the forced message alert; ( e) provide a manual response
`list on the display of the recipient PC and PDA/cell phone's
`display that can only be cleared by manually transmitting a
`response; and (f) provide an indication on the sender PDA/
`cell phone of the status and content the manual responses.
`
`13 Claims, 6 Drawing Sheets
`
`
`
`Case 2:22-cv-00263-JRG-RSP Document 87-2 Filed 07/21/23 Page 3 of 20 PageID #: 5911
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 1 of 6
`
`US 8,213,970 B2
`
`I·
`!
`
`l4
`
`Fig 1a
`
`
`
`Case 2:22-cv-00263-JRG-RSP Document 87-2 Filed 07/21/23 Page 4 of 20 PageID #: 5912
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 2 of 6
`
`US 8,213,970 B2
`
`PROVIDE EACH ACS NETWORK PARTICIPANT WITH A
`CELL PHONE/ PDA / GPS WITH TOUCH SCREEN DISPLAY
`i
`PROVIDE A MAP FOR GEOGRAPHICAL DISPLAY IN EACH
`PHONE
`t
`PROVIDE A DATABASE OF FIXED SITES AND THEIR
`LATITUDE- LONGTITUDE AND THEIR PHONE NUMBERS
`i
`PROVIDE A SYMBOL GENERATOR THAT CREATES A
`DISPLAY SYMBOL AT THE CORRECT LOCATION
`REPRESENTING AN ACS NETWORK PARTICIPANT OR ONE
`OF THE FIXED LOCATIONS ON THE GEOGRAPHICAL
`DISPLAY
`i
`CONTROL THE ACS DISPLAY THROUGH THE USE OF
`LAYERED SOFT SWITCHES
`i
`PROVIDE ACS THAT CAUSES THE EXCHANGE OF
`IDENTITY, LOCATION AND STATUS DATA BETWEEN THE
`PARTICIPANTS AND THE EXCHANGE OF FREE TEXT,
`PREFORMATTED TEXT MESSAGES, PHOTOGRAPHS AND
`VIDEOS
`i
`PROVIDE ACS THAT AUTOMATICALLY INITIATES A CALL
`TO A PARTICIPANT BY TOUCHING THE PARTICIPANT'S
`SYMBOL ON THE DISPLAY AND SELECTING THE CALL
`SWITCH
`i
`PROVIDE ACS THAT PERFORMS THE FUNCTJON OF
`REMOTELY CALLING ANOTHER PARTICIPANT'S CELL
`PHONE
`
`i
`SEND A MESSAGE TO THE REMOTE PHONE'S ACS THAT
`CAUSES IT TO CALL ANOTHER PHONE NUMBER OR
`PERFORM OTHER FUNCTIONS
`
`Fig 1b
`
`SET UP
`CONFERENCES
`1.....-. BY SELECTING A
`PLURALITY OF
`SYMBOLS
`
`
`
`Case 2:22-cv-00263-JRG-RSP Document 87-2 Filed 07/21/23 Page 5 of 20 PageID #: 5913
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 3 of 6
`
`US 8,213,970 B2
`
`Fig. 2
`
`START
`i
`The Forced Messaging Alert Software is installed on a plurality
`of cell phones, integrated PDA/cell phones and PCs, creating a
`communication network
`
`One or more default response lists for the communication
`network are created
`
`The contact and identifying information for each cell phone,
`integrated PDA/cell phone and PC that is a member of the
`communication network and the default response list(s) are
`loaded on to every member cell phone, integrated PDA/cell
`phone and PC. A list is kept of each integrated PDA/cell phone
`and PC as they sign on the communications network.
`
`'
`END
`
`
`
`Case 2:22-cv-00263-JRG-RSP Document 87-2 Filed 07/21/23 Page 6 of 20 PageID #: 5914
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 4 of 6
`
`US 8,213,970 B2
`
`Fig. 3A
`
`[ START
`
`The sender selects the forced messaging alert application
`software on a sender cell phone, integrated PDA/cell phone or
`PC and is prompted by said sender cell phone, integrated
`PDA/cell phone or PC to type the text message or record the
`voice message
`
`The sender types a text message or records a voice message
`on said sender cell phone, integrated PDA/cell phone or PC
`and is then prompted by said sender cell phone, integrated
`PDA/cell phone or PC to select if the message is to be sent
`to: a. a single user, b. all users participating in the network or
`c. a list of users.
`
`The sender then selects the default response list or creates a
`new response list that is sent with the text message or voice
`recording
`
`The sender designates instructs said sender cell phone,
`integrated PDA/cell phone or PC to transmit the message
`
`The forced message alert is transmitted to every designated
`recipient cell phone, integrated PDA/cell phone and PC
`
`GOTO
`FIG. 38
`
`
`
`Case 2:22-cv-00263-JRG-RSP Document 87-2 Filed 07/21/23 Page 7 of 20 PageID #: 5915
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 5 of 6
`
`US 8,213,970 B2
`
`Fig. 3B
`
`FROM FIG. 3A
`
`The sender cell phone, integrated PDA/cell phone or PC
`receives and monitors for acknowledgments of receipt from
`recipient cell phones, integrated PDA/cell phones and PCs and
`displays an indication of which recipient cell phones, integrated
`PDA/cell phones and PCs have acknowledged receipt of the
`message alert
`
`The sender cell phone, integrated PDA/cell phone or PC
`periodically resends the message alert to the recipient cell
`phones, integrated PDA/cell phones or PCs that have not
`acknowledged receipt.
`
`The sender cell phone, integrated PDA/cell phone or PC monitors
`for and receives responses to the message alert from the
`recipient cell phones, integrated PDA/cell phones and PCs and
`displays an indication of the response from each recipient cell
`phone, integrated PDA/cell phone and PC.
`
`END
`
`
`
`Case 2:22-cv-00263-JRG-RSP Document 87-2 Filed 07/21/23 Page 8 of 20 PageID #: 5916
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 6 of 6
`
`US 8,213,970 B2
`
`Fig. 4
`
`START
`
`l
`
`The forced alert message is received by the recipient cell phone,
`integrated PDA/cell phone or PC. In response to receipt of the
`forced alert message, the recipient phone software prepares and
`sends an automatic acknowledgement of the receipt to the
`sender cell phone, integrated PDA/cell phone or PC
`i
`After the acknowledgement of receipt is sent, the forced voice
`alert software takes control of the recipient's cell phone,
`integrated PDA/cell phone or PC and causes the text message
`to be displayed or the voice message to be periodically repeated
`and a list of responses to be shown on the display of the
`recipient cell phone inteqrated PDA/cell phone or PC PDA/cell
`i
`The recipient selects a response from the response list and the
`recipient cell phone and transmits the response to the senders
`cell phone.
`
`The forced message alert software releases control of the
`recipient cell phone, integrated PDA/cell phone or PC and
`clears the display or stops repeating the voice message
`
`END
`
`
`
`Case 2:22-cv-00263-JRG-RSP Document 87-2 Filed 07/21/23 Page 9 of 20 PageID #: 5917
`
`US 8,213,970 B2
`
`2
`SUMMARY OF THE INVENTION
`
`1
`METHOD OF UTILIZING FORCED ALERTS
`FOR INTERACTIVE REMOTE
`COMMUNICATIONS
`
`This application is a continuation-in-part of U.S. patent
`application Ser. No. 11/612,830 filed on Dec. 19, 2006 which
`is a continuation-in-part of U.S. patent application Ser. No.
`11/308,648 filedApr. 17, 2006 which is a continuation-in-part
`of U.S. patent application Ser. No. 10/711,490 now U.S. Pat.
`No. 7,031,728.
`
`BACKGROUND OF THE INVENTION
`
`Applicant's communication system and method described
`herein is embodied in the forced alert software developed by
`5 applicant and installed in the PCs and PDA/cell phones used
`herein.
`A plurality of PCs and PDA/cell phones each having forced
`alert software installed providing a communication network
`of PCs and PDA/cell phones with the ability to: a) allow an
`10 operator to create and transmit (via TCP/IP or another digital
`transmission means) a forced voice alert, wherein said forced
`voice alert is comprised of a text or voice message file and a
`forced alert software packet, from a sender PC or PDA/cell
`15 phone to one or more recipient PCs and PDA/cell phones
`within said communication network; (b) automatically trans(cid:173)
`mit an acknowledgement of receipt from said recipient PCs
`and PDA/cell phones to the sender PCs or PDA/cell phones
`upon receipt of the forced message alert by the recipient PCs
`20 and PDA/cell phones; ( c) periodically resend the message to
`the recipient PCs and PDA/cell phones that have not sent an
`acknowledgement until an acknowledgement is received
`from every recipient PC and PDA/cell phone; (d) provide an
`indication on the display of the sender PC or PD A/cell phone
`25 of which recipient PCs and PDA/cell phones have acknowl(cid:173)
`edged the forced message alert; ( e) provide a manual response
`list on the display of the recipient PC and PDA/cell phone's
`display that can only be cleared by manually selecting and
`transmitting a response from the list or recording and trans-
`30 mitting a voice response after sending said automatic
`acknowledgment; and (f) provide an indication on the sender
`PC or PDA/cell phone of the status the manual response and
`the content of the manual response from each recipient PCs
`35 and PDA/cell phones.
`A communication network server can act as a forwarder for
`TCP/IP communications between any combination of PC
`users or PDA/cell phone users. The server can also act as a
`forwarder of data addressed from one participant to one or
`40 more addressed participants, thus permitting the transmission
`of forced text or voice messages, other messages, photo(cid:173)
`graphs, video, E-mail and URL data from one network par(cid:173)
`ticipant to other selected network participants.
`The above functions can also be accomplished using WiFi,
`45 WiMax or other peer to peer communications. However, for
`use with cellular communications and to assure the level of
`security that cell phone companies require, a centralized
`static IP mutable server is used.
`It is the object of this invention provide to a method in
`50 which by sending a forced text or voice message to a recipient
`or a group of recipients, a sender can compel an automatic
`acknowledgement of receipt from each recipient's PC or
`PDA/cell phone and require a manual response from the
`recipient via the recipient's cell phone before the message can
`55 be cleared.
`In accordance with these and other objects which will
`become apparent hereinafter, the instant invention will now
`be described with particular reference to the accompanying
`drawings.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. la shows a front elevational view of an integrated
`PDA/cell phone having a touch screen that includes forced
`65 message alert software described herein.
`FIG. lb shows a flow chart that explains the device shown
`in FIG. la.
`
`1. Field of the Invention
`A communications system and method that uses a plurality
`of PCs and PD A/cell phones for the coordination of two or
`more people through the use of a communications network.
`The system and method provide each user with a PC or
`PDA/cell phone that has forced message alert software that
`enables a user to create and send a voice or text message alert
`that forces an automatic acknowledgement upon receipt and a
`manual response from the recipient.
`2. Description of Related Art
`The purpose of a communications system is to transmit
`information bearing digital messages from a source, located
`at one point, to a user destination, located at another point
`some distance away. A communications system is generally
`comprised of three basic elements: transmitter, information
`channel and receiver. One form of communication in recent
`years is cellular phone telephony. A network of cellular com(cid:173)
`munication systems set up around an area such as the United
`States allows multiple users to talk to each other, either on
`individual calls or on group calls, with handheld devices.
`Some cellular phone services enable a cellular phone to
`engage in conference calls with a small number of users.
`Furthermore, cellular conference calls can be established
`through 800 number services. Cellular telephony also now
`includes the ability to access local WiFi connections, allow(cid:173)
`ing the devices to utilize cellular phone data transmission
`technology as well as the data transmission ability of the
`Internet.
`The method and operation of the integrated PDA/cell
`phones ( cell phone/PDA/GPS with touch screen) used herein
`is described in U.S. Pat. No. 7,031,728, which is hereby
`incorporated by reference, pending U.S. patent application
`Ser. No. 11/308,648, and pending U.S. patent application Ser.
`No. 11/612,830, and are usually discussed herein as a cell
`phone.
`In many situations it is desirable for a user to be able to
`simultaneously send a message to the cell phones or PCs of a
`large group of people. This can be typically accomplished
`using Digital SMS (Smart Message Service) and TCP/IP
`messages that are transmitted using cellular technology such
`as the various versions of GSM and CDMA or via a WiFi local
`area network. However, in some situations it is additionally
`desirable to know: (a) which people received the message on
`their cell phone or PC, (b) which people did not receive the
`message on their cell phone or PC, and ( c) the response of 60
`each person receiving the message. Digital SMS and TCP/IP
`messages do not provide each of those functions. As a result,
`what is needed is a method in which a sender of a text or voice
`message can force an automatic acknowledgement upon
`receipt from a recipient's cell phone or PC and a manual
`response from the recipient via the recipient's cell phone or
`PC when sending the text or voice message.
`
`
`
`Case 2:22-cv-00263-JRG-RSP Document 87-2 Filed 07/21/23 Page 10 of 20 PageID #:
`5918
`
`US 8,213,970 B2
`
`3
`FIG. 2 shows the installation and set up of the forced
`message alert software on a communication network of cell
`phones, integrated PDA/cell phones, and PCs.
`FIG. 3A shows the first section of a flow chart showing a
`process of sending a forced message alert to one or more 5
`recipients as well as for ascertaining which rec1p1ents
`received the forced message alert and which recipients
`responded to the forced message alert.
`FIG. 3B shows the second section of a flow chart showing
`a process of sending a forced message alert to one or more
`recipients as well as for ascertaining which recipients
`received the forced message alert and which recipients
`responded to the forced message alert.
`FIG. 4 shows a flow chart showing a process ofreceiving a 15
`forced message alert as well as providing an acknowledgment
`ofreceipt and a response by the recipient.
`
`PREFERRED EMBODIMENT OF THE
`INVENTION
`
`4
`The server also acts as a forwarder of data addressed from
`one participant to one or more addressed participants, thus
`permitting the transmission of forced message alerts, other
`text and voice messages, photographs, video, E-mail and
`URL data from one network participant to other selected
`network participants.
`The above functions can also be accomplished using WiFi,
`WiMax, or other peer to peer communications. However, for
`use with cellular communications and to assure the level of
`10 security that cell phone companies require, a centralized
`static IP mutable server is used.
`Referring now to the drawings and, in particular, FIGS. la
`and lb, a small handheld cellular phone 10 is shown that
`includes a PDA integrated in housing 12 that includes an
`on/off power switch 19, a microphone 38, and an LCD dis(cid:173)
`play 16 that is also a touch screen system. The small area 16a
`is the navigation bar that depicts the telephone, GPS and other
`status data and the active software. Each cell phone includes
`a CPU and databases that store information useful in the
`20 communication network. With the touch screen 16, data can
`be entered through the operator using a stylus 14 ( or operator
`finger) by manipulatively directing the stylus 14 to literally
`touch display 16. Soft switches 16d displayed on the display
`16 are likewise activated by using a stylus 14 and physically
`25 and manipulatively directing the stylus to literally touch dis(cid:173)
`play 16. The display x, y coordinates of the touched point are
`known by a CPU in the PDA section of the communication
`system in housing 12 that can coordinate various information
`contained in the PDA relative to the x, y coordinate position
`30 on the display 16. Inside housing 12 is contained the conven(cid:173)
`tional cellular phone elements including a modem, a CPU for
`use with a PDA and associated circuitry connected to speaker
`24 and microphone 38. Conventional PDA/cellular phones
`are currently on sale and sold as a unit that can be used for
`35 cellular telephone calls and sending cellular SMS and TCP/IP
`or other messages using the PDA's display 16 and CPU. The
`device 10 includes a pair of cellular phone hardware activat(cid:173)
`ing buttons 20 to tum the cellular phone on and 22 to turn the
`cellular phone off. Navigation pad actuator 18 is similar to a
`40 joy or force stick in that the actuator 18 manually provides
`movement commands that can be used by the PDA' s software
`to move a cursor on display 16. Switches 26 and 28 are
`designed to quickly select an operator specified network soft(cid:173)
`ware program. Speaker 24 and microphone 38 are used for
`45 audio messages. Switch 19 at the top left of device 10 is the
`power on and power off switch for the entire device.
`The heart of the invention lies in the forced message alert
`software application program provided in each PC or PDA/
`cell phone. The forced message alert software application
`50 program is activated through use of a screen drawn soft switch
`or by clicking on an icon on the PC or PD A/cell phone display
`screen or when a forced message alert transmission is
`received by another PC or PDA/cell phone. The display 16 is
`mounted within the housing 12 as part of the PDA and the
`55 CPU (not shown). The internal CPU includes databases and
`software application programs that provide for a geographi(cid:173)
`cal map and georeferenced entities that are shown as display
`portion 16b that includes as part of the display various areas
`of interest in the particular local map section.
`When looking at display 16, the software switches (soft
`switches) which appear at the very bottom of the display 16d
`are used to control by touch many of the software driven
`functions of the PDA/cell phone. The soft switches are acti(cid:173)
`vated through the operator's use of the navigation pad 18, or
`65 a small track ball, force stick or similar hardware display
`cursor pointing device. Alternatively, the operator may
`choose to activate the software switches by touching the
`
`A communication system and method that joins partici(cid:173)
`pants in a communications network using personal computers
`("PC") and handheld cell phones having integrated personal
`digital assistant ("PDA/cell phone") with a forced message
`alert software application program that allows a participant to
`send a text or voice message to a group of people and force an
`automatic acknowledgment of receipt and a manual response.
`Each PDA/cell phone described herein for the participant
`network has its own individual on/off power and can function
`just as any other cell phone. It can also function with its PDA.
`To operate on the network, obviously the PDA/cell phone
`power switch has to be on. If the PDA/cell phone is com(cid:173)
`pletely turned off, then it is not part of the participating
`network and cannot send or receive any forced message
`alerts. In addition to its own on and off power switch, it has the
`forced message alert software application program that is
`activated manually when preparing to send a text or voice
`message or is activated automatically when receiving a forced
`message alert from another PC or PDA/cell phone.
`Each PC described herein is like any other contemporary
`PC, except that it has the forced message alert software appli(cid:173)
`cation program installed on it. To operate on the network,
`obviously the PC must be on and have an active connection to
`the Internet or other digital transmission means. If the PC is
`completely turned off, then it is not part of the participating
`network and cannot send or receive any forced message
`alerts. The forced message alert software application program
`on the PC is activated manually when preparing to send a text
`or voice message or is activated automatically when receiving
`a forced message alert from another PC or PDA/cell phone.
`The communication system also includes a server that acts
`as a forwarder for IP communications between any combina(cid:173)
`tion of PD A/cell phone users and/or PC based users. Network
`participant location, identity and status messages are sent to
`the server by each user. The users are the network partici(cid:173)
`pants. Network participant entered tracks are also sent to the
`server. Because this data is of interest to all the network
`participants, the server forwards the data received from one
`participant to all other participants, thus providing the infor- 60
`mation necessary for all network participants to know the
`identity, location and status of all other network participants.
`In addition, the server keeps all of the network participants
`updated on information kept in its databases, such as all of the
`participants' telephone numbers, E-mail addresses and other
`information necessary to carry on the communications
`described herein.
`
`
`
`Case 2:22-cv-00263-JRG-RSP Document 87-2 Filed 07/21/23 Page 11 of 20 PageID #:
`5919
`
`US 8,213,970 B2
`
`5
`
`5
`screen with a stylus 14 (or finger) at the switches' 16d loca(cid:173)
`tions. When some of the software switches are activated,
`different software switches appear. The bar display 16d
`shows the software switches "ZM IN (zoom in)," "ZM OT
`(zoom out)," "CENT ( center)" and "GRAB (pan/grab)" at the
`bottom of the screen. These software switches enable the
`operator to perform these functions. The "SWITH (switch)"
`software switch at the lower right causes a matrix oflayered
`software switches (soft switches) to appear above the bottom
`row of switches. Through use of the software switches, the
`operator can also manipulate the geographical map 16b or
`chart display. When looking at FIG. la, display symbols
`depict permanent geographical locations and buildings are
`shown. For example, the police station is shown and, when the
`symbol is touched by the stylus or finger, the latitude and
`longitude of the symbol's location, as shown in display sec(cid:173)
`tion 16c, is displayed at the bottom left of the screen. The
`bottom right side of display 16c is a multifunction inset area
`that can contain a variety of information including: a) a list of
`the communication link participants; b) a list of received
`messages; a) a map, aerial photograph or satellite image with
`an indication of the zoom and offset location of the main map
`display, which is indicated by a square that depicts the area
`actually displayed in the main geographical screen 16b; d)
`applicable status information; and e) a list of the communi(cid:173)
`cation net participants. Each participant user would have a
`device 10 shown in FIGS. la and lb.
`Also shown on the display screen 16, specifically the geo(cid:173)
`graphical display 16b, is a pair of different looking symbols
`30 and 34, a small triangle and a small square, which are not
`labeled. These symbols 30 and 34 can represent communica(cid:173)
`tion net participants having cellular phones in the displayed
`geographical area that are part of the overall cellular phone
`communications net, each participant having the same device
`10 used. The latitude and longitude of symbol 30 is associated 35
`within a database with a specific cell phone number and, if
`available, its IP address and E-mail address. The screen dis(cid:173)
`play 16b, which is a touch screen, provides x and y coordi(cid:173)
`nates of the screen 16b to the CPU's software from a map in
`a geographical database. The software has an algorithm that 40
`relates the x and y coordinates to latitude and longitude and
`can access a communications net participant's symbol or a
`fixed or movable entity's symbol as being the one closest to
`that point.
`In order to initiate a telephone call to the PDA/cell phone 45
`user ( communication net participant) represented by symbol
`(triangle) 30 at a specific latitude and longitude displayed on
`chart 16b, the operator touches the triangle 30 symbol with
`the stylus 14. The operator then touches a "call" software
`switch from a matrix of displayed soft switches that would 50
`overlay the display area 16c. Immediately, the PDA/cell
`phone will initiate a cellular telephone call to the PDA/cell
`phone user at the geographical location shown that represents
`symbol 30. A second PDA/cell phone user (communication
`net participant) is represented by symbol 34 which is a small 55
`square (but could be any shape or icon) to represent an indi(cid:173)
`vidual cellular phone device in the display area. The ring 32
`around symbol 30 indicates that the symbol 30 has been
`touched and that a telephone call can be initiated by touching
`the soft switch that says "call." When this is done, the tele- 60
`phone call is initiated. Other types of symbolic elements on
`the display 16 can indicate that a cellular phone call is in
`effect. Additionally, the operator can touch both symbol 34
`and symbol 30 and can activate a conference call between the
`two cellular phones and users represented by symbols 30 and 65
`34. Again, a symbolic ring around symbol 34 indicates that a
`call has been initiated.
`
`6
`Equally important, an operator/user with a PD A/cell phone
`call the police station or any other specific geographical facil(cid:173)
`ity displayed on the cell display map, including: buildings,
`locations of people, vehicles, facilities, restaurants, and the
`like, whose PD A/cell phone numbers and, if available, E-nail
`addresses, IP addresses and their URLs are previously stored
`in the database, by touching a specific facility location on the
`map display using the stylus 14 and then touching the cellular
`phone call switch. As an example, the operator/user can touch
`10 and point to call a restaurant using a soft switch by touching
`the restaurant location on the display with a stylus and then
`touching the call soft switch. The cellular phone will then call
`the restaurant. Thus, using the present invention, each partici(cid:173)
`pant can touch and point to call to one or more other net
`15 participants symbolically displayed on the map, each of
`whom has a device as shown in FIG. la and can also point to
`call facilities and regular phone numbers that had been pre(cid:173)
`viously stored in the phone's database. Furthermore, this
`symbol hooking and soft switch technique can be used to go
`20 to a fixed facility's website or to automatically enter the fixed
`facility's E-mail address in an e-mail.
`Each PDA/cell phone user device is identified on the map
`display of the other participants users' phone devices by a
`display symbol that is generated on each user phone display to
`25 indicate each user's identity. Each symbol is placed at the
`correct geographical location on the user display and is cor(cid:173)
`related with the map on the display. The operator of each
`PDA/ cell phone device may also enter one or more other fixed
`entities (buildings, facilities, restaurants, police stations, etc.)
`30 and geo-referenced events such as fires, accidents, or other
`events into its database. This information can be likewise
`transmitted to all the other participants on the communica(cid:173)
`tions net. The map, fixed entities, events and PDA/cell phone
`device communication net participants' latitude and longi(cid:173)
`tude information is related to the "x" and "y" location on the
`touch screen display map by a mathematical correlation algo(cid:173)
`rithm.
`When the PDA/cell phone device user uses a stylus or
`finger to touch one or more of the symbols or a location
`displayed on the cellular phone map display, the system's
`software causes the status and latitude and longitude infor(cid:173)
`mation concerning that symbol or location to be displayed. In
`order to hook a symbol or "track" such as another net partici(cid:173)
`pant which represents an entity on the geo-referenced map
`display, or a fixed geographical entity such as a restaurant,
`police station or a new entity observed by a cell phone user
`which is discussed below, the operator points at or near the
`location of a geo-referenced symbol appearing on the PDA/
`cell phone display that represents a specific track or specific
`participant or other entity. The hook application software
`determines that the stylus is pointed close to or at the location
`of the symbol and puts a circle, square or other indication
`around the symbol indicating that amplification information
`concerning the symbol is to be displayed and indicating that
`additional data or change in data can be made to the indicated
`symbol. The hook application code then sends a message to
`the display application code to display the net participant,
`facility or entity's amplifying data. The display application
`code retrieves the primary data and amplification data con(cid:173)
`cerning the symbol or entity from the database and displays
`the information at the correct screen location. The operator
`can then read the amplification data that relates to that specific
`symbol at the specific location. The PD A/cell phone operator
`can also select soft switches on the touch screen display to
`change the primary data and amplification data. Furthermore,
`the operator can use a similar method of hooking and select(cid:173)
`ing to activate particular soft switches to take other actions
`
`
`
`Case 2:22-cv-00263-JRG-RSP Document 87-2 Filed 07/21/23 P