Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 1 of 20 PageID #: 365
`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 1 of 20 PagelD #: 365
`
`
`
`
`EXHIBIT A
`EXHIBIT A
`
`
`
`
`
`

`

`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 2 of 20 PageID #: 366
`Case 2:22-cv-00185-JRG Document otLRATSUTTTTF°*
`
`US008213970B2
`
`a2) United States Patent
`US 8,213,970 B2
`(10) Patent No.:
`
`(45) Date of Patent: Jul. 3, 2012
`Beyer
`
`(54)
`
`METHOD OF UTILIZING FORCED ALERTS
`FOR INTERACTIVE REMOTE
`COMMUNICATIONS
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`(75)
`
`Inventor: Malcolm K.Beyer, Jupiter Inlet Colony,
`FL (US)
`
`(73)
`
`Assignee:
`
`Advanced Ground Information
`
`Systems, Inc., Jupiter, FL (US)
`
`(*)
`
`Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 367 days.
`
`(21)
`
`Appl. No.: 12/324,122
`
`(22)
`
`Filed:
`
`Nov. 26, 2008
`
`(65)
`
`(63)
`
`(51)
`
`(52)
`
`(58)
`
`Prior Publication Data
`
`US 2009/0075685 Al
`
`Mar. 19, 2009
`
`Related U.S. Application Data
`
`Continuation-in-part of application No. 11/612,830,
`filed on Dec. 19, 2006, which is a continuation-in-part
`of application No. 11/308,648, filed on Apr. 17, 2006,
`now
`Pat.
`No.
`7,630,724,
`which
`is
`a
`continuation-in-part of application No. 10/711,490,
`filed on Sep. 21, 2004, now Pat. No. 7,031,728.
`
`Int. Cl.
`
`(2009.01)
`HOAW 4/00
`US. Cl.
`.... 455/466; 455/88; 455/404.2; 455/412.1;
`455/412.2; 455/414.4; 455/415; 455/416;
`455/418; 455/419; 455/420; 455/456.1; 455/456.3;
`455/457; 455/458; 455/463; 455/500; 455/517;
`455/518; 455/519; 455/556.2; 701/213; 701/482
`Field of Classification Search.
`................. 455/41.1,
`455/416, 518, 519, 41.3, 88, 404.2, 412.1,
`455/414.4, 415, 418, 419, 420, 456.1, 456.3,
`455/457, 458, 463; 701/213, 482
`
`7,031,728 B2
`4/2006 Beyer, Jr.
`2002/0061762 Al*
`5/2002 Maggenti etal. 0.0.0... 455/519
`2004/0082352 Al*
`4/2004 Keatingetal. ......
`. 455/519
`
`2004/0192365 Al*
`...
`. 455/517
`9/2004 Daltonetal.
`2005/0241026 Al* 10/2005 Esleretal. ou, D24/100
`2006/0199612 Al
`9/2006 Beyer,Jr. etal.
`2008/0076410 Al
`3/2008 Beyer
`* cited by examiner
`
`Primary Examiner — Nick Corsaro
`Assistant Examiner — Amanuel Lebassi
`
`(74) Attorney, Agent, or Firm — Malin Haley Dimaggio
`Bowen & Lhota, P.A.
`
`ABSTRACT
`(57)
`The system and method having a specialized software appli-
`cation on a personal computer or a PDA/cell phonethat that
`enablesa participant to force an automatic acknowledgement
`and a manualresponseto a text or voice message from other
`participants within the same network. Each participant’s
`PDA/cell phone includes a force message alert software
`application program for both creating and processing these
`forced messagealerts. The system and method enabled by the
`force message alert software application program provides
`the ability to (a) allow an operator to create and transmit a
`forced messagealert from a sender PDA/cell phone to one or
`more recipient PCs and PDA/cell phones within the commu-
`nication network; (b) automatically transmit an acknowl-
`edgementof receipt to the sender PDA cell phone upon the
`receipt ofthe forced messagealert; (c) periodically resend the
`messageto the recipient PCs and PDA/cell phones that have
`not sent an acknowledgement; (d) provide an indication of
`which recipient PCs and PDA/cell phones have acknow]-
`edgedthe forced messagealert; (e) provide a manual response
`list on the display of the recipient PC and PDA/cell phone’s
`display that can only be cleared by manually transmitting a
`response; and (f) provide an indication on the sender PDA/
`cell phone of the status and content the manual responses.
`
`13 Claims, 6 Drawing Sheets
`
`See application file for complete search history.
`
`

`

`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 3 of 20 PageID #: 367
`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 3 of 20 PagelD #: 367
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 1 of 6
`
`US 8,213,970 B2
`
`
`
`

`

`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 4 of 20 PageID #: 368
`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 4 of 20 PagelD #: 368
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 2 of 6
`
`US 8,213,970 B2
`
`PROVIDE EACH ACS NETWORK PARTICIPANT WITH A
`CELL PHONE / PDA / GPS WITH TOUCH SCREEN DISPLAY
`
`PROVIDE A MAP FOR GEOGRAPHICAL DISPLAY IN EACH
`PHONE
`
`
`
`
`
`
`
`
`PROVIDE A DATABASE OF FIXED SITES AND THEIR
`LATITUDE — LONGTITUDE AND THEIR PRONE NUMBERS
`
`PROVIDE A SYMBOL GENERATOR THAT CREATES A
`DISPLAY SYMBOL AT THE CORRECT LOCATION
`REPRESENTING AN ACS NETWORK PARTICIPANT OR ONE
`OF THE FIXED LOCATIONS ON THE GEOGRAPHICAL
`DISPLAY
`
`
`CONTROL THE ACS DISPLAY THROUGH THE USE OF
`LAYERED SOFT SWITCHES
`!
`PROVIDE ACS THAT CAUSES THE EXCHANGE OF
`IDENTITY, LOCATION AND STATUS DATA BETWEEN THE
`PARTICIPANTS AND THE EXCHANGE OF FREE TEXT,
`PREFORMATTED TEXT MESSAGES, PHOTOGRAPHS AND
`VIDEOS
`
`
`
` SET UP
`
`
`
`CONFERENCES
`PROVIDE ACS THAT AUTOMATICALLY INITIATES A CALL
`
`
`TO A PARTICIPANT BY TOUCHING THE PARTICIPANT’S
`BY SELECTING A
`PLURALITY OF
`SYMBOL ON THE DISPLAY AND SELECTING THE CALL
`
`SYMBOLS
`SWITCH
`
`
` *
`
`PROVIDE ACS THAT PERFORMS THE FUNCTION OF
`REMOTELY CALLING ANOTHER PARTICIPANT'S CELL
`PHONE
`
`
`
`
`
`SEND A MESSAGE TO THE REMOTE PHONE’S ACS THAT
`CAUSES IT TO CALL ANOTHER PHONE NUMBER OR
`
`PERFORM OTHER FUNCTIONS
`
`

`

`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 5 of 20 PageID #: 369
`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 5 of 20 PagelD #: 369
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 3 of 6
`
`US 8,213,970 B2
`
`
`
`
`
`The Forced Messaging Alert Softwareis installed on a plurality
`
`
`of cell phones, integrated PDA/cell phones and PCs, creating a
`communication network
`
`One or more default responselists for the communication
`network are created
`
`
`
`The contact and identifying information for each cell phone,
`integrated PDA/cell phone and PC that is a member of the
`communication network and the default responselist(s) are
`loaded on to every membercell phone, integrated PDA/cell
`phone and PC. A list is kept of each integrated PDA/cell phone
`and PC asthey sign on the communications network.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 6 of 20 PageID #: 370
`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 6 of 20 PagelD #: 370
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 4 of 6
`
`US 8,213,970 B2
`
`Fig. 3A
`
`|
`
`START
`
`The senderselects the forced messaging alert application
`software on a sendercell phone, integrated PDA/cell phone or
`PC and is prompted by said sendercell phone, integrated
`PDA/cell phone or PC to type the text message orrecord the
`voice message
`
`The sender types a text messageor records a voice message
`on said sendercell phone, integrated PDA/cell phone or PC
`and is then prompted by said sender cell phone, integrated
`PDA/cell phone or PC to selectif the message is to be sent
`to: a. a single user, b. all users participating in the network or
`
`c. a list of users.
`
`
`
`The sender then selects the default response list or creates a
`new responselist that is sent with the text message or voice
`recording
`
`The sender designates instructs said sender cell phone,
`integrated PDA/cell phone or PC to transmit the message
`
`The forced message alert is transmitted to every designated
`recipient cell phone, integrated PDA/cell phone and PC
`
`

`

`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 7 of 20 PageID #: 371
`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 7 of 20 PagelD #: 371
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 5 of 6
`
`US 8,213,970 B2
`
`FROM FIG. 3A
`
`
`
`
`
`
`
`
`The sendercell phone, integrated PDA/cell phone or PC
`receives and monitors for acknowledgmentsof receipt from
`
`
`recipient cell phones, integrated PDA/cell phones and PCs and
`
`
`displays an indication of which recipient cell phones, integrated
`
`
`PDA/cell phones and PCs have acknowledged receipt of the
`
`
`message alert
`
`
`
`
`
`
`The sendercell phone, integrated PDA/cell phone or PC
`periodically resends the messagealert to the recipient cell
`
`
`phones, integrated PDA/cell phones or PCsthat have not
`
`acknowledgedreceipt.
`
`
`
`
`
`The sendercell phone, integrated PDA/cell phone or PC monitors
`for and receives responses to the message alert from the
`recipient cell phones, integrated PDA/cell phones and PCs and
`
`
`displays an indication of the response from each recipient cell
`phone, integrated PDA/cell phone and PC.
`
`
`END
`
`

`

`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 8 of 20 PageID #: 372
`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 8 of 20 PagelD #: 372
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 6 of 6
`
`US 8,213,970 B2
`
`
`
`
`
`
`The forced alert message is received by the recipient cell phone,
`integrated PDA/cell phone or PC. In responseto receipt of the
`
`forced alert message, the recipient phone software prepares and
`
`
`sends an automatic acknowledgementof the receipt to the
`sender cell phone, integrated PDA/cell phone or PC
`
`
`
`
`
`
`
`
`
`
`
`After the acknowledgementof receipt is sent, the forced voice
`alert software takes control of the recipient’s cell phone,
`integrated PDA/cell phone or PC and causes the text message
`to be displayed or the voice message to be periodically repeated
`andalist of responses to be shown onthe display of the
`recipient cell phone inteqrated PDA/cell phone or PC PDA/cell
`
`
`
`
`
`
`
`
`
`The recipient selects a response from the responselist and the |
`recipient cell phone and transmits the responseto the senders
`
` cell phone.
`
`The forced message alert software releases control of the
`recipient cell phone, integrated PDA/cell phone or PC and
`clears the display or stops repeating the voice message
`
`
`

`

`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 9 of 20 PageID #: 373
`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 9 of 20 PagelD #: 373
`
`US 8,213,970 B2
`
`1
`METHOD OF UTILIZING FORCED ALERTS
`FOR INTERACTIVE REMOTE
`COMMUNICATIONS
`
`This application is a continuation-in-part of U.S. patent
`application Ser. No. 11/612,830 filed on Dec. 19, 2006 which
`is a continuation-in-part of U.S. patent application Ser. No.
`11/308,648 filedApr. 17, 2006 which is a continuation-in-part
`of US. patent application Ser. No. 10/711,490 now U.S. Pat.
`No. 7,031,728.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`Acommunications system and methodthat usesa plurality
`of PCs and PDA/cell phones for the coordination of two or
`more people through the use of a communications network.
`The system and method provide each user with a PC or
`PDA/cell phone that has forced message alert software that
`enablesa userto create and send a voice or text messagealert
`that forces an automatic acknowledgementuponreceipt anda
`manual response from the recipient.
`2. Description of Related Art
`The purpose of a communications system is to transmit
`information bearing digital messages from a source, located
`at one point, to a user destination, located at another point
`some distance away. A communications system is generally
`comprised of three basic elements: transmitter, information
`channel and receiver. One form of communication in recent
`
`years is cellular phone telephony. A network of cellular com-
`munication systemsset up aroundan area suchas the United
`States allows multiple users to talk to each other, either on
`individual calls or on group calls, with handheld devices.
`Some cellular phone services enable a cellular phone to
`engage in conference calls with a small numberof users.
`Furthermore, cellular conference calls can be established
`through 800 numberservices. Cellular telephony also now
`includesthe ability to access local WiFi connections, allow-
`ing the devices to utilize cellular phone data transmission
`technology as well as the data transmission ability of the
`Internet.
`
`The method and operation of the integrated PDA/cell
`phones(cell phone/PDA/GPSwith touch screen) used herein
`is described in U.S. Pat. No. 7,031,728, which is hereby
`incorporated by reference, pending U.S. patent application
`Ser. No. 11/308,648, and pending U.S. patent application Ser.
`No. 11/612,830, and are usually discussed herein as a cell
`phone.
`In manysituations it is desirable for a user to be able to
`simultaneously send a messageto the cell phones or PCs of a
`large group of people. This can be typically accomplished
`using Digital SMS (Smart Message Service) and TCP/IP
`messagesthat are transmitted using cellular technology such
`as the various versions ofGSM and CDMA orviaa WiFilocal
`
`area network. However, in somesituationsit is additionally
`desirable to know: (a) which people received the message on
`their cell phone or PC, (b) which people did not receive the
`message on their cell phone or PC, and (c) the response of
`each person receiving the message. Digital SMS and TCP/IP
`messages do not provide each of those functions. As a result,
`what is needed is a method in which a senderof a text or voice
`
`message can force an automatic acknowledgement upon
`receipt from a recipient’s cell phone or PC and a manual
`response from the recipient via the recipient’s cell phone or
`PC whensending the text or voice message.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`SUMMARY OF THE INVENTION
`
`Applicant’s communication system and method described
`herein is embodied in the forced alert software developed by
`applicant and installed in the PCs and PDA/cell phones used
`herein.
`
`Aplurality ofPCs and PDA/cell phoneseach having forced
`alert software installed providing a communication network
`of PCs and PDA/cell phones with the ability to: a) allow an
`operator to create and transmit (via TCP/IP or anotherdigital
`transmission means) a forced voice alert, wherein said forced
`voice alert is comprised of a text or voice messagefile and a
`forced alert software packet, from a sender PC or PDA/cell
`phone to one or more recipient PCs and PDA/cell phones
`within said communication network; (b) automatically trans-
`mit an acknowledgementof receipt from said recipient PCs
`and PDA/cell phones to the sender PCs or PDA/cell phones
`upon receipt of the forced messagealert by the recipient PCs
`and PDA/cell phones; (c) periodically resend the message to
`the recipient PCs and PDA/cell phones that have not sent an
`acknowledgement until an acknowledgement
`is received
`from every recipient PC and PDA/cell phone; (d) provide an
`indication on the display of the sender PC or PDA/cell phone
`of which recipient PCs and PDA/cell phones have acknowl-
`edgedthe forced messagealert; (e) provide a manual response
`list on the display of the recipient PC and PDA/cell phone’s
`display that can only be cleared by manually selecting and
`transmitting a response from thelist or recording andtrans-
`mitting a voice response after sending said automatic
`acknowledgment; and (f) provide an indication on the sender
`PC or PDA/cell phoneofthe status the manual response and
`the content of the manual response from each recipient PCs
`and PDA/cell phones.
`A communication network server can act as a forwarderfor
`
`TCP/IP communications between any combination of PC
`users or PDA/cell phone users. The server can also act as a
`forwarder of data addressed from one participant to one or
`more addressedparticipants, thus permitting the transmission
`of forced text or voice messages, other messages, photo-
`graphs, video, E-mail and URL data from one network par-
`ticipantto other selected network participants.
`The abovefunctions can also be accomplished using WiF1,
`WiMaxorother peer to peer communications. However, for
`use with cellular communications andto assure the level of
`security that cell phone companies require, a centralized
`static IP routable server is used.
`
`It is the object of this invention provide to a method in
`which by sending a forced text or voice messageto a recipient
`or a group of recipients, a sender can compel an automatic
`acknowledgement of receipt from each recipient’s PC or
`PDA/cell phone and require a manual response from the
`recipientvia the recipient’s cell phone before the message can
`be cleared.
`
`In accordance with these and other objects which will
`becomeapparenthereinafter, the instant invention will now
`be described with particular reference to the accompanying
`drawings.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1a shows a front elevational view of an integrated
`PDA/cell phone having a touch screen that includes forced
`messagealert software described herein.
`FIG. 16 showsa flow chart that explains the device shown
`in FIG. La.
`
`

`

`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 10 of 20 PageID #: 374
`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 10 of 20 PagelD #: 374
`
`US 8,213,970 B2
`
`3
`FIG. 2 shows the installation and set up of the forced
`messagealert software on a communication network ofcell
`phones, integrated PDA/cell phones, and PCs.
`FIG. 3A showsthefirst section of a flow chart showing a
`process of sending a forced message alert to one or more
`recipients as well as for ascertaining which recipients
`received the forced message alert and which recipients
`respondedto the forced messagealert.
`FIG. 3B showsthe secondsection of a flow chart showing
`a process of sending a forced message alert to one or more
`recipients as well as for ascertaining which recipients
`received the forced message alert and which recipients
`respondedto the forced messagealert.
`FIG.4 showsa flow chart showing a processofreceiving a
`forced message alert as well as providing an acknowledgment
`of receipt and a responsebythe recipient.
`
`PREFERRED EMBODIMENT OF THE
`INVENTION
`
`A communication system and method that joins partici-
`pants in acommunications networkusing personal computers
`(“PC”) and handheld cell phones having integrated personal
`digital assistant (“PDA/cell phone’’) with a forced message
`alert software application program that allowsa participant to
`send a text or voice messageto a group of people and force an
`automatic acknowledgmentofreceipt and a manualresponse.
`Each PDA/cell phone described herein for the participant
`networkhasits own individual on/offpower and can function
`just as any other cell phone. It can also function with its PDA.
`To operate on the network, obviously the PDA/cell phone
`power switch has to be on. If the PDA/cell phone is com-
`pletely turned off, then it is not part of the participating
`network and cannot send or receive any forced message
`alerts. In addition to its own on and offpower switch, it has the
`forced message alert software application program that is
`activated manually when preparing to send a text or voice
`messageoris activated automatically when receiving a forced
`messagealert from another PC or PDA/cell phone.
`Each PC described herein is like any other contemporary
`PC, exceptthatit has the forced message alert software appli-
`cation program installed on it. To operate on the network,
`obviously the PC must be on and havean active connection to
`the Internet or other digital transmission means. If the PC is
`completely turned off, then it is not part of the participating
`network and cannot send or receive any forced message
`alerts. The forced messagealert software application program
`on the PC is activated manually when preparingto send a text
`or voice messageoris activated automatically whenreceiving
`a forced messagealert from another PC or PDA/cell phone.
`The communication system also includes a serverthat acts
`as a forwarder for IP communications between any combina-
`tion of PDA/cell phoneusers and/or PC based users. Network
`participant location, identity and status messages are sent to
`the server by each user. The users are the network partici-
`pants. Network participant entered tracks are also sent to the
`server. Because this data is of interest to all the network
`participants, the server forwards the data received from one
`participant to all other participants, thus providing the infor-
`mation necessary for all network participants to know the
`identity, location and status of all other network participants.
`In addition, the server keeps all of the network participants
`updated on information keptin its databases, such as all ofthe
`participants’ telephone numbers, E-mail addresses and other
`information necessary to carry on the communications
`described herein.
`
`4
`Theserver also acts as a forwarder of data addressed from
`one participant to one or more addressed participants, thus
`permitting the transmission of forced messagealerts, other
`text and voice messages, photographs, video, E-mail and
`URL data from one network participant to other selected
`network participants.
`The abovefunctions can also be accomplished using WiF1,
`WiMax,or other peer to peer communications. However, for
`use with cellular communications andto assure the level of
`
`security that cell phone companies require, a centralized
`static IP routable server is used.
`Referring now to the drawingsand,in particular, FIGS. 1a
`and 1b, a small handheld cellular phone 10 is shown that
`includes a PDA integrated in housing 12 that includes an
`on/off power switch 19, a microphone 38, and an LCD dis-
`play 16 that is also a touch screen system. The small area 16a
`is the navigation bar that depicts the telephone, GPS and other
`status data andthe active software. Each cell phone includes
`a CPU and databases that store information useful in the
`communication network. With the touch screen 16, data can
`be entered through the operator using a stylus 14 (or operator
`finger) by manipulatively directing the stylus 14 to literally
`touch display 16. Soft switches 16d displayed on the display
`16 are likewise activated by using a stylus 14 and physically
`and manipulatively directing the stylusto literally touch dis-
`play 16. The display x, y coordinates of the touched pointare
`known by a CPU in the PDAsection of the communication
`system in housing 12 that can coordinate various information
`contained in the PDArelative to the x, y coordinate position
`on the display 16. Inside housing 12 is contained the conven-
`tional cellular phone elements including a modem, a CPU for
`use with a PDAandassociated circuitry connected to speaker
`24 and microphone 38. Conventional PDA/cellular phones
`are currently on sale and sold as a unit that can be used for
`cellular telephonecalls and sending cellular SMS and TCP/IP
`or other messages using the PDA’s display 16 and CPU. The
`device 10 includes a pair of cellular phone hardwareactivat-
`ing buttons 20 to turn the cellular phone on and 22 to turn the
`cellular phone off. Navigation pad actuator 18 is similarto a
`joy or force stick in that the actuator 18 manually provides
`movement commandsthat can be used by the PDA’s software
`to move a cursor on display 16. Switches 26 and 28 are
`designed to quickly select an operator specified network soft-
`ware program. Speaker 24 and microphone 38 are used for
`audio messages. Switch 19 at the top left of device 10 is the
`poweron and poweroff switch for the entire device.
`The heart of the invention lies in the forced messagealert
`software application program provided in each PC or PDA/
`cell phone. The forced message alert software application
`program is activated throughuse ofa screen drawnsoft switch
`or by clicking on an icon on the PC or PDA/cell phonedisplay
`screen or when a forced message alert
`transmission is
`received by another PC or PDA/cell phone. The display 16 is
`mounted within the housing 12 as part of the PDA and the
`CPU (not shown). The internal CPU includes databases and
`software application programsthat provide for a geographi-
`cal map and georeferencedentities that are shown as display
`portion 16d that includes as part of the display various areas
`ofinterest in the particular local map section.
`When looking at display 16, the software switches (soft
`switches) which appearat the very bottom of the display 16d
`are used to control by touch many of the software driven
`functions of the PDA/cell phone. The soft switches are acti-
`vated through the operator’s use of the navigation pad 18, or
`a small track ball, force stick or similar hardware display
`cursor pointing device. Alternatively,
`the operator may
`choose to activate the software switches by touching the
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`

`

`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 11 of 20 PageID #: 375
`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 11 of 20 PagelD #: 375
`
`US 8,213,970 B2
`
`5
`screen with a stylus 14 (or finger) at the switches’ 16d loca-
`tions. When some of the software switches are activated,
`different software switches appear. The bar display 16d
`showsthe software switches “ZM IN (zoom in),” “ZM OT
`(zoom out),” “CENT (center)” and “GRAB(pan/grab)”at the
`bottom of the screen. These software switches enable the
`operator to perform these functions. The “SWITH (switch)”
`software switch at the lower right causes a matrix of layered
`software switches(soft switches) to appear above the bottom
`row of switches. Through use of the software switches, the
`operator can also manipulate the geographical map 165 or
`chart display. When looking at FIG. 1a, display symbols
`depict permanent geographical locations and buildings are
`shown.For example,the policestation is shown and, when the
`symbol is touched by the stylus or finger, the latitude and
`longitude of the symbol’s location, as shown in display sec-
`tion 16c, is displayed at the bottom left of the screen. The
`bottom right side of display 16c is a multifunction inset area
`that can contain a variety of information including: a) a list of
`the communication link participants; b) a list of received
`messages; a) a map, aerial photographorsatellite image with
`an indication of the zoom andoffset location ofthe main map
`display, which is indicated by a square that depicts the area
`actually displayed in the main geographical screen 16d; d)
`applicable status information; and e) a list of the communi-
`cation net participants. Each participant user would have a
`device 10 shown in FIGS. 1a and 1.
`Also shownonthe display screen 16, specifically the geo-
`graphical display 16,is a pair of different looking symbols
`30 and 34, a small triangle and a small square, which are not
`labeled. These symbols 30 and 34 can represent communica-
`tion net participants having cellular phonesin the displayed
`geographical area that are part of the overall cellular phone
`communicationsnet, each participant having the same device
`10 used. Thelatitude and longitude of symbol30 is associated
`within a database with a specific cell phone numberand, if
`available, its IP address and E-mail address. The screen dis-
`play 164, which is a touch screen, provides x and y coordi-
`nates of the screen 16to the CPU’s software from a map in
`a geographical database. The software has an algorithm that
`relates the x and y coordinates to latitude and longitude and
`can access a communications net participant’s symbol or a
`fixed or movable entity’s symbol as being the one closest to
`that point.
`In order to initiate a telephone call to the PDA/cell phone
`user (communication net participant) represented by symbol
`(triangle) 30 at a specific latitude and longitude displayed on
`chart 16), the operator touchesthe triangle 30 symbol with
`the stylus 14. The operator then touches a “call” software
`switch from a matrix of displayed soft switches that would
`overlay the display area 16c. Immediately,
`the PDA/cell
`phone will initiate a cellular telephone call to the PDA/cell
`phoneuserat the geographical location shownthat represents
`symbol 30. A second PDA/cell phone user (communication
`net participant) is represented by symbol 34 whichis a small
`square (but could be any shape or icon) to represent an indi-
`vidual cellular phone device in the display area. The ring 32
`around symbol 30 indicates that the symbol 30 has been
`touchedandthat a telephonecall can be initiated by touching
`the soft switch that says “call”? When this is done, the tele-
`phonecall is initiated. Other types of symbolic elements on
`the display 16 can indicate that a cellular phonecall is in
`effect. Additionally, the operator can touch both symbol 34
`and symbol30 and can activate a conferencecall between the
`twocellular phones andusers represented by symbols 30 and
`34. Again, a symbolic ring around symbol 34 indicatesthat a
`call has been initiated.
`
`25
`
`40
`
`45
`
`55
`
`6
`Equally important, an operator/user with a PDA/cell phone
`call the police station or any other specific geographical facil-
`ity displayed on the cell display map, including: buildings,
`locations of people, vehicles, facilities, restaurants, and the
`like, whose PDA/cell phone numbersand,if available, E-nail
`addresses, IP addresses and their URLsare previously stored
`in the database, by touching a specific facility location on the
`map display using the stylus 14 and then touchingthe cellular
`phonecall switch. As an example, the operator/user can touch
`and point to call a restaurant using a soft switch by touching
`the restaurant location on the display with a stylus and then
`touching the call soft switch. The cellular phone will thencall
`the restaurant. Thus, using the present invention, each partici-
`pant can touch and point to call to one or more other net
`participants symbolically displayed on the map, each of
`whom hasa device as shown in FIG. 1a and can also point to
`call facilities and regular phone numbers that had been pre-
`viously stored in the phone’s database. Furthermore, this
`symbol hooking and soft switch technique can be used to go
`to a fixed facility’s website or to automatically enter the fixed
`facility’s E-mail address in an e-mail.
`Each PDA/cell phone user device is identified on the map
`display of the other participants users’ phone devices by a
`display symbol that is generated on each user phonedisplay to
`indicate each user’s identity. Each symbol is placed at the
`correct geographical location on the user display andis cor-
`related with the map on the display. The operator of each
`PDA/cell phone device mayalso enter one or more otherfixed
`entities (buildings, facilities, restaurants, police stations, etc.)
`and geo-referenced events such as fires, accidents, or other
`events into its database. This information can be likewise
`
`transmitted to all the other participants on the communica-
`tions net. The map, fixed entities, events and PDA/cell phone
`device communication net participants’ latitude and longi-
`tude information is related to the “x” and “y” location on the
`touch screen display map by a mathematical correlation algo-
`rithm.
`When the PDA/cell phone device user uses a stylus or
`finger to touch one or more of the symbols or a location
`displayed on the cellular phone map display, the system’s
`software causes the status and latitude and longitude infor-
`mation concerning that symbolorlocation to be displayed. In
`order to hook a symbolor“track” such as anothernetpartici-
`pant which represents an entity on the geo-referenced map
`display, or a fixed geographical entity such as a restaurant,
`police station or a new entity observed by a cell phone user
`which is discussed below, the operator points at or near the
`location of a geo-referenced symbol appearing on the PDA/
`cell phone display that represents a specific track or specific
`participant or other entity. The hook application software
`determines that the stylus is pointed closeto orat the location
`of the symbol and puts a circle, square or other indication
`around the symbolindicating that amplification information
`concerning the symbolis to be displayed and indicating that
`additional data or changein data can be madetothe indicated
`symbol. The hook application code then sends a message to
`the display application code to display the net participant,
`facility or entity’s amplifying data. The display application
`code retrieves the primary data and amplification data con-
`cerning the symbolor entity from the database and displays
`the information at the correct screen location. The operator
`can then read the amplification data thatrelates to that specific
`symbolat the specific location. The PDA/cell phone operator
`can also select soft switches on the touch screen display to
`changethe primary data and amplification data. Furthermore,
`the operator can use a similar method of hooking andselect-
`ing to activate particular soft switches to take other actions
`
`

`

`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 12 of 20 PageID #: 376
`Case 2:22-cv-00185-JRG Document 23-1 Filed 08/23/22 Page 12 of 20 PagelD #: 376
`
`US 8,213,970 B2
`
`7
`which could include: making cellular phonecalls, conference
`calls, 8300 numbercalls; sending a free text message, operator
`selected preformatted messages, photographsor videos to the
`hooked symbol; or to drop a entered symbol.
`Each knownnetparticipant has a PDA/cell phone number,
`IP address and, if available, E-mail address that is store