Case 2:17-cv-00513-JRG Document 175-3 Filed 08/14/18 Page 1 of 14 PageID #: 7274
`Case 2:17-cv—00513-JRG Document 175-3 Filed 08/14/18 Page 1 of 14 PageID #: 7274
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`EXHIBIT 2
`
`EXHIBIT 2
`
`
`
`

`

`Case 2:17-cv-00513-JRG Document 175-3 Filed 08/14/18 Page 2 of 14 PageID #: 7275
`
`III III H IIH III IHI HII DIII DI IO 11H IIDI II HI II
`US008213970B2
`
`(12) United States Patent
`Beyer
`
`(10) Patent No.:
`(45) Date ofPatent:
`
`US 8213,97O B2
`Jul. 3, 2012
`
`(54) NiFIHOL) OF UlELLZENG FORCED ALERtS
`FOR INTERACTIVE REMOTE
`COMIU[CAT[OS
`
`(75)
`
`inventor:
`
`[v1aIc(,Im K. Beyer, Jupiter Inlet Cclony,
`FL (US)
`
`( 73) Assignee: Advanced Ground Information
`Systems, [nc., Jupiter, FF, (lIS)
`
`(
`
`)
`
`l'Totice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adj usted under 35
`U.S.C. 154(b) by 367 clays.
`
`(21)
`
`Appl.No.: 12/324,122
`
`(22) Filed:
`
`Nov. 26, 2008
`
`(65)
`
`I/S 2009/0075685 Al
`
`Prior Publicatioii Data
`Mar. 19, 2009
`
`Related U.S. Application Data
`(63) Continuation-in-part of application Nd. 11/612,830,
`filed on L)ec. 1 9, 2006, which is a continuation-in-part
`ofapplication No. I I /308,648, filed on Apr. 17, 2006,
`which
`now
`No.
`is
`Pal.
`a
`7,630,724,
`continuation-in-part of application No. 10/711,490,
`filed on Sep. 21, 2004, how Pat. No. 7,031,728.
`
`(51)
`
`(52)
`
`hit. Cl.
`1f(14W4/OO
`
`(2009.0!)
`
`U.S. Cl ..... 455/466; 455/88; 455/404.2; 455/412.1;
`455/412.2; 455/414.4; 455/415; 455/416;
`
`455/418; 455/419; 455/420; 455/456.1; 455/456.3;
`455/457; 455/458; 455/463; 455/500; 455/517;
`
`455/518: 455/519; 455/556.2; 701/213; 701/482
`(58) Field ofClassification Search .................. 455/41.1,
`455/416, 518, 519, 41.3, 88, 404.2, 412.1,
`
`455/414.4, 415, 418, 419, 420, 456.1, 456,3,
`455/457, 458, 463; 701/213, 482
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATFN1' DOCIJMENTS
`7,031,728 L12
`4/20(16 Lteyef, Jr.
`2002/0061762 AI "
`5/2002 Maggenti er al ..............
`4/20(14 Kc'aLing et al ................. 455/519
`2004/0082352 A I
`9i2004 Dalton el al ,,,,,,,,,,,,,, 455/517
`2004/0192365 Ai
`lOi2005 Esler et al ,,,,,,,,,,,,,,,, D24/100
`2005/0241026 AI '
`9/2006 Beyer, Jr. et al,
`200(1/01996 12 Ai
`3/2008 Beyer
`2008/0076410 AI
`s cited by examiner
`
`Iriìnary Exconïner
`- Nick Corsaro
`Assistant Examiner - Aiiianuel Lebassi
`(74) Attorney, Agent, or Firm - Malin Haley Dimaggio
`Bowen & Lhota, PA.
`
`ABSTRACT
`(57)
`The system and method having a specialized software appli-
`cation on a personal computer or a FDA/cell phone that that
`enables a participant to force an automatic acknowledgement
`and a manual response to a text or voice message from other
`participants within the same network, Fach participant's
`ODA/cell phone includes a force message alert software
`application program for both creating ttnci processing these
`fbrced message alerts. 'I'he system rind method enableci bythe
`force message alert software application program provides
`the ability to (a) allow an operator to create and transmit a
`forced message alert from a sender PDAIcell phone to one or
`more recipient [(s and P[)A/cell phones within the comma-
`nication network; (h) automatically transmit tin acknowl-
`edgement o:f receipt to the sender FDA cell phone upon the
`receipt o/the fòrcedmessage alert; (e) periodically resend die
`message to tite recipient PCs and PDA/cell phones that have
`not sent an acknowledgement; (d) provide an indication of
`which recipient PCs and PIJA/eclI phones have acknowl-
`edgeclthe torced message alert; (e) provide a manual response
`list on the display ofthe recipient [C and PL)A/cell phone's
`display that can only be cleared by manually transmitting a
`response; and (f) provide an indication on the sender PDAI
`cell pitone of the status and content the isianual responses.
`
`13 Claims, 6 Drawing Sheets
`
`j
`
`t
`
`AG ISTX_O O O 0 5824
`
`

`

`Case 2:17-cv-00513-JRG Document 175-3 Filed 08/14/18 Page 3 of 14 PageID #: 7276
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet i of 6
`
`US 8,213,970 !B2
`
`I
`
`Eigj
`
`AG ISTX_O O O 0 5825
`
`

`

`Case 2:17-cv-00513-JRG Document 175-3 Filed 08/14/18 Page 4 of 14 PageID #: 7277
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 2 of 6
`
`liS 8,213,970 B2
`
`PROVIDE EACH ACS NETWORK PARTICIPANT WiTH A
`CELL PHONE J PDA f GPS WITH TOUCH SCREEN DISPLAY
`
`PROVIDE A MAP FOR GEOGRAPHICAL DISPLAY IN EACH
`PHONE
`
`PROVIDE A DATABASE OF FIXED SITES AND THEIR
`LATITUDE LONGTITUDE AND THEIR PHONE NUMBERS
`
`PROVIDE A SYMBOL GENERATOR THAT CREATES A
`DISPLAY SYMBOL AT THE CORRECT LOCATION
`REPRESENTING AN ACS NETWORK PARTICIPANT OR ONE
`OF THE FIXED LOCATIONS ON THE GEOGRAPHICAL
`DISPLAY
`
`CONTROL THE ACS DISPLAY THROUGH THE USE OF
`LAYERED SOFT SWITCHES
`
`PROVIDE ACS THAT CAUSES THE EXCHANGE OF
`IDENTITY, LOCATION AND STATUS DATA BETWEEN THE
`PARTICIPANTS AND THE EXCHANGE OF FREE TEXT,
`PREFORMATTED TEXT MESSAGES, PHOTOGRAPHS AND
`VIDEOS
`
`,
`
`PROVI DE ACS THAT AUTOMATICALLY INITIATES A CALL
`TO A PARTICIPANT BY TOUCHING THE PARTICIPANT'S
`SYMBOL ON THE DISPLAY AND SELECTING THE CALL
`SWITCH
`
`PROVIDE ACS THAT PERFORMS THE FUNCTION OF
`REMOTELY CALLING ANOTHER PARTICIPANTS CELL
`PHONE
`
`SEND A MESSAGE TO THE REMOTE PHONE'S ACS THAT
`CAUSES IT TO CALL ANOTHER PHONE NUMBER OR
`PERFORM OTHER FUNCTIONS
`
`Pig ib
`
`I
`
`r-
`
`SETUP
`CON FERENCES
`i_I '' SELECTING A
`PLURALITY OF
`SYMBOLS
`
`AG ISTX_O O O 0 5826
`
`

`

`Case 2:17-cv-00513-JRG Document 175-3 Filed 08/14/18 Page 5 of 14 PageID #: 7278
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 3 of 6
`
`liS 8,213,970 B2
`
`Fig. 2
`
`START
`
`I
`
`J,
`
`The Forced Messaging Alert Software is instafled on a pluraflty
`of cell phones, integrated FDA/cell phones and POs, creating a
`communication network
`
`I
`One or more default response lists forthe communication
`network are created
`
`The contact and identifying information for each cell phone,
`integrated FDA/cell phone and PC that is a member of the
`communication network and the default response list(s) are
`loaded on to every member cell phone, integrated PDA!cell
`phone and PC. A list is kept of each integrated PDAIcell phone
`and PC as they sign on the communications network.
`
`END
`
`[
`
`]
`
`AG ISTX_O O O 0 5827
`
`

`

`Case 2:17-cv-00513-JRG Document 175-3 Filed 08/14/18 Page 6 of 14 PageID #: 7279
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 4 of 6
`
`liS 8,213,970 B2
`
`Fig. 3A
`
`START
`
`[
`
`j
`
`The sender selects the forced messaging alert application
`software on a sender cell phone, integrated FDA/cell phone or
`PC and is prompted by said sender cell phone, integrated
`PDAIceII phone or PC to type the text message or record the
`voice message
`
`The sender types a text message or records a voice message
`on said sender cell phone, integrated PDA/cell phone or PC
`and is then prompted by said sender cell phone, integrated
`PDA/cell phone or PC to select if the message is to be sent
`to: a. a single user, b. all users participating in the network or
`C. a list of users.
`
`The sender then selects the default response list or creates a
`new response list that is sent with the text message or voice
`recording
`
`The sender designates instructs said sender cell phone,
`integrated FDA/cell phone or PC to transmit the message
`
`The forced message alert is transmitted to every designated
`recipient cell phone, integrated FDA/cell phone and FC
`
`GOTO
`FIG. 3B
`
`AG ISTX_O O O 0 5828
`
`

`

`Case 2:17-cv-00513-JRG Document 175-3 Filed 08/14/18 Page 7 of 14 PageID #: 7280
`
`U.S. Patent
`
`Jul. 3, 2012
`
`SheetS of 6
`
`liS 8,213,970 B2
`
`Fig. 3B
`
`[ROM FIG. 3A]
`
`jr
`
`The sender cell phone, ¡ntegrated FDA/cell phone or PC
`receives and monitors for acknowledgments of receipt from
`recipient cell phones, integrated PDA/celI phones arid PCs and
`displays an indication of which recipient cell phones, integrated
`PDNceII phones and POs have acknowledged receipt of the
`message alert
`
`.Jr
`
`The sender cell, phone, integrated FDA/cell phone or PC
`periodically resends the message alert to the recipient cell
`phones, integrated PDAIcelI phones or POs that have not
`acknowledged receipt.
`
`I
`The sender cell phone, integrated PDAfcell phone or PC monitors
`for and receives responses to the message alert from the
`recipient cell phones, integrated PDA/cell phones and POs and
`displays an indication of the response from each recipient cell
`phone, integrated FDA/cell phone and PC.
`
`i,
`
`END
`
`[
`
`J
`
`AG ISTX_O O O 0 5829
`
`

`

`Case 2:17-cv-00513-JRG Document 175-3 Filed 08/14/18 Page 8 of 14 PageID #: 7281
`
`U.S. Patent
`
`Jul. 3, 2012
`
`Sheet 6 of 6
`
`liS 8,213,970 B2
`
`Fig. 4
`
`START
`
`The forced alert message is received by the redpient cell phone,
`integrated PDNceII phone or PC. In response to receipt of the
`forced alert message, the recipient phone software prepares and
`sends an automatic acknowledgement of the receipt to the
`sender cell phone, integrated PDA/ceIl phone or PC
`
`After the acknowledgement of receipt is sent. the forced voice
`alert software takes control of the recipient's cell phone,
`integrated PDAIceII phone or PC and causes the text message
`to be displayed or the voice message to be periodically repeated
`and a list of responses to be shown on the display of the
`recipient cell phone inteqrated FDA/cell phone or PC PDNceII
`
`The recipient selects a response from the response list and the
`recipient cell phone and transmits the response to the senders
`cell phone.
`
`The forced message alert software releases control of the
`recipient cell phone, integrated PDAIcell phone or PC and
`clears the display or stops repeating the voice message
`
`END
`
`AG ISTX_O O O 0 58 3 0
`
`

`

`Case 2:17-cv-00513-JRG Document 175-3 Filed 08/14/18 Page 9 of 14 PageID #: 7282
`
`US 8,213,970 B2
`
`i
`METUO[) OF UTILIZING FORCEE) ALERTS
`FOR INTERACTiVE REMOTE
`COMMUNICATIONS
`
`This application is a conlinualion-in-parl of U.S. paient
`application Ser, No, I I /6 I 2,830 filed on F)cc. I 9, 2006 which
`is a continuation-in-part of liS. patent application Ser. NC).
`i 1/308,648 filedApr. I 7,2006 which is a continuation-in-part
`of U.S. patent application Ser. No .10/71 1490 now U.S. [ht.
`No. 7,031,728.
`
`10
`
`BACKGROUND OF THE INVENTION
`
`2
`SUMNi[ARYOFIIILi IINVEft[ION
`
`Applicant's communication system and method described
`herrin is embodied in the forced alert software developed by
`applicant suici installed in the PCs suici PDAIceII phones used
`herein.
`A plurality ofPCs and FDA/cell phones each having forceci
`alert software installed providing a conuiiun.ication network
`of PCs and P[)A/cell phones with the ability to: a) allow an
`operator to create ami transmit (via TCP/IP or another digital
`transmission means) a forced voice alert, wherein said forced
`voice alert is comprised of a text or voice message file and a
`forced alert software packet, from a sender PC or PDA/celi
`phone to one or isiore recipient PCs and PDA/celi phones
`within saici communication network; (b) automatically trans-
`salit an acknowledgement of receipt from said recipient PCs
`and PDA/cell phones to the sender PUs or PDA/cell phones
`upon receipt ofthe forced message alert by the recipient PCi
`and PDAIceii phones; (e) periodically reseiid tue message to
`the recipient PCi and PDA/cell phones that have not sent an
`acknowledgement until an acimnoa'lecigement is received
`from every recipient PC aiid PDA/cell phone; (/1) provide an
`indication on the display ofthe sender PC or ['[iA/cell phone
`of which recipient PCs asid PDAIceII phones have aclanowl-
`edged the forced message alert; (e) provide a manual response
`list on the display ofthe recipient PC and PL)A/cell phone's
`display that can only be cleared by manually selecting and
`transmitting a response -from the list or rording and trans-
`mitting a voice response a:fter sending said automatic
`acknowledgment; and (f) provide an indication on the sender
`PC or P[)A/cell phone ofthe status the manual response and
`the content ofthe nianual response from each recipient PCs
`and PDAfoeil phones.
`A communication network server can act as a forwarder for
`TCP/IP conmiunicalions between any combination of PC
`users or PDA/cell phone users. The server can also act as a
`fonvarcier of data addressed from one participant to one or
`niore addressed participailts, thus permittisig the transmission
`of forced text or voice messages, other messages, photo-
`graphs, vicieo, Li-mail arici [lRL ciato froni one network par-
`ticipant to other selected network participants.
`The above ftinctïons can also he accomplished using WiG,
`WiMax or other peer to peer comniunications. [-lowever, ihr
`use with cellular communications and to assure the level of
`security that cell phone companies require, a centralized
`static IP mutable server is used.
`it is the object of this invention provide to a method in
`which by sending a forced text or voice message to a recipient
`or a group of recipients, a sender can compel an automatic
`acknowledgement of receipt from cacha recipient's PC or
`PDA/cell pitone and require a nianuai response from the
`recipient via the recipient's cell pitone before the niessage can
`he cleared.
`in accordance with these and other objects which will
`become apparent hereinafter, the instant invention will now
`be described with particular reference lo the acconipanying
`drawings.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. la shows a froist elevational view of an integrated
`PDA/cell phone having a touch screen that includes forced
`message alert software ciescrihed herein.
`FIG. lb shows a flow chart that explains the device shown
`ill FIG. la.
`
`AG ISTX_O O O 0 58 3 1
`
`20
`
`2)
`
`_
`
`1. Field ofthe Invention
`A comniunications system and nietliod diat uses a plurality
`of PC/s and PDÀ/ceIl phones for the coordination of two or
`more people through the use o:f a cotnmLlnïcations network.
`The system and iiietiiod provide cacha user with a PC or
`P[)A/cell phone that has forced message siert software that
`enabies a user to create and send a voice or text message alert
`that fones ais automatic acknowiedgenieiit upon receipt and a
`manual response from the recipient.
`2. Description of Reiated Art
`T1e purpose of a communications system is to transmit
`information bearing digital messages from a source, located
`at one point, to a user destination, located at another point
`some distance away. A communications system is generally
`comprised of three basic elements: transmitter. information
`elisione! and receiver. One forni of communication in recent
`years is ceiiuiar phone telephony, A network of cellular com-
`munication systenis set up around an area suela as the United
`States allows multiple users to talk to each other, either on
`ïticlïvïciiiai calls or on group calls, with handheid devices.
`Some cellular phone services enabie a ceiluiar phone to
`engage in conference calls with a small numher of users.
`Furthermore, cellular conference calls can be established
`through 800 number services. Cellular telephony also now
`includes the ability to access local WiFi connections, allow-
`ing the devices to utilize celiLilar phone cinta transmission
`technology as weil as the data transmission ability of the
`Internet.
`The method and operation of the integrated PDAIceII
`phones (cell phioneJPDAíGPS with toucha screen) used herein 4
`is tiesetibecl in U.S. Pat. No. 7031,728, which is hereby
`incorporated by reference, pending liS. patent application
`Ser. No. I 1/308,648, and pending U.S. patent application Ser.
`No. 1 1/612,830, and are usually discussed herein as a cell
`phone.
`in many situations it is desirable for a user to be able to
`simultaneously senti a message to the cell phones or PCs of a
`large group of people. 'ihis can be typically accomplished
`using Digital SMS (Smart Message Service and TCP/IP
`messages that are transmitted using cellular technology such 55
`as tise various versions ofGSM and CDMA or via a WiFi local
`area network. 1-lowever, in some situations it is additionally
`desirable to know: (a) which people received the message on
`their cell phone or PC, (b) which people did not receive the
`message on their celi phone or PC, and (e) tise response of 60
`each person receiving the message. Digital SMS and TCP/IP
`messages do not provide each ofthose functions. As a result,
`what is needed is a method in which a sender ofa text or voice
`message can force an automatic acknowledgement upon
`receipt from a recipient's cell phone or PC anti a manual
`response from the recipient via the recipient's cell phone or
`PC when sending the text or voice niessage.
`
`50
`
`65
`
`

`

`Case 2:17-cv-00513-JRG Document 175-3 Filed 08/14/18 Page 10 of 14 PageID #: 7283
`
`US 8,213,970 B2
`
`FIG. 2 shows the installation and sot up of the forced
`rnessac alert software on a conimLtnication network of cell
`phones, iiitegrated PDA/cell phones, and PCs.
`FIG. 3A shows the first section of a flow chart showing a
`process of sending a forced message alert lo one or more
`recipients as well as for ascertaining which recipients
`received the forced message alert and which recipients
`responded to the forced niessage alert.
`ElCi. 3B shows the second section ofa flow chart showing
`a process of sending a fòrced message alert to one or snore
`recipients as well as for ascertainisig which recipients
`received the forced message alert and which recipients
`responded to die forced message alert.
`FIG. 4 shows a flow chart showing a process of receiving a
`forced message alert as well as providing an acicnowledgment
`of receipt and a response by the recipient.
`
`PREFERRED EMBODIMENT OF THE
`INVENTIoN
`
`A coniimmication system and method that joins partici-
`pants in a coniniunications network using personal computers
`(PC") and hiandheld cell pIsones having integrated personal
`digital assistant ("P0k/cell phone") with a forced message
`alert softwire applicationprogram that allows a participant to
`send a text or voice message to a group ofpeople and force an
`automatic acknowledgment of receipt and a manual response.
`Each PDAÍceII phone described herein for die participant
`network has its own individual oníoffpower and can fonction
`just as any other cell phone. It can also ftmction with its PDA.
`To operate on the network. obviously the PDA1ceII phone
`power switch has to he on. if the FDA/cell phone is corn-
`pletely turned off, then it is not part of the participating
`network and cannot send or receive any fòrced message
`alerts. In additiosi to its own on and offpower switch, it has the
`forced message alert software application program that is
`activated manually when preparing to send a text or voice
`message or is activated automatically when receiving a forced
`message alert from another [5C or PDA/cell phone.
`Each PC described herein is like any other contemporary
`PC, except that it lias the forced message alert software appli-
`cation pmgrani installed on it. To operate on the network,
`obviously the PC must he on and have an active connection to
`the Internet or other digital transmission means. ifthe [5C is
`completely turned o:tf, then it is not part ofthe participating
`network and cannot send or receive any forced message
`alerts. The forced message alert software application program
`on the PC is activated manually when preparing to send a text
`or voice message or is activated automatically wlieii receiving
`a forced inessige alert from mother PC or PDA/eell phone.
`The communication system also includes a server that acts
`as a forwarder foriP communications between any combina-
`tion ofPDA/cell phone users and/or PC based users . Network
`participalit location, identity and status messages are sent to
`the server by each user. The users are the network partici-
`pants. Network participant entered tracks arc also sent to the
`server. Because this clatst is of interest to all the network
`participants, the server forwards the data received from one
`participant to all other participants, thus providing the infor-
`inalioii necessary for all network participants to know the
`identity, location and stami ofall other network participants.
`Iii addition, the server keeps all of the network participants
`updated on inforniationkept in its datihases, such îs all of the
`participants' telephone numbers, F-mail addresses and other
`information necessary to carry on the conimLinications
`described herein.
`
`The server also acts 515 0 forwarder of data addressed from
`one participant to one or more addressed participants, thus
`permitting the transmission of forced message alerts, other
`text and voice messages, photographs, video, E-mail and
`5 URL data foins one netivork participant to other selected
`network participants.
`The shove ftinctions csn sIso he sccomplished using WiFi,
`\VïMax, or other peer to peer communications. Flowever, for
`Lise with cellular communications and to assure the level of
`lo SecLility thai cell phone companies require, a centralized
`static IP mutable server is used.
`Referring now to the drawings and, in particular, FIGS. 1
`and ib, s small hsndheld cellular phone 10 is shown that
`includes a ['[)A integrated in housing 12 that includes an
`ii on/off power switch 19, a microphone 38, and an LCD dis-
`play 16 that is also a touch screen system. The small area 16a
`is the navigation bar that depicts the telephone, GPS and other
`status data and the active software. Each cell phone includes
`a CPU and databases that store information useful in the
`20 communication network. With the touch screen :16, data can
`he entered through the operator using a stylus 14 (or operator
`finger) by manipulatively directing the stylus 14 to literally
`toucha display 16. Soft switches 16d displayed on the display
`16 are likewise activated by using a stylus 14 and physically
`23 and manipulatively directing the stylus to literally touch dis-
`play 16. The display x, y coordinates ofthe touched point are
`known by a CPU in the PL)A section ofthe communication
`system in housing 12 that can coordinate various information
`contained in the PDA relative to die x, y coordinate position
`30 on the display 16. Inside housing 12 is contained the costeen-
`tional cellular phone elements including a modem, a CPU for
`use with a PDA and associated circuitry connectedto speaker
`24 and microphone 38. Conventional [5DA/cellular phones
`are currently on sale and selci as a unit that can he used for
`35 cellularteleplione calls and sending cellular SMS and TCP/IP
`or other messages using the PDA's display 16 and CPU. The
`device 10 includes a pair ofcellular phone hardware activat-
`ing buttons 20 to turn the cellular phone on and 22 to turn the
`cellular phone off. Navigation pitch actuator 18 is similar to a
`40 .iOy or force stick in that the actuator 18 manually provides
`niovenient conunands that can be used by tise PDA' s software
`to move a cursor on display 16. Switches 26 and 28 are
`designed to quickly select an operator specified network soft-
`ware program. Speaker 24 and microphone 38 arc used -for
`45 audio messages. Switch 19 at the top left ofdevice 10 is the
`power on and power off switch for the entire device.
`'the heart ofthe invention lies in the forced message alert
`software application prograni provided in each PC or PDAI
`cell phone. The forced message alert software application
`50 prograiii is activated through use ofa screen drawii soft switch
`orby clicking on an icon onthe PC or PDA/cell phone display
`screen or when a forced message alert transmission is
`received by another PC or PDA/cell phone. 'Ihe display 16 is
`niounted within the hoLising 12 as part of the PDA and the
`55 C-PU (not shown). Tise internal CPU includes databases and
`software application progranis thai peavide for a geographi-
`cal map and georefcrenced entities that arc shown as display
`portion 16h that includes as part ofthe display various areas
`ofinterest in the particular local map section.
`60 When looking at display 16, the software switches (soil
`switches) which appearai tise very bottom ofihe display 16d
`are used to cotitrol by toucha many of the software driven
`functions of the PDAIce11 phone. The soft switches are acti-
`vated through the operator's use ofthe navigation pad 18, or
`lt small track ball, force stick or similar hardware display
`cursor pointing device. Alternatively, the operator may
`choose to activate the software switcises by touching tise
`
`65
`
`AG ISTX_O O O 0 58 32
`
`

`

`Case 2:17-cv-00513-JRG Document 175-3 Filed 08/14/18 Page 11 of 14 PageID #: 7284
`
`US 8,213,970 B2
`
`2
`
`30
`
`screen with a stylus 14 (or finger) at the switches' 16d loca-
`tions, When some of the o:ftwarc switchc arc activated,
`different software switches appear. The bar display 1M
`shows the software switches "ZM TN (zoossi in)," 'ZM OT
`(zoossi out)," "CENT (center)" and 'GRAB (panlgrab)" at the
`bottom of the screen, These software switches enable the
`operator to perform these functions. The "SWITEI (switch)"
`software switch at the lower right causes a matrix o:f layered
`software switches (soft switches) to appear above the bottom
`row of switches. Through use of the software switches, the io
`operator can also manipulate the geographical map 16b or
`chart display. When looking at FIG. la, display symbols
`depict permanent geographical locations and buildings are
`shown. [or example, the police station is shown and, when the
`symbol is tOLicheci by the stylus or finger, the latitude and i
`longitude ofthe symbol's location, as shown in display sec-
`tion 16e, is displayed at the bottom left of the screen. The
`bottoisi right side ofdisplay 16c is a multifunction inset area
`that can contain a variety ofinformation including: a) a list of
`the communication link participants; b) a list of received 20
`messages; a) a map, aerial photograph or satellite image with
`an indication of'the zoom and offset location ofthe main niap
`display, which is indicated by a square tisai depicts the area
`actually displayed iii the main geographical screen 16b; d)
`applicable status information; and e) a list of the conimuni-
`cation net participants. Bach pirticipoint user would have a
`device 10 shown in FIGS. la and lb,
`Also shown on the display screen 16, specifically the geo-
`graphical display 16b, is a pair ofdifferent looking symbols
`30 and 34, a small triangle and a small square, which are not
`labeled. These symbols 30 and 34 can represent coismiunica-
`tien net participants having cellular phones in the displayed
`geographical area that are part ofthe overall cellular phone
`communications net, each participant having the sanie device
`lo Usedl. The latitude andlongitude ofsyinbol 30 is associated 35
`withiii a database with a specific cell phone ni.uiiber and, if
`available, its IP address and E-niail address. The screen dis-
`play I 6h, which is a touch screen, provides x and y coordi-
`nates ofthe screen 16h to the U's sothss'are from a map in
`a geographical database. Ihe software has an algorithm that 40
`relates the x and y coordinates to latitude and longitude and
`can access a conmiunicalions nel participant's symbol or a
`fixed or movable entity's symbol as being the one closest to
`that point.
`in order to initiste a telephone call to the P[)Á/cell phone 45
`user (communication net participant) represented by symbol
`(triangle) 30 at a specific latitude and longitude displayed on
`chart 16b, the operator louches the triangle 30 symbol with
`the stylus 14. The operator then touches a "call" software
`switch front a niatrix of displayed soft switches that would so
`overlsy the displsy ares 16e. immediately, the PDA/cell
`phone will initiate a cellular telephone call to the PDA/cell
`phone user at the geographical location shown that represents
`symbol 30. A secondI PDAícell phone tiser (communication
`net participant) is represented by symbol 34 which is a small
`square (but could be any shape or icon) to represent an indi-
`vidual cellular phone device in the display arca. The ring 32
`around symbol 30 indicates that the symbol 30 has been
`touched and that a telephone call can be initiated by touching
`the soil switch that says 'call." When this is done, the tele- so
`phone call is initiated. Other types of symbolic elements on
`the display 16 eau indicate that a cellular pitone call is in
`effect. Additioiially, the operator eau touch both symbol 34
`and symbol 30 and can activate s conference ciii between the
`two cellularphones tinti titers represented by symbols 30 and ss
`34. Again, a symbolic ring around symbol 34 indicates that a
`call lias been initiated.
`
`55
`
`6
`[dlually important, an operatermuser with a PL)A/cehl phone
`call the police station or any other specific geographical facil-
`ity displayed on the cell display map, including: buildings,
`locations of people, vehicles, facilities, restaurants, and the
`like, whose PDAIce11 phone numbers and, ifavailable, E-iiail
`addresses, TP addresses and their IJR[,s are previously stored
`in the database, by touching a specific ftcility location on the
`map display using the stylus 14 andthentouching the cellular
`phone call switch. As an example, the operator/user cantouch
`and point to call a restaurant using a soft switch by touching
`the restaurant location osi tite display with a stylus and titen
`touching the call soft switch. The cellular phone will then call
`the restaurint, Thus, using the present invention, eschpartici-
`pant can touch and point to call to one or more other net
`participants symbolically displayed on the map, each of
`whom lias a device as shown in FIG. la and can also point to
`call facilities and regular pitone numbers that liad been pre-
`viously stored in the phone's database. Furthermore. titis
`symbol hooking and soft switch technique can he used to go
`to ti fixed tàcïlity' s vebsite or to automatically enter the fixed
`facility's E-mail address in an e-mail.
`Each PDA/cell phone user device is identified osi the snap
`display of the oilier participants users' phone devices by a
`display symbol that is generated on each userphone display to
`indicate each user's identity', Bach symbol is placed at the
`correct geographical location on the user display and is cor-
`related with the map on the dïspltiy. The operator of each
`PL)A/cell phone device may also enter one or more other fixed
`entities (buildings, facilities, restaurants, police stations, etc.)
`and geo-referenced events such as fires, accidents, or other
`events into its database. This information can be likewise
`transmitted to all the other participants on the communies-
`tions net. Ihe map, fixed entities, events and ['DA/celi phone
`device communication net participants' latitude anti longi-
`tutte infbrmation is related to the 'x" auth "y" location on the
`touch screen display map by a mathematical correlation algo-
`ritimi.
`When the PDÀ/cell phone device user uses a stylus or
`finger to touch one or more of the symbols or a location
`displayed on the cellular phone map display, the system's
`software causes the stattis and latitude and longitude ïnfbr-
`Ination concenhing that synibol or location to be displayed. In
`order to hook a symbol or "track" such as another net partici-
`pant which represents an entity on the geo-referenced map
`display, or a fixed geographical entity such as s restaurant,
`police station or a new entity observed by a cell phone tiser
`which is discussed below, the operator points at or near the
`location of a geo-refereneed symbol appearing osi lie PDAI'
`cell phone display that represents a specific track or specific
`participant or oilier entity. The hook application software
`determines that the stylus is pointed close to or at the location
`of the symbol tind puts a circle, square or other indication
`around the syniho 1 indicating that amp lification information
`concerning the symbol is to be displayed and indicating that
`additional data or change in data can be suade to the indicated
`symbol. The hook application code then sends a message to
`the display application code to display the net participant,
`facility or entity's amplifying data. The display application
`code retrieves the primary data and amplification data con-
`cerning the symbol or entity from the database and displays
`Ihie inlorniation at the correct screen location. The operator
`can then read the amplification data that relates to that specific
`symbol at the specific location. The PDA/cell phone operator
`can also select soft switches on the touch screen display to
`change the primary data and amplification data. Furthermore,
`the operator can use a similar method ofhooking and select-
`ing to activate particular soft switches to take oilier actions
`
`AG ISTX_O O O 0 58 3 3
`
`

`

`Case 2:17-cv-00513-JRG Document 175-3 Filed 08/14/18 Page 12 of 14 PageID #: 7285
`
`US 8,213,970 B2
`
`20
`
`which could include: making cellular phcue calls, coaference
`ca1L, 8(X) number ca11; sending a free text message, operator
`setected prefbrmatted niessages, photographs or videos to the
`hooked symbol; or to drop a entered synibol
`Each iniown net participant has a PDA/cell phone iiumber,
`iI' address and. if available, Ft-mail address that is stored in
`esch participant's device database.
`Referring now to FIG. 2, in order to set L1 a conimunica-
`tïOfl network that