Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 1 of 41 PageID #: 11724
`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 1 of 41 PageID #: 11724
`
`EXHIBIT 5
`EXHIBIT 5
`
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 2 of 41 PageID #: 11725
`
`METHOD TO PROVIDE AD HOC AND PASSWORD PROTECTED DIGITAL AND
`VOICE NETWORKS
`
`Allorney Docket No.: 10963.3829
`PATE~T
`
`CROSS REFERENCE TO RELATED AP PUCA TIONS
`
`[0001)
`
`Thi.s application is a continuation of co-pending U.S. Patent Application Serial No.
`
`13/751,453 filed January 28, 2013, which is a continuation-in-paLt of U.S. Patent Application
`
`Serial No. ·12/761,533 filed on April 16, 2010, now U.S. Patent No. 8,364,129 issued January 29,
`
`2013, which is a continuation-in-part of U.S. Patent Application Serial No. 11/615,472 filed on
`
`December 22, 2006, now U.S. Patent No. 8,126,441 issued on February 28, 2012, which is a
`
`continuation-in-patt of U.S. Patent Application Serial No. 11/308,648 filed April l 7, 2006, now
`
`U.S. Patent No. 7,630,724 issued on December 8, 2009, which is a continuation-in-pmt of U.S.
`
`Patent Application Serial No. 10/711 ,490, filed on September 21 , 2004, now U.S. Patent No.
`
`7,031,728 issued on April 18, 2006.
`
`BACKGROUND OF THE INVENTION
`
`Field of the Invention
`
`[0002)
`
`A communications method and system using a plurality of cellular phones each
`
`having an integrated Personal Digital Assistant (PDA) and Global Positioning System (GPS)
`
`receiver for the management of two or more people through the use of a communications
`
`network. The method and system provide each user with an
`
`integrated handheld
`
`cellular/PDA/GPS/phone that has Advanced Communication Software application programs
`
`(hereinafter referred to as ACS) and databases used in conjunction with a remote Server that
`
`enable a user to quickly establish a communication network of cell phone pmticipants having a
`
`comm.on temporary ad hoc network using mobile wireless communication devices.
`
`1
`
`AG1STX_00002266
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 3 of 41 PageID #: 11726
`
`Allorney Docket No.: 10963.3829
`PATE~T
`
`[0003)
`
`The invention includes a method and communication system to quickly set up and
`
`provide ad hoc, password protected, digital and voice networks to allow a group of people to be
`
`able to set up a network easily and rapidly, especia.Uy in an emergency situation.
`
`Description of Related A.rt
`
`[0004)
`
`The purpose of a communications system is to transm.it digital messages from a
`
`source, located at one point, to user destination(s), located at other po:i.nt(s) some distance away.
`
`A communications system is generally comprised of tlu·ee basic elements:
`
`transmitter,
`
`information channel and receiver. One form of communication in recent years is cellular phone
`
`teJephony. A network of cellular communication systems set up around an area such as the
`
`United States allows multiple users to ta.Ll< to each other, either on individual caUs or on group
`
`calls. Some cellular phone services enable a cellular phone to engage in conference calls with a
`
`smaU number of users. Fmthermore, cellular conference calls can be established tlu·ough 800
`
`number services. Cellular telephony also now includes systems that include GPS navigation that
`
`l1tilizes satellite navigation. These devices thllS llnite cellular phone technology with navigation
`
`information, computer ·information transmission and receipt of data.
`
`[0005)
`
`The method and o eration of communication devices used herein are desciibed in
`
`U.S. Patent 7,031,728 whkh is hereby incor orated b reference and U.S. Patent No. 7,630,724
`
`[0006) Military, first responder, and other public and private emergency groups need to be
`
`able to set up ad hoc digitaJ and voice networks easily and rapidJy. These private networks may
`
`be temporary or longer lasting in nature. The users need to be able to rapidly coordinate their
`
`activities eliminating the need for pre-entry of data into a web and or identifying others by name,
`
`phone numbers or email addresses so that aU intended participants that enter the agreed ad hoc
`
`2
`
`AG1STX_00002267
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 4 of 41 PageID #: 11727
`
`Allorney Docket No.: 10963.3829
`PATE~T
`
`network name and password are both digitally and voice interconnected. When a user or users
`
`leave the network, no data concerning the network participants need be retained.
`
`(0007]
`
`Coordinating different organizations at the scene of a disaster presents several
`
`problems as there are voice and digital data (text messages) communications that need to be
`
`constantly occurring up and down the chain of command. As an example. communications are
`
`required from a police chief to a police captain to a police lieutenant to a police sergeant to a
`
`policeman and then back 1.1p the same chain of command. Digital data exchange of OPS data or
`
`other means provides the location component of the units. Digital chat, text messages, white
`
`boards and photo video exchange provide extensive collaboration. However, during a disaster,
`
`other first responders such as fire departments must become engaged. ·while the fire department
`
`users may have voice and digital data (text messages) communications up and down their chain
`
`of command, these individuals do not have the ability to cross communicate necessarily with
`
`police units without a substantial degree of immediate coordination. The method and system in
`
`accordance with the present invention described herein discloses how digital commw1ication.s
`
`along WLth Personal Computer (PC) and PDA devices can be used to quickly establish user
`
`specific password protected pd vate ad hoc voice and data networks to enable both data and voice
`
`communications up and down their chain of command and simultaneously with different, not
`
`pre-known, organizations responding to a disaster. The invention defines a method of
`
`accomplishing this by providing all personnel that need to commm1icate with each other with a
`
`PC or PDA which are interconnected to a Server using cellular or other communications.
`
`3
`
`AG1STX_00002268
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 5 of 41 PageID #: 11728
`
`SUMMARY OF THE fNV ENTfON
`
`Allorney Docket No.: 10963.3829
`PATE~T
`
`[0008)
`
`Applicant's communication system and method described herein is embodied in the
`
`Advanced Conununication Software (ACS) application programs developed by applicant and
`
`installed in the integrated PDA/GPS cell phones used herein and remote Servers.
`
`[0009)
`
`A plurality of Internet Protocol (IP) capable PDA/GPS devices each having ACS
`
`application programs and databases provides a communication network in conjunction with a
`
`remote Server that provides the ability to: a) establish an ad hoc network of devices so that the
`
`devices can e'ither broadcast to a group or selectively transmit to each of the other; each PDA /
`
`GPS phone starts by requesting access to the Server and identifying a mutually agreed to network
`
`name and password and once granted, reports its GPS position and status; the Seiver then routes
`
`the data to all signed on network participants so that each of the devices exchange location, status
`
`and other information; (b) force the received information to the recipient's display and enable the
`
`recipient to acquire additional infonnation by touching the display screen at a remote phone's
`
`location on the PDA display; (c) make calls to or send data to remote phones by touching their
`
`display symbols and selecting the appropriate soft switch; (d) layer a sufficient number of soft
`
`switches or buttons on the POA display to perform the above functions without overlaying the
`
`map; and (e) allow a polling mode in each cell phone that permits a user to contact other cell
`
`phone users that have a common interest or relationship with a password and identifier for
`
`communication and to establish quickly a temporary ad hoc network especially in an emergency.
`
`[00010] A communication Server acts as a forwarder for IP communications between any
`
`combination of cell phone/PDA users and/or PC based users. Network participant location,
`
`identity and status messages are sent to the Server by each user. Network pa1ticipant entered
`
`tracks are also sent to the Server. Because this network participant location and track data is of
`
`4
`
`AG1STX_00002269
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 6 of 41 PageID #: 11729
`
`Allorney Docket No.: 10963.3829
`PATE~T
`
`interest to all the network participants, the Server forwards the data received from one participant
`
`to all other participants, causing their displays automatically, withot1t any operator action, to
`
`display the received information, thus providing the information necessary for all network
`
`pruticipants to know the identity, location and status of all other network pa1ticipants.
`
`[00011) The Server also acts as a forwarder of data addressed from one patticipant to one or
`
`more addressed participants, thtts permitting the transmission of free text, preformatted
`
`messages, photographs. video, Email and Unifotm Resource Locator (URL) data from one
`
`network participant to other selected network participants.
`
`[00012) The above functions can also be accomplished using peer to peer WiFi, WiMax or
`
`other peer to peer communications. However, for use with cellular communications and to assure
`
`the level of security that cell phone companies require, a centralized static 1P routable Server is
`
`used.
`
`[00013) The IP Server also fills another role of being a database from which data can be
`
`requested by network participants (i.e. maps, satellite images, and the like) or can be pushed to
`
`network participants (i.e. symbology and soft switch changes, and the like). The Server is used
`
`to establish an ad hoc network within ce1tain groups using an ad hoc event name and password.
`
`[00014) This invention provides a method and a system establishing an ad hoc password
`
`protected digital and voice network that can be temporarily set up or longer lasting in nature. The
`
`invention described herein allows users to rapidly coordinate their activities without having to
`
`pre-enter data into a web or identify others by name, E mail addresses or phone numbers.
`
`Essentially the users that establ ish the ad hoc and password protected digital and voice networks
`
`are required. to enter the Server's 1P address and an ad hoc event name and a password. In the
`
`case of military and fu·st responders, the name of the user's unit may also be used. This action
`
`5
`
`AG1STX_00002270
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 7 of 41 PageID #: 11730
`
`Allorney Docket No.: 10963.3829
`PATE~T
`
`causes the specific PDA or PC of the user to commence reporting directly to the Server's rP
`
`address. Once the Server receives the initial JP message from the user's PDA or PC, the server
`
`can commence to exchange data with the user's PDA or PC. The initial LP message may also
`
`contain additional data such as a license number and, if desired, a phone number man:ually
`
`entered or automatically acquired by the ACS. The JP address of the PDA and PC unit sending
`
`the initial rP message is stored by the Server. The Server then responds with a message notifying
`
`the user that his PC/ PDA is connected to the Server. The user PDNPC then repo1ts its GPS
`
`location and other status info1mation directly to the Server. This information is retained by the
`
`Server even when there are no other devices initially commun.icatb1g with the Server. When the
`
`other user's devices sign on to the Server with the same ad hoc event name and password, the
`
`Server software then recognizes all the users and stores their fP addresses in the Server. Thus the
`
`Server has all the users IP addresses stored and can pass location and status information among
`
`the ad hoc network participants even though the network participants have not entered other
`
`network pruticipants' names, phone numbers or email addresses. Thus one of the purposes of the
`
`invention is to allow an ad hoc network to be formed on a temporary basis in a rapid manner.
`
`[00015] When using the PTT feature, the ACS can enable the network participant to: I. PTT
`
`with all that are in the ad hoc digital network, or 2. PTf with select specific network participants,
`
`by touching their symbol(s) and then selecting PTT soft switch or 3. Specify a group of the
`
`network pa1ticipa11ts by assigning their symbols or unit names to a list of network patticipants
`
`and then associating the list with a soft switch whose function is to enable the operator to have
`
`PTT communications with all in the list.
`
`(00016]
`
`Since only one person is transmitting on a PTT voice network at any given time, the
`
`rece·iving network patticipant's ACS can relate the PTT IP address to the lP address of the unit
`
`6
`
`AG1STX_00002271
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 8 of 41 PageID #: 11731
`
`Attorney Docket No.: 10963.3829
`PATE~T
`
`transmitting his identification on the digital ad hoc network. This information cat1 then be used
`
`by the other PTI networked participant's ACS to: 1. flash the transmitting unit's name on their
`
`PDA / PC screens or 2. if a photograph has been attached to the ad hoc digital network symbol of
`
`the PTT transmitting person, to flash that photograph on the receiving unit's PDA / PC clisplay.
`
`(00017)
`
`It is an object of this invention to enable each patticipant in the communication
`
`network to join other ad hoc network parti.cipants to form an ad hoc digital and voice network
`
`with other cell phone users rapidly for coordinating member activities.
`
`[000l8]
`
`In accordance with these and other objects which will become apparent hereinafter,
`
`the instant invention will now be described with patiicular reference to the accompanying
`
`drawings.
`
`BRIEF DESCR1PTION OF THE DRAWINGS
`
`[000l9]
`
`Figme 1 shows a front plan view of a cellular phone/PD A/OPS having a touch screen.
`
`(00020)
`
`Figure 2 shows the screen IP address entry menu.
`
`(00021)
`
`Fig11re 3 shows ad hoc net names and password screen entry name.
`
`[00022)
`
`Figure 4 shows a screen entry identifying user.
`
`[00023)
`
`Figme 5 shows a flow chrut of the network as users sign on to the network.
`
`[00024)
`
`Figme 6 shows a flow chart that depicts how a group commander can command
`
`networked PD As/ PCS and raclios to load a Push To Talk (PTT) channel.
`
`(00025)
`
`Figtu-e 7 shows a flow chart that depicts how networked radio units respond to receipt
`
`of the Push-to-Talk (PTT) Commanded Channel.
`
`[00026)
`
`Figtu:e 8 shows a PDA screen geographical clisplay that represents the area covered by
`
`the network.
`
`7
`
`AG1STX_00002272
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 9 of 41 PageID #: 11732
`
`Allorney Docket No.: 10963.3829
`PATE~T
`
`[00027]
`
`Figure 9 shows a diagram that enables determining location, status, ViOP, PTT, and
`
`video communication between radios and cell phones.
`
`[00028]
`
`Figure 10 shows a diagram that describes enabling non RFlD equipped PDA phones
`
`to receive RFID tag data.
`
`PREFERRED EMBODIMENT OF THE INVENTION
`
`[00029] A method and communication system that joins a communications network of
`
`p,uticipants using handheld cell phones having integrated PDA and GPS circuitry with ACS
`
`application programs that allow a participant having an ACS equipped cell phone to provide an
`
`ad hoc and password protected digital and voice network.
`
`[00030] A communication Server acts as a forwarder for 1P communications between any
`
`combination of cell phone/PDA users and/or PC based user. Network participant location,
`
`identity and status messages are sent to the Server by each user. Network participant entered
`
`tracks are also sent to the Server. Because this data is of interest to all the network pmticipants,
`
`the Server forwards the data received from one participant to all other participants, thus
`
`providing the information necessary for all network participants to know the identity, .location
`
`and status of all other network participants.
`
`[00031] The Server allows the set up of the ad hoc network with an ad hoc event name and a
`
`password.
`
`[00032] The Server also acts as a forwarder of data addressed from one participant to one or
`
`more addressed participants, thus permitting the transmission of free text, preformatted
`
`messages, photographs, video, email and URL data from one network participant to other
`
`selected netwOJk pa1ticipants.
`
`8
`
`AG1STX_00002273
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 10 of 41 PageID #: 11733
`
`Allorney Dockel No.: 10963.3829
`PATE~T
`
`[00033] Referring now to the drawings and, in particular, to Figure ·1, a small handheld
`
`cellular phone 10 is shown that includes a PDA and a GPS communications device integrated in
`
`housing l2 that includes an on/off power switch l9, a microphone 38, and a Liquid Crystal
`
`Display (LCD) display 16 that is also a touch screen system. The small area 16a is the navigation
`
`bar that depicts the telephone, GPS and other status data and the active software. Each ceU
`
`phone includes a Central Processing Unit (CPU) and databases that store information useful in
`
`the communication network. The CPU also includes a symbol generator for creating touch
`
`screen display symbols discussed herein. With the touch screen 16, the screen symbols are
`
`entered through GPS inputs or by the operator using a stylus 14 (or operator finger) by
`
`manipulatively directing the stylus 14 to literally touch display 16. The soft switches 16d
`
`di.splayed on the display 16 are likewise activated by using a stylus 14 and physically and
`
`manipulatively directing the stylus to literally touch display 16. The display x, y coordinates of
`
`the touched point are known by a CPU in the PDA section of the communication system in
`
`housing 12 that can coordinate various i_nformation contained in the PDA relative to the x, y
`
`coordinate position on the display 16. Inside housing 12 is contained the conventional cellular
`
`phone elements including a modem, a CPU for use with a PDA and associated circuitry
`
`connected to speaker 24 and microphone 38. A GPS navigational receiver that receives signals
`
`from satellites that can determine the latitude and longitude of the cellular phone housing 12 can
`
`be internal or external to the housing 12. Conventional PDA/cellular phones are cw-rently on
`
`sale and sold as a unit (or with an external connected GPS) that can be used for cellular telephone
`
`calls and sending cellular Shott Message Service (SMS) and Transmission Control Protocol
`
`(TCP) TCP/IP or other messages using the PDA's display 16 and computer CPU. The GPS
`
`system including a receiver in housing 12 is capable of determining the latitude and longitude
`
`9
`
`AG1STX_00002274
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 11 of 41 PageID #: 11734
`
`Attorney Docket No.: 10963.3829
`PATE~T
`
`and through SMS, TCP/fP, WiFi or other digital messaging software, to also transmit this
`
`latitude and longitude information of housing 12 to other ceUular phones in the communication
`
`network via cellular communications, WiFi or radio. The device lO includes a pair of cellular
`
`phone hardware activating buttons 20 to turn the cellular phone on and 22 to turn the cellular
`
`phone off. Navigation pad actuator 18 is similar to a joy or force stick in that the actuator 18
`
`manually provides movement commands that can be used by the PDA's software to move a
`
`cursor on display 16. Switches 26 and 28 are designed to quickly select an operator specified
`
`network software program. Speaker 24 and microphone 38 are used for audio messages. Switch
`
`19 at the top left of device 10 is the power on and power off switch for the entire device.
`
`[00034)
`
`The heart of the invention lies in the applicant's ACS application programs provided
`
`in the device. The ACS programs are activated by clicking on an icon on the display to tum the
`
`ACS programs on or off. Mounted within housing 12 as pmt of the PDA is the display 16 and
`
`the CPU. The internal CPU includes databases and software application programs that provide
`
`for a geographical map and georeferenced entities
`
`that are shown as display portion 16b that
`
`includes as part of the display various areas of interest in the patticular local map section.
`
`[00035) When looking at display 16, the software switches (soft switches) which appear at the
`
`ve1y bottom of the display 16d are used to control by touch many of the software driven
`
`functions of the cellular phone aud PDA. The soft switches are activated tlu·ough the operator's
`
`use of the navigation pad 18, or a small track ball, force stick or similar hardware cLisplay cursor
`
`pointing device. Alternatively, the operator may choose to activate the software switches by
`
`touching the screen with a stylus 14 (or finger) at the switches' 16d locations. When some of the
`
`software switches are activated, different software switches appear. The bar display 16d shows
`
`the software switches " ZM lN (zoom in)," "ZM OT (zoom out)," "CENT (center)" and "GRAB
`
`10
`
`AG1STX_00002275
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 12 of 41 PageID #: 11735
`
`Allorney Docket No.: 10963.3829
`PATE~T
`
`(pan/grab)" at the bottom of the screen. These software switches enable the operator to perform
`
`these functions. The "SWITH (switch)" software switch at the lower right causes a matrix of
`
`layered software switches (soft switches) to appear above the bottom row of switches. Through
`
`use of the software switches, the operator can also manipulate the geographical map 1.6b or chart
`
`display. When looking at Figure 1, display symbols depicting permanent geographical locations
`
`and buildings are shown. For example, the police station is shown and, when the symbol is
`
`touched by the stylus or finger, the latitude and longitude of the symbol's location, as shown in
`
`display section 16c, is displayed at the bottom left of the screen. The bottom right side of display
`
`16c is a multi.function .i11set area that can contain a variety of .i1uo1mation including: a) a list of
`
`the communication link participants; b) a list of received messages; c) a map, aerial photograph
`
`or satellite image with an indication of the zoom and offset location of the main map display,
`
`which is indicated by a square that depicts the area actually displayed in the main geographical
`
`screen 16b; d) applicable status information; and e) a list of the communication net paiticipants.
`
`Each pa1ticipant user would have a device 10 shown in Figure l.
`
`[00036] Also shown on the display screen 16, specifically the geographical display 16b, is a
`
`pair of different looking symbols 30 and 34, a small triangle and a small square, which are not
`
`labeled. These symbols 30 and 34 can represent communication net pruticipants having cellular
`
`phones in the displayed geographical area that are part of the overall cellular phone
`
`communications net, each participant having the same device 10 used. The latitude and
`
`longitude of symbol 30 is associated within a database with a specific cell phone number and. if
`
`available, its fP address and email address. The screen display ·16b, which is a touch screen,
`
`provides x and y coordinates of the screen 16b to the CPU's software from a map in a
`
`geographical database. The software has an algorithm that relates the x and y coordinates to
`
`11
`
`AG1STX_00002276
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 13 of 41 PageID #: 11736
`
`Attorney Docket No.: 10963.3829
`PATE~T
`
`latitude and longitude and can access a communications net patticipant's symbol or a fixed or
`
`movable entity's symbol as being the one closest to that point.
`
`(00037]
`
`In order to initiate a telephone call to the cellular phone user (communication net
`
`pruticipant) represented by symbol (triangle) 30 at a specific latitude and longitude display on
`
`chart 16b, the operator touches the triangle 30 symbol with the sty.lus 14. The user then touches a
`
`"call" software switch from a matrix of displayed soft switches that would overlay the display
`
`area 16c. Immediately, the cellular phone will initiate a cellular telephone call to the cellul~u·
`
`phone user at the geographical location shown that represents symbol 30. A second ceUular
`
`phone user (com.mrntlcation net participant) is represented by symbol 34 which is a small square
`
`(but could be any shape or icon) to represent an individual cellular phone device in the display
`
`area. The ring 32 al'Ound symbol 30 indicates that the symbol 30 has been touched and that a
`
`telephone call can be initiated by touching the soft switch that says "call." When this is clone, the
`
`telephone call is initiated.. Other types of symbolLc elements on the rusplay 16 can inrucate that a
`
`cellular phone call is in effect. Additionally, the operator can touch both symbol 34 and symbol
`
`30 and can activate a conference call between the two cellular phones and users represented. by
`
`symbols 30 and 34. Again, a symbolic ring around symbol 34 indicates that a call has been
`
`initiated.
`
`(00038]
`
`Equally important, a user can call the po.lice station, or any other specific geographical
`
`facility displayed on the map including: buildings, locations of people, vehicles, faciJities,
`
`restaurants, or the like. whose cellular phone numbers and, if available, Email addresses. JP
`
`addresses and their URLs (previously stored in the database) by touching a specific facility
`
`location on the map display using the stylus 14 and then touching the cellular phone call switch.
`
`As an example, the operator can touch and poi nt to call a restaurant using a soft switch by
`
`12
`
`AG1STX_00002277
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 14 of 41 PageID #: 11737
`
`Allorney Docket No.: 10963.3829
`PATE~T
`
`touching the restaurant location with a stylus and then touching the call soft switch. The cellular
`
`phone will then call the restaurant. Thus, using the present invention, each participant can touch
`
`and point to call to one or more other net participants symbolically displayed on the map, each of
`
`whom has a device as shown in Figure l, and can also point to call facilities that had been
`
`previously stored in the phone' s database. Furthermore, this symbol hooking and soft switch
`
`technique can be used to go to a fixed facility's website or to aulomatically enter the fixed
`
`facility's email address in an email.
`
`[00039)
`
`Each cellular phone/PDA/GPS user device is identified on the map display of the
`
`other network pa1ticipant user's phone devices by a display symbol that is generated on each user
`
`phone display to indicate each user's own location and identity. Each symbol is placed at the
`
`correct geographical location on the user display and is correlated with the map on the display
`
`and is transmitted and automatically displayed on the other network paiticipant's PC and PDA
`
`devices. The operator of each cellular phone/PDA/GPS device may also enter one or more other
`
`fixed entities (buildings, facilities, restaurants, police stations, etc.) and geo-referenced events
`
`such as fo·es, accidents, etc., into its database. This information can be likewise transmitted to all
`
`the other participants on the communicati.ons net and automatically displayed. The map, fixed
`
`entities, events and cellular phone/PDA/GPS device communication net participants' latitude and
`
`Longitude inf01mation is related to the "x" and "y" location on the touch screen display map by a
`
`mathematical correlation algorithm.
`
`(00040] When the cellular phone/PDA/GPS device user uses a stylus or finger to touch one or
`
`more of the symbols or a location displayed on the cellular phone map display, the system's
`
`softwai·e causes the status and latitude and longitude information concerning that symbol or
`
`Location to be disp.layed. ln order to hook a symbol or "track" such as another net participant
`
`13
`
`AG1STX_00002278
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 15 of 41 PageID #: 11738
`
`Allorney Docket No.: 10963.3829
`PATE~T
`
`which represents an entity on the geo-referenced map display, or a fixed geographical entity such
`
`as a restaurant, police station or a new entity observed by a cell phone user which is discussed
`
`below, the operator touches at or near the location of a geo-reforenced symbol appearing on the
`
`cellular phone/PDA display that represents a specific track or specific pa11icipant or other entity.
`
`The hook application software dete1mines that the stylus ( or finger) is pointed close to or at the
`
`location of the symbol and puts a circle, square or other indication around tbe symbol indicating
`
`that amplification information concerning the symbol is to be displayed. The operator can hook
`
`entered tracks or his own track symbol and add data or change data associated with the indicated
`
`symbol. The hook application code then sends a message to the database application code to
`
`store the facility or entity's llpdated data. The display application code retrieves the primary data
`
`and amplification data concerning the symbol or entity from the database and displays the
`
`information at the correct screen location. The operator can then read the amplification data that
`
`relates to that specific symbol at the specific location. The eel I phone operator can also select
`
`soft switches on the touch screen display to change the primary data and amplification data.
`
`Furthetmore, the operator can use a similar method of hooking and selecting to activate patticular
`
`soft switches to take other actions which could include: making cellular phone calls, conference
`
`calls, 800 number calls; sending a free text message, operator selected preformatted messages,
`
`photographs or videos to the hooked symbol; or to drop a11 entered symbol.
`
`[00041]
`
`Each known net pai1icipant has a cellular phone number, IP address and, if avaiJable,
`
`Email address that is stored in each participant's device database.
`
`[00042] To use the communication system, a user sta,ts the PD A/cellular phone device system
`
`by turning on the cell phone power and selecting the cell phone and network software which
`
`causes: a) the cellular phone to be activated (if it has not already been activated); b) the GPS
`
`14
`
`AG1STX_00002279
`
`

`

`Case 2:17-cv-00513-JRG Document 226-5 Filed 12/14/18 Page 16 of 41 PageID #: 11739
`
`Allorney Docket No.: 10963.3829
`PATE~T
`
`interface receiver to be established; c) a map of the geographic area where the operator is located
`
`and operator's own unit symbol to appear at the correct latitude and longitude on the map on the
`
`display; d) the locations of fixed facilities such as restaurants, hotels, fire departments, police
`
`stations, and military ban-acks, that are part of the database to appear as symbols on the map; e)
`
`the device selected item read out area which provides amplification information for the
`
`communications net participants or the entity that has been hooked (on the display screen) to
`
`appear on the display; f) an insert area that contains various data including: the list of net
`
`paiticipants, a List of messages to be read, an indication of what portion of the map is being
`
`displayed in major map area and other information to appear on the display; and g) a row of
`
`ptimaty software created "soft switches" that are always present on the display to appear.
`
`[00043]
`
`For point to call network units and fixed facilities, the application code detects the x,
`
`y display screen location of the symbol that is designated by the user's stylus and translates the x,
`
`y coordinates to latitude and longitude and then: (1) searches the database to fmd the symbol at
`
`that location, (2) places a ''hook" indicator (a circle, square or other shape) around the symbol,
`
`(3) displays any amplifying data and (4) obtains the symbol's associated phone number (or, for
`
`Voice over fp (VoIP) an fp address) from the database. Upon receiving a "call" designation from
`
`the soft switch, the operator's device's ACS causes the appropriate phone number or IP address
`
`to be called. Upon receiving an indication that the phone number is being called, the application
`
`code places a box around the symbol (color, dashed or the like). When the call is connected, the
`
`box changes to indi