Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 1 of 20 PageID #: 7528
`Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 1 of 20 PageID #: 7528
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`EXHIBIT 16
`
`EXHIBIT 16
`
`
`
`

`

`Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 2 of 20 PageID #: 7529
`
`III III H IIH IIO III 1011 HH IIH III 01H III II HI II
`US007630724B2
`
`(12) United States Patent
`Beyer, Jr. et al.
`
`(10) Patent No.:
`(45) Date ofPatent:
`
`US 763O,724 B2
`Dec. 8, 2009
`
`(f4) METHOD OF PROVtDING A CELLULAR
`PHONEIPDA COMMUNICATION SYSTEM
`
`(75)
`
`inventors:
`
`[v1aIc(,Im K. Beyer Jr., Jupiter inlet
`Colony, FL (US); Christopher IL Rice,
`Monroe, WA (US)
`
`( 73) Assignee: Advanced Ground Information
`Systems, Inc., Jupiter Inlet Colony, FL
`(US)
`
`( * ) Noiiee:
`
`Subleci lo any diselainier, the terni of tlñs
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 450 clays.
`
`(21) Appl.No.: 11/308,648
`
`(22) Filed:
`
`Apr. 17, 2006
`
`(65)
`
`Prior Publication Data
`Sep. 7,2006
`US 2006/0199612 AI
`
`Related U.S. Application Data
`(63) Continuation-in-part of application No. 10/71 1,490,
`filed Ofl Sep. 21, 2004, now Pat. No. 7,031,728.
`
`(f1)
`
`[nt.CI.
`1104W 24/0(1
`(2009 . 01)
`(52) U.S. Cl ......................... 455/457; 455/416; 4551417
`(58) Field ofCIasitication Search .............. 455/452.3,
`455/416, 457
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATRNT DOC1JMFTS
`3/2001 Fumaiolo et al ............ 715/736
`I 2/2003 Huckham et al ............. 455/47
`
`6,204,844 Bl '
`
`6,662,() 16 F31
`
`3/2005 MuramaLsu
`6,868,337 B2
`7/2003 Rodriguez e al.
`2003/0139150 AI
`10/2003 Tue ........................ 709/203
`2003/0200259 A1
`(jorday et al ............ 455/456.1
`2004/0192331 Ai
`9/2004
`2004/0204070 AI * 10/2004 August et al ................ 455/557
`2004/0266456 AI
`12/2004 Bostroni et i1.
`2/2006 MzLLuo
`2006/0031927 AI '
`al ................. 726/11
`
`* cited by examiner
`
`Primary Examiner-Nick Corsaro
`A s si s tant Exa,nïner-Amanue1 Lebassi
`(74) Aìkrney, Agem, or F/rm-Ma1ïti Haley DiMaggio
`Bowen & Lhoia, PA.
`
`(57)
`
`ABSTRACT
`
`A cellular. PDA .ornrntuhication device and conIInLinicalioli
`system for allowing a plurality of cellular phone users to
`monitor each others' locations aiid status, to initiate cellular
`phone c11s by touching a symbol on the touch screen disp1y
`with a stylus which can also include point to call confereucing
`calling. Each participant's cellular phone PDA device
`iflClLldeS GPS navigation receiver with application sofìwue
`for point to call cellular phone initiation to participants and
`geographical entities including vehicles, persons or events,
`conference calls andvidco transfers, The method and system
`also includes automatic shifting from CfPRS/L[)GE/C[)MAI
`IXEVL)() to SMS when any of the cellular phones in the
`communication network is in the voice mode and in use and
`for aulonialic shifting back to GPRS/EDGE/CDMA'IXE-
`VDO upon completion of the voice phone call. In addition,
`using the system, a full transfer ofphotographs, video clips
`and high speed dth cn he used between any cel1ulr phones
`rearci1es of who the cellular phone vendors or cellular
`phone companies are and in either CL)MA, GSM, WiLi or a
`combinaiion of the Iwo.
`
`16 Claims, 6 Drawing Sheets
`
`J
`
`AGISTX_00005701
`
`

`

`Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 3 of 20 PageID #: 7530
`
`U.S. Patent
`
`Dec. 8,2009
`
`Sheet i of 6
`
`US 7,630,724 B2
`
`19
`
`24
`
`26 J
`
`)
`
`14
`
`12
`
`i';]
`
`ir
`
`i
`
`AG ISTX_0 O O 0 5702
`
`

`

`Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 4 of 20 PageID #: 7531
`
`U.S. Patent
`
`Dec. 8,2009
`
`Sheet 2 of 6
`
`US 7,630,724 B2
`
`24
`
`26
`
`)
`
`14
`
`12
`
`1t
`
`FIG. 2
`
`AG ISTX_0 O O 0 570 3
`
`

`

`Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 5 of 20 PageID #: 7532
`
`U.S. Patent
`
`Dec. 8, 2009
`
`Sheet 3 of 6
`
`US 7,630,724 112
`
`PROVIDE PARTICIPANTS EACH A CELLPHONE/PDA/CPS
`WITH TOUCH SCREEN DISPLAY
`
`PROVIDE GEOGRAPHICAL DISPLAY
`IN EACH PHONE
`
`PROVIDE A DATABASE OF FIXED LOCATIONS
`AND THEIR LA1TRJDE - LONGITUDE
`AND THEIR PHONE NUMBERS
`
`PROVIDE A DATABASE HAVING A LIST OF
`PARTICIPANTS AND CORRESPONDING CELLPHONE NUMBERS
`
`PROViDE A SYMBOL GENERATOR THAT CREATES A
`DISPLAY SYMBOL REPRESENTING A PARTiCIPANT
`ON THE GEOGRAPHICAL DISPLAY OF EACH CELLPHONE
`
`PROVIDE A MEANS TO CONTROL THE
`DISPLAY THROUGH THE USE OF
`LAYERED SOFT SWITCHES
`
`PROVIDE SOFTWARE TI-IAl PERMITS
`THE EXCHANGE OF GPS POSITION
`DATA, MESSAGES, PHOTOGRAPHS AND VIDEOS
`
`SET UP CONFERENCE
`CALLS BY TOUCHING
`A PLURALITY OF
`SYMBOLS OR
`SYMBOL IDENTIFIERS
`
`-
`
`PROVIDE SOFTWARE THAT AUTOMATICALLY
`INITIATES A CALL TO A PARTICIPANT BY TOUCHING
`THE PARTICIPANT SYMBOL ON THE DISPLAY
`
`PROVIDING SOFTWARE HAVING PRESTORED
`AUDIO, TEXT, OR VIDEO MESSAGES IN EACH
`CELLPI-IONE THAT CAN BE TURNED ON OR OFF
`REMOTELY BY ANOTHER PARTICIPANT
`
`FiG. 3
`
`AG ISTXO O O 0 5704
`
`

`

`Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 6 of 20 PageID #: 7533
`
`U.S. Patent
`
`Dec. 8, 2009
`
`Sheet 4 of 6
`
`liS 7,630,724 B2
`
`40
`
`46
`
`n
`
`"
`
`"
`
`-s
`
`N
`
`N
`
`N
`
`N
`
`N
`
`N
`
`'
`
`\
`
`\
`
`\
`
`\
`
`\
`
`\
`
`\
`\
`
`I
`
`I
`
`I
`
`I
`
`I
`
`I
`
`I
`
`I
`I
`
`/
`
`r
`
`r
`
`r
`
`r
`
`r
`
`52
`
`TCP/IP I
`SERVER
`
`FIG. 4
`
`AG ISTX_O O O 0 570 5
`
`

`

`-JD
`
`C,
`
`DDDQ
`
`l
`
`Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 7 of 20 PageID #: 7534
`
`cl)
`
`,,
`
`-t
`
`L.è
`
`e
`
`ç
`
`IILl.
`çií_'
`
`L_-Timer waiting for COMPLEIED Auto delete fileif timer expires
`
`I
`
`l.
`
`"FileAvail" msq with COMPLETED status onport 80
`
`Send new AGl
`
`Close socket to indicate EOF
`
`Send Data ini K blocks. Throttling if needed.
`
`ERROR]"
`
`I
`
`Send "AGIS [0K
`
`i
`
`¶Send 'AGIS PUT <FROM><T0><flLENAME><RLESIZE)
`
`[II)User Picks download in UI
`
`u
`
`Notification via UI
`
`i
`
`Connect Port 8i
`
`i
`
`i
`
`Send new AGIS'FileAvail" nisg with AVAILABLE status on port 80
`
`Close socket to indicate EOF
`
`i
`
`l
`
`Send Dato ini K blocks. Throttling if needed.
`
`ERRORI"
`
`I
`
`Send "AGIS [OK
`
`i
`
`I
`
`t
`
`i
`
`i
`
`3Listen Port 81
`
`iSend 'AGIS PUT <FROM><TO><flLENAME><FThESIZE)
`
`i
`
`Connect Port 81
`
`I
`
`I
`
`Handset Receiving
`
`I
`
`J
`
`Handset Sending
`
`

`

`Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 8 of 20 PageID #: 7535
`
`U.S. Patent
`
`Dec. 8, 2009
`
`Sheet 6 of 6
`
`US 7,630,724 B2
`
`OPERATOR TURNS
`PHONE ON
`
`OPERATOR SELECTS
`AGIS SOFTWARE
`
`AGIS SOFTWARE PUTS PHONE
`IN DIGITAL DATA TRANSFER MODE
`
`AGIS OPERATES EXCHANGING POSITION,
`TRACKS, TEXT, PHOTOS, VIDEO CLIPS
`
`AGIS OPERATOR DECIDES TO MAKE A PHONE CALL
`EITHER BY HOOKING A MAPSYMBOL OR AGIS
`UNIT AND SELECTING CALL, CONFERENCE CALL,
`800 CALL OR DIALING
`
`PHONE SOF1VARE PUTS PHONE
`IN VOICE AND SMS MODE
`
`OPERATOR HANGS PHONE UP
`
`AGIS SOFTWARE DETECTS HANGUP
`AND AUTOMATICALLY SHIFTS BACK
`TO DIGITAL DATA TRANSFER MODE
`
`AG ISTX_O O O 0 5707
`
`

`

`Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 9 of 20 PageID #: 7536
`
`US 7,630,724 B2
`
`i
`MET[IO[) OI PR)V[D[NG A CELLULAR
`[»ER)EIP[)A (Or4LUN[CAT[ON SYSTEwL
`
`FIELD OF THE INVENTION
`
`T1is invention relates generally to an integrated commu-
`niestions system using a plurality of cellular/PDA/CìPS
`phones for the management of a group ofpeople through the
`use ofa communications net and, specifically, to provide each
`tiser with a cellular/PDA/GPS/phone that has software appli-
`cation programs tisici databases that permit all the users to
`eoiitiiiuously know each other's locations and status, to rap-
`idly call and communicate voice, high speed internet data,
`photographs tinti video clips among the users by touching
`display screen symbols and to enable the users to easily i5
`access data concerning other users aocI other database infor-
`mation.
`
`io
`
`DESCRIPTION OF RELATED ART
`
`20
`
`2
`
`30
`
`The purpose of s communications system is to transmit
`information hearing signals from a source, located at one
`point, to a user destination, located at another point sonic
`distance away. A comnnuhications system is generally cosos-
`prised ofthree basic elenients: transmitter, information citan-
`nel and receiver. One fonts ofeonmiunication in recent years
`is cellular phone telephony. A network of cellular communi-
`cation systems set up around an area such sis the United States
`allows multiple users to talkto eachother, either on individual
`calls or osi group calls. Some cellular phone services enable a
`cellular phone to engage in conference calls with a small
`number of users. Furtlienuore, cellular conference calls can
`he established through 80(1 number services. Cellular tele-
`phony also now includes systems that include Global Posi-
`tinning System ((liPS) navigation that utilizes satellite navi- 3i
`gatioti. These devices thus unite cellular pitone technology
`with navigation information, computer information transniis-
`sioli and receipt of data.
`Digital Smart Message Service (SMS) antI TCP/IP mes-
`sages ctin be transmitted using cellular technology stich as 40
`various versions ofOSM and CDMA or via a WiFi local arca
`network. One implementation of these OPS location report-
`ing cellular systems is for tise data to go to a remote central site
`where the information is displayed for a person to monitor the
`locations ofthe cellular units that have the combined cellular 45
`(liPS phone. Another implementation permits the cellular
`phone users to also view the location ofother (iFS equipped
`units . A drawback of the current implenientation is that these
`systems are either all on or all off. There is no way to selec-
`tively activate participants or to stop the participants from so
`participating in the networlc or for participants to set their
`reporting intervals that is based on time or distance traveled.
`'['he tise of the current conitoineci cellular phone/PDA tech-
`nology has drawbacks when calling. WIsest an operator snakes
`a cellular phone call using the PDA to display a map (that also 55
`may depict geo-referenced businesses, homes asid other
`facilities' locations and phone numbers), the cellular phone/
`FDA operator is required to display the numeric phone num-
`ber by touching the display screen at the correct location of
`that entity citi the map, memorize the numeric phone number, so
`and select a different display to physically enter the phone
`number to snake tue call asid then, if desired, go back to the
`snap display. Needless to say, this is a cumbersome process.
`Sending a text message or an email to a location, business,
`home or fhcïlïty that appears on a PL)A map display or to 65
`another cellular phone CiliO also be a cumbersome process as
`the PDA operator has to find the phone number or entail
`
`address tif the location on the map display, memorize the
`phone number or email address, then go to a different display
`to enter a text message, enter the text niessage, send the text
`niessage and then shift back to tise snap display program.
`Furtiiennore, for a phone to send data concerning a new entity
`of interest, not currently on the geo-referenced map display
`( car, person, tank, iccident, or other entity), the operator must
`type in the information anti the latitude tinti longitude of the
`nest' entity of interest.
`U.S. Patent Application No. 2003/0139150 published Jul.
`24, 2003 shows a portable navigation asid communicatioii
`system. In one esiibodiment, tise system conibisies within a
`single enclosure a (fF5 satellite positioning unit, mobile tele-
`phony using cellular phone technolegy sind personal comput-
`ing capable of wired or wireless internet or intranet access
`using a standard operating system. The purpose ofthïs inven-
`timi is to provide portable navigation for ass individual. How-
`ever, to operate the device, one still steeds to utilize a keypad
`with the telephone functions. 11.5. Patent Application No.
`2003/0139 15(1 described a wireless communication system
`operating the PL)A in a conventional manner. There is no
`provision for displaying the location of other similarly
`equipped systessis. There is mio provision to cause other sirni-
`larly equipped cellular piionelPDA users to transniit their
`locations. There is no provision for entering other entities o-f
`interest by touching the display screen at their locitions on a
`map. There is no provision for making a telephone call by
`touching the display screen at a net participant's symbol or
`entered facility (police statiosi, lire station, etc.) synibol to
`initiate automatically the telephone call to that tiser or by
`touching multiple symbols to snake conference calls. There is
`no provision for sending text messages, photographs or vid-
`eos by touching the net participant(s)' symbol(s) on the dis-
`play screento automatically sencitext messages, photographs
`or videos to that participant or participants. There is no pro-
`vision to go to a facility' s web site or to automatically fill in a
`facility's E-mail address, There is no description or disclo-
`sure o-f a procedure to cause digital messages to he sent to a
`remote cellular phone that would cause the cellular phone to
`make verbal announcements, increase sound intensity,
`vibrate or to call back or to call another phone nLtsnber. There
`is no description of the uses of layered soft switches widcli
`confine the switches to a particular vicinity of the PDA's
`display screen.
`
`A plurality ofcellular piione/WiFi/PDAIGPS devices each
`having application software and databases to provide a corn-
`niunication network having: a) the ability to selectively poll
`each ofthe other [t[)A,'G[tS phone devices with each poirtici-
`pant to start reporting its position minci status information
`directly to all or selected users equipped with the sanie ccl-
`lular phione/PDA communication/GPS cievices in the corn-
`niunications net so that each of the devices that tue data is
`transmitted to is provided a display ofthe location, status amid
`other in-formation of the other users; h) the ability ofeach o-f
`the cellular phone/FDA devices to report to another device at
`an operator selected time rate or at a rate based on ciistance
`traveled; e) the ability to exchange othier entities' of interest
`inforniation asid to assign these entities a category (car, per-
`soli, tank. accident, or other event) by touching tise display
`screen at the entity's location on tise displayed Issap, and
`selecting the appropriate category switch; cl) the ability to
`make rapiti voice anti data call initiation to any other partici-
`pant in the cellular phone/Wibi net whose phone number is
`available in a gen-referenced database including the cellLilar
`
`AG ISTX_O O O 0 570 8
`
`

`

`Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 10 of 20 PageID #: 7537
`
`US 7,630,724 B2
`
`20
`
`3
`phoneíPE)A/GPS devices ifl a COtfltflUllïCati()tlS net by touch-
`ing the display screen at the appropriate map location on the
`PDA map display arid selecting a cati switch; e) tue ability to
`make rapid voice, and conference call initiation to locations,
`businesses, hontes aiid facilities whose pitone numbers are
`available in a geo-rcferenccd database including the cellular
`phone/P[)A!CiPS devices in a communications net by touch-
`ing the display screen at the appropriate other user locations
`Oil the t)A map display sind selecting a coniference call
`switch; f) lise ability to access a facility's URL or to autornali- io
`cally fill in their E-mail address: g) tite ability to remotely
`coittrol from one cellular phoneíPDA/GPS any of tite other
`cellular phone/PDA/GPS systems phones including the abil-
`ity to control remete cellular phones to make verbal prere-
`corded atinouncements, place return calls, place calls to i
`another pilone number, vibrate, execute text to speech soft-
`ware, change sound intensity, remotely control software and
`functions resident on tile remote phone and process and dis-
`play information by touching the display screen at their loca-
`tioti on the P[)A display and selecting the appropriate switch;
`and g) the ability to layer a sufficient number of switches or
`buttons on the PDA display to perfòrni the above functions
`without overlaying the situp.
`it is tui object of this invention to provide an improved
`ccl ILilar telephone conimunication network among a plurality 21
`OfeelILtIar phoiies for greatly decreasing the operator actions
`necessary to establish calling and conferencing between each
`of the cellular pitones.
`Aoci yet another object ofthis invention is to enable each
`participant to automatically exchange IP addresses using 30
`SMS or another digital message fornial.
`Anti yet another object ofthis invention is to enable each
`participant in the coinmLuuicatïons net to poll the other net
`participants to report or cease reporting their locations, iden-
`tity aiid status oit tite conummication net.
`Aoci yet another object ofthis invention is to enable each
`participant iii the comniunications net to be able to easily
`transniit ait entity ofinlerest to the other participants ofthe net
`by touching tite display screen at the entity's location oit the
`map and causing a symbol to he generated on the screen and
`entered and then entering the entity's category information.
`Asid yet another object of Ibis invention is to provide for
`initiating a cellularplione telephone call to imoilierphone by
`touching the other phone's symbol on the screen ofthe eel-
`loIsir phone, which automatically activates the telephone call.
`i't.iid yet another object of titis invention is to provide a
`cellularphone network that provides for instant voice confer-
`ence calling and the exchange offree text, preformatted mes-
`sages, photographs and video among a plurality of cellular
`phones by tOLlchïilg the display screen of specific geo-refér-
`eiiced niap synibols ihr ini dating the calls.
`And yet another object of this invention is to provide a
`cellular phone network that provides Ihr instant conference
`voice, text, photographs andvïdeo exchange by pre-estatllish-
`ing conferencing sub-nets tiicl tue subsequent activation of
`one of those sub-nets to establish a conference call.
`But yet still another object ofthe invention is to provide ihr
`a comniunication systeni that uses cellular telephone network
`that allows for photographs and video clips to be transferred
`('pushed") between and among the cellular phone users
`across multiple cellular carriers, between smart phone and
`PCi.
`in accordance with these and other objects which will
`become apparent hereinafter, the instant invention will now is
`be described with particLilar reference to the accompanying
`drawings.
`
`35
`
`4
`BRI[iF [)[iSCR.IPTIION oF TIIl[i L) RAWIL NOS
`
`FIG. i shows a front plait view of a cellular phone/PDA
`having a touch screen display in accordance with the present
`invention.
`PIO. 2 shows a front plan view ofthe cellular phone/PDA
`of FIEf. i with i different touch screen display.
`P11G. 3 shows a How chart of the operation of the present
`invention.
`FIG. 4 shows a schematic diagram depicting GPS satel-
`lites, a plurality of cellular phoneiPDí\ units, the cellular
`pitone company, the internet and the conmiand server that
`allows automatic shifting between high speed cellular inter-
`net coni.mumctttions tintI voice communictitions.
`FIG. 5 shows a process flow diagram ofthe transfer proto-
`col in accordance with the present invention.
`FIG. 6 shows a flow diagrani for automatic shifting
`between voice and high speed cellular internet communica-
`tions.
`
`PRP.FERREL) EMBC)DIH'V[ENT OPTI-lEi
`IlNVEìft[l()N
`
`Referring now to the drawings and, in particular, FIG. 1,
`the present invention is shown generally at 10 that includes a
`small handheld cellular phone that includes a personal digital
`assistant (PL)A) tind a global positioning system receiver
`( C-PS) communications device in housing 12 that includes an
`onioff power switch 19, a microphone 38, and an LCD dis-
`play 16 thaI is also a touch screen system. The small area 16a
`is the navigation bar that depicts tite telephone, GPS asid other
`status data and the active software, AGIS software refers to
`the application software used in this invention, AGIS is a
`trademark of AGIS Corporation. E'ich cell phone includes a
`CPU and databases that store ïnfbrmatïon useftil in the corn-
`niunication network. The CPU also includes a symbol gen-
`erator for creating touch screen display symbols discussed
`herein. With the touch screen I 6, the screen symbols are
`entered through Ci['S inputs or by the operator using a stylus
`14 (or operator finger) by snanipulatively directing the stylus
`14 to literally touch display 16. The soft switches 16d dis-
`played oit the display 16 are likewise activated by using a
`stylus 14 aitd physically aitd manipulatively directing lite
`stylus to literally touch display I 6. The display x, y coordi-
`nates ofthe touched point are known by a CPU in the PL)A
`section ofthe communication system in housing 12 that can
`coordinate varioLls information contained in the PDA portion
`relative to the x, y coordinate posilioit on the display 16.
`litside housing 12 is contained tite conventional cellular
`pitone elenieitis includiitg a ittodeni, a CPU for use with a
`PDA and associated circuitry connected to speaker 24 and
`microphone 38. A GPS navigationtil receiver that receives
`signals from satellites that can determine the latitude and
`longitude ofthe cellular phoite housing 12 cast be intentaI or
`external to the housiitg 12. PDAicellular phoite units such as
`these are curreittly on sale and sold as a complete unit (or ivitli
`an extemal connected (fPS) that can he used -for cellular
`telephone cttlls and sending cellular S MS and TOE/I P or other
`messages using the PL)A's display :16 and computer (CUI-I).
`The GPS system ineltaling a receiver in housing 12 is capable
`of deterrniniitg tite latitude and loitgitLtde and through SMS,
`TCP/IP, WiFi or other digital niessaging software, to also
`transntil titis latitude aitd longitude inforniatioit ofhousing 12
`to other cellular phones in the communication network via
`cellular communications, \VïE'ï or radio. The device 10
`includes a pair ofcellular phone hardware activating buttons
`20 to turn the cellular phoite on and 22 lo turn the celILilar
`
`AG ISTX_O O O 0 5709
`
`

`

`Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 11 of 20 PageID #: 7538
`
`US 7,630,724 B2
`
`6
`For describing the network, the operator's phone is cellular
`phone oft'. Navigation pad actuator 18 is similar to st jcy or
`force stick it-i that the actuator 18 manuaLly provides move-
`phone 'one," in order to initiate a telephone call to the eel lular
`phone user (communication net participant) represented by
`mont coinmaiicls that can be used by the PDA' s software to
`synibol (triangle) 30 at a specific latitude and longitude dis-
`move a cursor on display 16. Switches 26 and 28 are designed
`to quicidy select an operator specified sofiware program.
`play on chart 16b, the operator touches tise triangle 30 symbol
`Speaker 24 and microphone 38 arc used for audio messages.
`with the stylus I 4. The operator then touches a "call" software
`Switch 19 at the top left of device 10 is the power on and
`switch from a matrix of displayed soft switches that would
`overltty the display ttrea 16e. immediately, the cellular phone
`po\a'er Oft switch for the entire device,
`'The heart ofthe invention lies in the AGIS software appli-
`will initiate a cellulartelephone call to the cellular phone tiser
`caliolis providedin the device. J\founted withinhousing 12 as io
`at hie geographical location shown thai represents symbol 30.
`A second cellular phone user (commimication net partici-
`part of the PDA is the display 16 said the CPU. The internal
`CPU includes databases that provide for a geographical map
`pant) is represetited by synibol 34 wisich is a small square (but
`and georeferenced entities that is shown as display portion
`could he any shape or icon) to represent sin individual cellular
`[6h that includes as part ofthe display various areas of inter-
`phone device in the display area. The ring 32 around symbol
`est in the particular local map section.
`:11) indicates that the symbol 30 has been touched and that a
`When looking at display 16, the software switches (soft
`telephone call can be initiated by touching the soft switch that
`says 'call." When this is done, the telephone call is initiated.
`switches) which appear at the very bottom of the display i M
`are used to control by touch maiiy of the software driven
`Other types of symbolic elesnetits on the display 16 can indi-
`cate that a cellular phone call is in effect. Additionally, the
`Ponctions nf the cellular phone and PDA. The software drawn
`and controlled switches are activated through the operator's 20
`operator etin touch both symbol 34 and symbol 30 and can
`use ofthe navigation pad 18, or a small track ball, force stick
`activate a conference call between the two cellular phones and
`users represented by symbols 30 antI 34. Again, a symbolic
`or similar luuclware display cursor pointing device. Alterna-
`ring around symbol 34 indicates that a call lias been initialed.
`tively. the operatormay choose to activate the software switch
`matrix by touching tise screen with a stylus 14 (or finger) at
`Equally important, die operator ofeellularphone "one" cati
`the switches' 1M locations. When some of the software 2
`call the police station or any other specific geographical facil-
`switches are activated, duft brent software switches appear.
`ity displayed on the map, including: (buildings, locations of
`The bar display 16d shows the software switches 'ZM IN
`people, vehicles, facilities, restaurants, etc., (whose cellular
`(aoorn in)," "ZM 01 (zoom out)," 'CENI (center)" and
`phone numbers and,
`if available, Li-mail addresses, IP
`GRAß (panlgrab)" at the bottoni of the screen. These soft-
`addresses and their URLs were previously stored in the data-
`base) by touching a specific facility location on lise issap
`ware switches are for the operator to perforni these ftmctions. 30
`display using the stylus 14 and then touchitig the cellular
`The "SWITFI (switch)" software switch at the lower right
`causes a matrix oflayered software switches (soft switches)
`phone call switch, As an example, the operator can touch and
`to appear above the bottom row of switches. Through use of
`point to call a restaurant using a soft switch by touching the
`the software switches, the operator can also manipulate the
`restaLtrant location with his stylus and then touching the call
`soft switch. The cellular pisone will then call the restaurant.
`geographical map 16h or chart display. Whets looking at FIG.
`i, permanent geographical locations and buildings are shown.
`Thus, using lise present invention, each participant can touch
`and point to call to one or more other net participants sym-
`For example, the police station is shown asid when tite symbol
`is touched by the stylus or finger, the latitude and longitude of
`holically displayed on the map each ofwhom have a device as
`the symbol's location, as shown in display section 16c, is
`shown in FIG. i and can also point to call facilities that httd
`displayed at the bottom left ofthe screen. The bottom right 40
`been previously stored in the phone's database. Furthermore,
`side of display 16e is a multifunction inset area that can
`this symbol hooking and soft switeis teeimiquc can be used to
`contain a variety of infonisalinil including: a) a list of the
`go to a fixed facility's websile or lo automatically ciller lise
`coniniunication link participants; b) a list of received Isles-
`fixed facility' s E-mail address in ais c-snail.
`sages; e) a map, aerial photograph or satellite image with an
`Fach cellular phone!PDÀ/GPS user device is identified on
`indication ofthe zoom and offset location ofthe main map 45
`the map display ofthe other participa nt user phone devices by
`display, which is indicated by a square that depicts the area
`a displtty symbol that is generated on each user phone display
`actLlally displayed in the main geographical screen 16h; d)
`to indicate each user's identity. Each symbol is placed at the
`applicable stalLis infonnation; and e) a list of the conlntIni-
`correct geograpisical location on the user display and is cor-
`related wilis the map ois the display. The operator of each
`cation net participants. Eacii participant user would have a
`device 10 shown in FIG. i.
`cellular plione/PDA1GPS device may also enter one or more
`other fixed entities (buildings, fbeilities, restaurants, police
`Also shown on the display screen 16, specifically the geo-
`graphical display 16h, is a pair ofdïft'erent belting symbols
`stations, etc, and geo-refereneed events such as 'f tres, aeci-
`dents, etc.) into its database. 'ibis informationeantse likewise
`30 aoci 34, a small triangle and a sinall sqLlare, which are not
`transisiittecl to all die other participants ou tise commuiiïca-
`labeled. These symbols 30 suici 34 can represent conmiunica-
`tion net participants having cellular phones in the displayed 55
`tinos iset. The Issap, fixed entities, events and cellular phoise!
`geographical area that are part of the overall cellular piione
`PDA/GPS device coississunicatiots net participants' latitude
`communications net having the same device lO used in this
`and longitude information is related to the "x" and 'y" loca-
`tion on the touch screen display map by a mathematical
`invention. The latitude andlongitucle ofsymbol 30 is associ-
`correlation algorithm.
`stted within a database along sa'ith a specific phone number
`and, ifavailable, its IP address and email address. The screen so
`When the cellular phone/PDA/CfPS device user tises a sty-
`display 16h, which is a touch screen, provides x stud y eoor-
`lus or finger lo toucis one or niore of the symbols or a location
`displayed on the cellular pisosie niap display, the systeiss's
`dinates ofthe screen 16b to the CPU's software from a map in
`software causes the status and latitude and longitude iisfor-
`a geograpiiical database. The software has an algorithm that
`relates the x and y coordinates to latitude and longitude and
`mation concerning that symbol or loestionto be displayed. in
`can access a communications net participant's symbol or a ss
`order to hook ti symbol or "truck" such tts another net partici-
`pant which represents an entity on the geo-referenced map
`fixed or movable entity's symbol as being the one closest to
`display, or a fixed geographical entity such as a restaurant,
`that point.
`
`so
`
`35
`
`AGISTX_00005710
`
`

`

`Case 2:17-cv-00513-JRG Document 175-17 Filed 08/14/18 Page 12 of 20 PageID #: 7539
`
`US 7,630,724 B2
`
`5
`
`sible by identity and by location. Ihïs data is then displayed.
`pclïce station or a new entity cbservecl by a cell phone user
`which is discussed be1os'. the operator points at or near the
`\Vhen a request for data is received, a location search is matie
`location ofa geo-refèrenced symbol appearitig on the cellular
`and an indication ofthe closest track to the x, y position of the
`stylus is sent back lo the display screen and software appli-
`photieìPDA display that represents a specific track or specific
`participant or other entity. The hook applicatiosi software
`cation code wh.icii causes another shape to appear around tite
`unit and the data associated with the unit to he accessed.
`determines that the stylus is pointed close to or at the location
`of the symbol end puts a circle, square or other indication
`When the appliestion code receives s soft switch command to
`around the symbol indicating that amplification information
`plaice a phone call, the so:ftware uses the phone number (orlE
`concerning the track is to be displayed and indicating that
`address) associateci with the unit to place the call or to send
`additional cInta or cluige in cIato cati be iiiade to the indicated
`lo ciato.
`If a device receives a digital message that a call is being
`symbol. Tite hook application code then sends a message to
`the display application code to display the net participant,
`received, tite receiving tmit's application code places a box or
`fhcility or entity's amplifying data. The display application
`similar object around the transmitter symbol indicating who
`the call is f rom. When the call is answered, the application
`Code retrieves the primary data awl amplificatien data eon-
`ii software changes the visual characteristics of the box. in a
`cerning the track or entity from the database and displays the
`ïnfòrmatïon at the correct screen location. The operator can
`similar manner, witen a phone receives a digital text message,
`then read tite amplification data that relates to that specific
`photograph or video, a box appears aroi.md tite trsnsrnitter's
`symbol at the specific location. The cell phone operator can
`symbol indicating tite transmitter of the message. The poiitt to
`call network devices are participants and each one has a
`also select soft switches on the touch screen display to change
`the primary data and amplification cIato or to take actions
`20 similar device with the same software for use as a total par-
`which could include making cellular phone calls, conference
`ticiptint network. other situations forcalling theilities t