`INTERACTIVE REMOTE CELL PHONE
`TRANSMISSIONS AND DISPLAYSCOMMUNICATIONS
`
`BACKGROUND OF THE INVENTION
`
`This application is a continuation-in-part of U.S. Patent Application Serial No.
`5
`11/308,648612830
`filed on December 19, 2006 which is a continuation-in-part of U.S. Patent Application
`Serial No. 11/308,648 filed April 17, 2006 which is a continuation-in-part of U.S.
`Patent Application Serial No. 10/711,490 now U.S. Patent No. 7,031,728.
`
`10 1.
`
`Field of the Invention
`
`10
`
`A communications system usingand method that uses a plurality of cellular
`phones each having anPCs and PDA/cell
`
`integrated PDA and GPS receiverphones for the coordination of two or more people
`through the use
`
` of a communications
`
`network. The method and system and method provide each user with an integrateda PC or
`PDA/cell phone that has
`
`handheld cellular/PDA/GPS/phone that has advanced communication software
`application
`
`programs (hereinafter referred to as ACS) and databases used in conjunction with a
`remote
`
`server that enableforced message alert software that enables a user to control
`15
`the user's cell phone and to remotely control other users'create and send a voice or text
`message
`
`cellular/PDA phones to create a passive mode and partial shutdown.
`
`15 alert that forces an automatic acknowledgement upon receipt and a manual response
`from the
`
`recipient.
`
`2.
`
`Description of Related Art
`
`Apple Inc.
`Exhibit 1020
`Page 001
`
`
`
`
`
`The purpose of a communications system is to transmit information bearing digital
`
`messages from a source, located at one point, to a user destination, located at another point
`
`20 some distance away. A communications system is generally comprised of three basic
`
`elements: transmitter, information channel and receiver. One form of communication in
`
`recent years is cellular phone telephony. A network of cellular communication systems set up
`
`around an area such as the United States allows multiple users to talk to each other, either on
`
`individual calls or on group calls, with handheld devices. Some cellular phone services enable
`
`25
`25 a cellular phone to
` engage in conference calls with a small number of users.
`Furthermore, cellular conferenceFurthennore,
`
`Apple Inc.
`Exhibit 1020
`Page 002
`
`
`
`
`
`3
`2
`
`cellular conference calls can be established through 800 number services. Cellular telephony
`
`also now includes systems that include Global Positioning System (GPS) navigation that
`
`utilizes satellite navigation. These devices thus unite cellular phone technology with
`
`navigation information, computer information transmission and receipt of data.the
`
`ability to access local WiFi connections, allowing the devices to utilize cellular phone data
`
`transmission technology as well as the data transmission ability of the Internet.
`
`5 The method and operation of the communication devicesintegrated PDA/cell phones (cell
`
`phone/PDA/GPS with
`
`with touch screen) used herein areis described in U.S. Patent 7,031,728, which is hereby
`
`incorporated by reference and, pending U.S. Patent Application Serial No. 11/308,648, and
`
`pending U.S. Patent Application Serial No. 11/612,830, and are usually discussed herein as
`
`a cell phone.
`
`10
`
`In many situations it is desirable for a user to be able to simultaneously send a message
`
`to the cell phones or PCs of a large group of people. This can be typically accomplished
`
`using Digital SMS (Smart Message Service) and TCP/IP messages that are transmitted
`
`using cellular technology such as the various versions of GSM and CDMA or via a WiFi
`
`local area network. However, in some situations it is additionally desirable to know: (a)
`
`which people received the
`
`It is desirable in certain specific communication networks such as military or police
`
`to:
`10 (a) enable each network participant having a cell phone that provides other participants
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 003
`
`
`
`
`
`with ongoing information such as location
`
`4
`
`to stop reporting and transmitting to
`
`other participants messages and to go into a listen only passive mode for transmission
`
`silence and (b) provide each cell phone the ability to quickly destroy its message location
`
`processing and/or display software in case of capture. Furthermore, it is desirable for a
`
`commander's cell phone to be
`
`15 able to remotely control one or more of the cell phones operating in the entire network
`
`to: (a)message on their cell phone or PC, (b) which people did not receive the message on
`
`their cell
`
`cause another busy phone to interrupt and to accept a voice call, (b) force a phone to
`
`accept an incoming call, and (c) quickly disable or destroy a remote phone's message
`
`location processing and/or display software in case of capture.
`
`phone or PC, and (c) the response of each person receiving the message. Digital SMS and TCP/IP
`
`messages do not provide each of those functions. As a result, what is needed is a method in
`
`which a sender of a text or voice message can force an automatic acknowledgement upon
`
`receipt from a recipient's cell phone or PC and a manual response from the recipient via
`
`20
`
`the recipient's cell phone or PC when sending the text or voice message.
`
`Apple Inc.
`Exhibit 1020
`Page 004
`
`
`
`
`
`-
`
`
`
`SUMMARY OF THE INVENTION
`
`Applicant's communication system and method described herein is embodied in the
`
`advanced communicationforced alert software (ACS) application programs developed by
`
`applicant and. installed in the PCs and PDA/cell phones
`
`5
`
`installed in the integrated PDA/GPS cell phones used herein.
`A plurality of cellular phone/PCs and PDA/GPS devicescell phones each having ACS
`
`application programs and databases provideforced alert software installed providing a
`
`communication network in conjunction with a remote server dedicated to the
`
`communication network of cell phone devicesof PCs and PDA/cell phones with the ability
`
`to: a) selectively poll each of the other PDA/GPS cell phone devices requiring each
`
`participantallow an operator to create and transmit (via TCP/IP or another digital
`
`transmission means) a forced voice alert, wherein said forced voice alert is comprised of a
`
`text or voice message file and a
`
`10 forced alert software packet, from a sender PC or PDA/cell phone to one or more recipient
`
`PCs and PDA/cell phones within said communication network; (b) automatically
`
`transmit an acknowledgement of receipt from said recipient PCs and PDA/cell phones to
`
`the sender PCs or PDA/cell phones upon receipt of the forced message alert by the
`
`recipient PCs and PDA/cell phones; (c) periodically reseed the message to the recipient
`
`PCs and PDA/cell
`
`15 phones that have not sent an acknowledgement until an acknowledgement is received from
`
`every recipient PC and PDA/cell phone; (d) provide an indication on the display of the
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 005
`
`
`
`
`
`sender PC or PDA/cell phone of which
`
`-
`
`
`
`recipient PCs and PDA/cell phones have
`
`acknowledged the forced message alert; (e) provide a manual response list on the display
`
`of the recipient PC and PDA/cell phone's display that can only be cleared by manually
`
`selecting and transmitting a
`
`20 response from the list or recording and transmitting a voice response after sending said
`
`automatic acknowledgment; and (f) provide an indication on the sender PC or PDA/cell
`
`phone
`
`10 phone to start automatically reporting its position and status information to all or selected
`
`users equipped with the same cellular phone/PDA software devices in the communications
`
`net so that each of the phone devices exchange location, status and other information, (b)
`
`remotely control from one cellular phone/PDA/GPS any of the other cellular
`
`phone/PDA/GPS systems phones including the ability to control remote cellular phones,
`
`place return calls, place calls to
`
`15 another phone number, vibrate, execute text to speech software, change sound intensity,
`
`and
`
`remotely control software and functions resident on the remote phones, (c) display remote
`
`phone information by touching the user phone display screen depicting remote phone's
`
`location on the PDA user display, (d) make calls to or send data to remote phones by
`
`touching their display symbols and selecting the appropriate user phone displayed soft
`
`switch; (e) layer
`
`20 a sufficient number of switches or buttons on the PDA display to perfoiin the above
`functions
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 006
`
`
`
`
`
`
`without overlaying the map; and (f) change the nomenclature of a series of soft switches
`
`-
`
`for different operating environments.
`
`of the status the manual response and the content of the manual response from each
`
`recipient PCs and PDA/cell phones.
`
`A communication network server actscan act as a forwarder for TCP/IP
`
`communications between any combination of PC users or PDA/cell phone/PDA users and/or
`
`PC based users. Network participant users. The server can also act as a
`
`5
`
`location, identity and status messages are sent to the server by each network participant or
`
`user
`
`phone device. Network participant entered tracks are also sent to the server. Because this
`
`data is of interest to all the network participants, the server forwards the data received
`
`from one participant to all other participants, thus providing the information necessary for
`
`all network participants to know the identity, location and status of all other network
`
`participants.
`
`105 The server also acts as a forwarder of data addressed from one participant to one or more
`
`addressed participants, thus
`
`permitting the transmission of freeforced text, preformatted or voice messages, other
`
`messages, photographs, video, E-mail and URL data from one network participant to other
`
`Apple Inc.
`Exhibit 1020
`Page 007
`
`
`
`
`
`selected network participants.
`
`-
`
`
`
`The above functions can also be accomplished using peer to peer WiFi, WiMax or
`15 other peer to
`10 peer communications. However, for use with cellular communications and to assure the level
`
`
`
`of security that cell phone companies require, a centralized static IP routable server is used. It is the object of
`
`this invention provide to a method in which by sending a forced text or voice message to a recipient or a
`
`group of recipients, a sender can compel an automatic acknowledgement of receipt from each recipient's
`
`PC or PDA/cell phone and require a manual
`
`The IP server also fills another role of being a database from which data can be
`
`requested by network participants (i.e. maps, satellite images, etc.) or can be
`
`pushed to
`
`20 network participants (i.e. symbology and soft switch changes, etc.).
`
`Apple Inc.
`Exhibit 1020
`Page 008
`
`
`
`
`
`- 5
`
`It is an object of this invention is to enable each participant in the communications
`
`net to poll the other net participants to report or cease reporting their locations, identity
`
`and status on the communication net.
`
`It is another object of this invention to provide and enable each participant in
`
`the
`5 communications net to select an ACS software switch that directs each participant's cell
`
`phone
`
`software to limit the application to receive messages only at the cell phone thus making it
`
`passive.
`
`Another object of the invention is to provide a communication system having a
`
`plurality of individual cell phones that allow an operator of one cell phone to remotely
`
`control
`
`10 any of the other cell phone/PDA system phones including the ability to: (a) control remote
`
`cellular phones that cause another phone to automatically accept a voice call, (b) select a
`
`soft switch that destroys the message location processing software of the remote phone
`
`and to activate a microphone so conversations can be monitored, (c) remotely turn off and
`
`turn on the specific message location processing and/or display software in the remote
`
`phone and (d)
`
`15 remotely cause aresponse from the recipient via the recipient's cell phone to destroy
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 009
`
`
`
`itsbefore the message location processing and display softwarecan be cleared.
`In accordance with these and other objects which will become apparent hereinafter, the
`
`instant invention will now be described with particular reference to the accompanying
`
`drawings.
`
`
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 010
`
`
`
`
`
`1
`
`
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`Figure la shows a front planelevational view of a cellular phone/an integrated
`PDA/GPScell phone having a touch screen
`
`touch screen that includes ACSforced message alert software described herein.
`
`Figure lb shows a flow chart that provides a method of calling a remote cell phone byexplains
`the device shown in Figure 1 a.
`
`5 hooking a symbol representing the remote user and selecting the CALL soft switch
`and
`
`causing a remote phone to make a call.
`5 Figure 2a shows a flow chart that provides a method to the user to preclude the user'sthe
`
`installation and set up of the forced message alert software on a
`
`communication network of cell phones, integrated PDA/cell phones, and PCs.
`
`own cell phone transmissions.
`
`Figure 2b shows a flow chart of a user method to disable the user's own cell
`
`phone
`
`10 message location processing display software.
`Figure 2c3A shows the first section of a flow chart showing a user method to destroy
`
`the user's own cell phone processing and display software.process of sending a forced
`
`Apple Inc.
`Exhibit 1020
`Page 011
`
`
`
`
`
`
`
`message alert to one or more recipients as
`
`1
`
`
`
`well as for ascertaining which recipients
`
`received the forced message alert and which recipients responded to the forced message
`
`alert.
`
`10
`
`Figure 3aB shows the second section of a flow chart of a user method to transmit a
`
`digital message to a remote cell phone to turn off the remote cell phone's display.showing
`
`a process of sending a
`
`15
`
`Figure 3b shows a flow chart of a method for a user cell phone to transmit a digital
`
`message to a remote cell phone to destroy the remote cell phone's message location
`
`processing and display software.
`
`forced message alert to one or more recipients as well as for ascertaining which recipients
`
`received the forced message alert and which recipients responded to the forced message
`
`alert.
`
`Figure 4 shows a flow chart showing a process of receiving a forced message alert
`
`as well as providing an acknowledgment of receipt and a response by the recipient.
`
`15
`
`Apple Inc.
`Exhibit 1020
`Page 012
`
`
`
`
`
`13
`
`PREFERRED EMBODIMENT OF THE INVENTION
`
`A method and communication system and method that joins participants in a
`
`communications network using personal computers ("PC") and handheld cell phones having
`
`integrated PDA and GPS circuitry with ACS
`
`5 personal digital assistant ("PDA/cell phone") with a forced message alert software
`
`application programs that allow a participant having an Advanced Communications
`
`Software
`
`(ACS) equipped cell phone to activate and control other participants' remote cell
`
`phones/PDAs that contain ACS.
`
`program that allows a participant to send a text or voice message to a group of people and
`
`force an automatic acknowledgment of receipt and a manual response.
`
`Each PDA/cell phone described herein for the participant network has its own
`
`individual on/off power and can function just as any other cell phone. It can also function with
`
`its PDA
`
`10 with its PDA. To operate on the network, obviously the PDA/cell phone power switch has
`
`to
`
` 10
`
`and GPS systembe on. If the PDA/cell phone is completely turned off, then it is
`
`not part of the participating network and cannot send or receive any forced message alerts.
`
`In addition to its own on and off power switch, it has another switch thatthe forced message
`
`alert software application program that is activated manually when preparing to send a
`
`text or voice message or is activated automatically when
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 013
`
`
`
`
`
`14
`
`activates the ACS advanced communication software programs resident in each cell phone
`
`including the special databases that provide all the other participants' telephone
`
`numbers, Email addresses and other information necessary to carry on the communications
`
`described herein. To operate the network, obviously the cell phone power switch has to be
`
`on. If the
`
`15 receiving a forced message alert from another PC or PDA/cell phone.
` 15
`cell phoneEach PC described herein is like any other contemporary PC,
`
`except that it has the forced message alert software application program installed on it. To
`
`operate on the network, obviously the PC must be on and have an active connection to the
`
`Internet or other digital transmission means. If the PC is completely turned off, then it is
`
`not part of the participating network.
`
`20 network and cannot send or receive any forced message alerts. The forced message alert
`
`software application program on the PC is activated manually when preparing to send a
`
`text or
`
`Apple Inc.
`Exhibit 1020
`Page 014
`
`
`
`
`
`15
`
`voice message or is activated automatically
`
`when receiving a forced message alert
`
`from another PC or PDA/cell phone.
`
`The communication system also includes a server that acts as a forwarder for lipIP
`
`communications between any combination of PDA/cell phone/PDA users and/or PC based
`
`users..
`
` 5 Network participant location, identity and status messages are sent to the server by each user.
`
`The users are the network participants. Network participant entered tracks are also sent to the
`
` 20
`
` server. Because this data is of interest to all the network participants, the server
`
`forwards the data received from one participant to all other participants, thus providing the
`
`information
`
`
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 015
`
`
`
`
`
`-
`
`necessary for all network participants to know the identity, location and status of all other network
`
`participants.
`
`10 network participants. In addition, the server keeps all of the network participants updated
`
`on
`
`The sewer information kept in its databases, such as all of the participants' telephone
`
`numbers, E-mail addresses and other information necessary to carry on the communications
`
`described herein. The server also acts as a forwarder of data addressed from one participant to one
`
`or more addressed participants, thus permitting the transmission of free text, prefonnatted
`
`5forced message alerts, other 15 text and voice messages, photographs, video, E-mail and URL
`
`data from one network participant to other selected network participants.
`
`The above functions can also be accomplished using peer to peer WiFi, WiMax, or other
`
`peer to peer communications. However, for use with cellular communications and to assure the
`
`level of security that cell phone companies require, a centralized static IP mutable
`
`routable 10
`
`server is used.
`
`The P sewer also fills another role of being a database from which data can
`
`be
`
`requested by network participants (i.e. maps, satellite images, etc.) or can be
`pushed to
`
`network participants (i.e. symbology and soft switch changes, etc.).
`20 Referring now to the drawings and, in particular, Figure la and lb, a small handheld cellular
`
`15cellular phone 10 is shown that includes a personal digital assistant (PDA) and a global
`
`positioning system receiver (GPS) communications devicePDA integrated in housing 12 that
`
`includes an
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 016
`
`
`
`17
`
`on/off power switch 19, a microphone 38, and an LCD display 16 that is also a touch screen
`
`system. The small area 16a is the navigation bar that depicts the telephone, GPS and other
`
`status data and the active software. Each cell phone includes a CPU and databases that store
`
`information20
`
` useful in the communication network. The CPU also includes a symbol
`
`generator for creating touch screen display symbols discussed herein. With the touch
`
`screen 16, the screen symbolsdata can be
`
`
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 017
`
`
`
`
`
`are5
`
`-
`entered through GPS inputs or by the operator using a stylus 14 (or operator finger)
`
`
`by manipulatively directing
`
`the stylus 14 to literally touch display 16. The softSoft switches 16d displayed on the display 16
`
`are likewise activated by using a stylus 14 and physically and manipulatively directing the stylus
`
`to literally touch display 16. The display x, y coordinates of
`
`5
`
` the touched point are
`
`known by a CPU in the PDA section of the communication system in housing 12 that can
`
`coordinate
`
`10 various information contained in the PDA relative to the x, y coordinate position on the display
`
`16. Inside housing 12 is contained the conventional cellular phone elements including a modem,
`
`a CPU for use with a PDA and associated circuitry connected to speaker 24 and microphone 38.
`
`A GPS navigational receiver that receives signals
`
`
`
`10
`
`from satellites that can determine the latitude and longitude of the cellular phone
`
`housing 12
`
`can be internal or external to the housing 12. Conventional PDA/cellular phones are currently
`
`on sale and sold. as a unit (or with an external connected GPS) that can be used for cellular
`
`telephone calls and sending cellular SMS and TCP/IP or other
`
`15 messages using the PDA's display 16 and computer (CPU). The GPS system including a receiver
`
`in housing 12 is
`
`15 capable of determining the latitude and longitude and through SMS, TCP/IP, WiFi or
`
`other
`
`digital messaging software, to also transmit this latitude and longitude information of
`
`housing 12 to other cellular phones in the communication network via cellular
`
`communications, WiFi or radio. The device 10 includes a pair of cellular phone hardware
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 018
`
`
`
`-
`activating buttons 20 to turn the cellular phone on and 22 to turn the cellular phone off.
`
`
`Navigation pad actuator 18 is 20
`
` similar to a joy or force stick in that the actuator 18
`
`manually provides movement commands that can be used by the PDA's software to move a
`
`cursor on display 16. Switches 26 and 28
`
`
`
`
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 019
`
`
`
`
`are designed to quickly select an operator
`
`- 20 -
`
`specified
`
`20 network software program. Speaker 24 and microphone 38 are used for audio messages.
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 020
`
`
`
`
`
`21
`
`Switch 19 at the top left of device 10 is the
`
`power on and power off switch for the
`
`entire device.
`
`The heart of the invention lies in the applicant's ACSforced message alert software
`
`application programsprogram provided in each PC or PDA/cell phone. The forced message
`
`alert software
`
` 5
`
`each cell phone/PDA device. The ACS programs are activated by clicking on an icon on
`
`the
`
` 5
`
`application program is activated through use of a screen drawn soft switch or by
`
`clicking on an
`
`icon on the PC or PDA/cell phone/PDA display screen to turn the ACS programs on or off.
`
`Mountedor when a forced message alert transmission is received by another PC or
`
`PDA/cell phone. The display 16 is mounted within the housing 12 as part of the PDA is the
`
`display 16 and the CPU (not shown). The internal CPU includes databases and software
`
`application programs that provide for a geographical map and georeferenced entities
`
`10 that are shown as display portion 16b that includes as part of the 10
`
` display various areas of
`
`interest in the particular local map section.
`
`When looking at display 16, the software switches (soft switches) which appear at the
`
`very bottom of the display 16d are used to control by touch many of the software driven
`
`functions of the cellular phone and PDA/cell phone. The soft switches are activated through
`
`the operator's use of
`
`15 the navigation pad 18, or a small track ball, force stick or similar hardware
`
`15
`
` display
`
`cursor pointing device. Alternatively, the operator may choose to activate the software switches
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 021
`
`
`
`
`
`by touching the screen with a stylus 14 (or
`
`22
`
`finger) at the switches' 16d locations. When
`
`some of the software switches are activated, different software switches appear. The bar display
`
`16d shows the software switches "ZM IN (zoom in)," "ZM OT (zoom out)," "CENT (center)"
`
`and
`
`20
`
`"GRAB (pan/grab)" at the bottom of the screen. These software switches enable the operator
`
`20 the operator to performto perfo
`switch at the lower right causes a
`
`i these functions. The "SWITH (switch)" software
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 022
`
`
`
`layered software switches (soft
`
`- 23 -
`
`switches) to appear above the bottom
`
`
`matrix of
`
`
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 023
`
`
`
`
`
`- 24 -
`
`row of switches. Through use of the software switches, the operator can also manipulate the
`
`geographical map 16b or chart display. When looking at Figure la, display symbols depict
`
`permanent geographical locations and buildings are shown. For example, the police station is
`
` 5
`
`shown and, when the symbol is touched by the stylus or finger, the latitude and longitude of
`
`the symbol's location, as shown in display section 16c, is displayed at the bottom left
`
` 5
`
`of the
`
` screen. The bottom right side of display 16c is a multifunction inset area that can contain a
`
`variety of information including: a) a list of the communication link participants; b) a list of
`
`received messages; c) a map, aerial photograph or satellite image with an indication of the
`
`10 zoom and offset location of the main map display, which is indicated by a square that depicts
`
`10 the area actually displayed in the main geographical screen 16b; d) applicable status
`
`information; and e) a list of the communication net participants. Each participant user would
`
`have a device 10 shown in Figure la and lb.
`
`Also shown on the display screen 16, specifically the geographical display 16b, is a
`15 pair of different looking symbols 30 and 34, a small triangle and a small square, which are not
`
`15 labeled. These symbols 30 and 34 can represent communication net participants having
`
`cellular phones in the displayed geographical area that are part of the overall cellular phone
`
`communications net, each participant having the same device 10 used. The latitude and longitude
`
`of symbol 30 is associated within a database with a specific cell phone number and,
`
`20 if available, its IP address and E-mail address. The screen display lob16b, which is a touch
`
` 20
`
` screen, provides x and y coordinates of the screen 16b to the CPU's software from a
`
`map in a
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 024
`
`
`
`
`
`geographical database. The software has an algorithm that relates the x and y coordinates to
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 025
`
`
`
`
`
`- 26 -
`
`geographical database. The software has an algorithm that relates the x and y coordinates to
`
`latitude and longitude and can access a communications net participant's symbol or a fixed or
`
`movable entity's symbol as being the one closest to that point.
`
`In order to initiate a telephone call to the cellularPDA/cell phone user
`
`(communication net 5 participant) represented by symbol (triangle) 30 at a specific latitude
`
`and longitude displayed
`
` 5
`
`
`
`on chart 16b, the operator touches the triangle 30 symbol with the stylus 14. The
`
`operator then touches a "call" software switch from a matrix of displayed soft switches that
`
`would overlay the display area 16c. Immediately, the cellularPDA/cell phone will initiate a
`
`cellular telephone call to the cellularPDA/cell phone user at the geographical location shown
`
`that represents symbol 30. A 10 second cellularPDA/cell phone user (communication net
`
`participant) is represented by symbol 34 which10 is a small square (but could be any shape or
`
`icon) to represent an individual cellular phone device in the display area. The ring 32 around
`
`symbol 30 indicates that the symbol 30 has been touched and that a telephone call can be
`
`initiated by touching the soft switch that says "call." When this is done, the telephone call is
`
`initiated. Other types of symbolic elements on
`
`15
`
`the display 16 can indicate that a cellular phone call is in effect. Additionally, the operator
`
`can15 touch both symbol 34 and symbol 30 and can activate a conference call between the two
`
`cellular phones and users represented by symbols 30 and 34. Again, a symbolic ring around
`
`symbol 34 indicates that a call has been initiated.
`
`Equally important, an operator/user with a PDA/cell phone call the police station or
`20 any other specific geographical facility displayed on the cell display map, including: buildings,
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 026
`
`
`
`
`
`20 locations of people, vehicles, facilities, restaurants, and the like, whose cellularPDA/cell
`
`phone
`
`Apple Inc.
`Exhibit 1020
`Page 027
`
`
`
`
`
`- 28 -
`numbers and, if available, E-mail addresses, IP addresses and their URLs are previously
`
`
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 028
`
`
`
`
`
`- 29 -
`
`stored in the database, by touching a specific facility location on the map display using the stylus
`
`14 and then touching the cellular phone call switch. As an example, the operator/user can touch
`
`and point to call a restaurant using a soft switch by touching the restaurant location
`
` 5 on the display with a stylus and then touching the call soft switch. The cellular phone will then
`
` 5
`
`call the restaurant. Thus, using the present invention, each participant can touch and
`
`point to
`
` call to one or more other net participants symbolically displayed on the map, each of whom
`
`has a device as shown in Figure la and can also point to call facilities and regular phone numbers
`
`that had been previously stored in the phone's database. Furthermore, this symbol
`
`10 hooking and soft switch technique can be used to go to a fixed facility's website or to 10
`
`
`
`automatically enter the fixed facility's E—mail address in an e-mail.
`
`Each cellular phone/PDA/GPScell phone user device is identified on the map display
`
`of the other participants users' phone devices by a display symbol that is generated on each user
`
`phone display to indicate each user's identity. Each symbol is placed at the correct geographical
`
`15 location on the user display and is correlated with the map on the display. The operator of15 each
`
`cellular phone/PDA/GPScell phone device may also enter one or more other fixed entities
`
`(buildings, facilities, restaurants, police stations, etc.) and geo-referenced events such as fires,
`
`accidents, or other events into its database. This information can be likewise transmitted to all
`
`the other participants on the communications net. The map, fixed entities, events and cellular
`
`phone/PDA/GPScell phone
`
`20 device communication net participants' latitude and longitude information is20 related to the
`
`"x"
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 029
`
`
`
`
`
`- 30 -
`and "y" location on the touch screen display map by a mathematical correlation algorithm.
`
`
`
`Apple Inc.
`Exhibit 1020
`Page 030
`
`
`
`
`
`- 31 -
`
`When the cellular phone/PDA/GPScell phone device user uses a stylus or finger to touch
`
`one or more of the symbols or a location displayed on the cellular phone map display, the system's
`
`software causes the status and latitude and longitude information concerning that symbol or
`
`location to be displayed. In order to hook a symbol or "track" such as another net participant which
`
`5 which
`
`represents an entity on the geo-referenced map display, or a fixed geographical entity
`
`such as a
`
`restaurant, police station or a new entity observed by a cell phone user which is discussed below,
`
`the operator points at or near the location of a geo-referenced symbol appearing on the cellular
`
`phone/PDA/cell phone display that represents a specific track or specific participant or other
`
`entity. The hook application software determines that the stylus is pointed close to or at the
`
`location
`
`10
`
`close to or at the location of the symbol and puts a circle, square or other indication around the
`
`symbol indicating that
`
`amplification information concerning the symbol is to be displayed and indicating that additional
`
`data or change in data can be made to the indicated symbol. The hook application code then sends
`
`a message to the display application code to display the net participant, facility or entity's
`
`amplifying data. The display application code retrieves the primary data
`
`15 primary data and amplification data concerning the symbol or entity from the database and
`
`displays the information at the correct screen location. The operator can then read the
`
`amplification data that relate