(12) United States Patent
`Zeitfuss et al.
`
`(10) Patent N0.:
`(45) Date of Patent:
`
`US 6,833,811 B2
`Dec. 21, 2004
`
`US006833811B2
`
`(54) SYSTEM AND METHOD FOR HIGHLY
`ACCURATE REAL TIME TRACKING AND
`LOCATION IN THREE DIMENSIONS
`
`(75) Inventors: Michael P. Zeitfuss, Satellite Beach,
`_
`FL ms)’ Joseph M‘ Nemethy> West
`Melbqurne, FL(US); Joseph A-
`Venella, Melbourne, FL (Us)
`
`(73) Assignee: Harris Corporation, Melbourne, FL
`(US)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U_S_C_ 154(k)) by 0 days
`
`(21) Appl. No.: 10/265,757
`(22) Filed:
`Oct- 7’ 2002
`
`(65)
`
`Prior Publication Data
`
`US 2004/0066329 A1 Apr. 8, 2004
`7
`
`3/2002 Jain et al.
`6,360,234 B2
`3/2002 Goebel et al. .............. .. 342/64
`6,362,775 B1
`7/2002 Chadwick et al. ........ .. 342/465
`6,421,010 B1
`9/2002 Dickson et al.
`6,445,983 B1
`10/2002 Kllshnaswamy
`6’463’180 B1
`6,480,789 B2 * 11/2002 Lin .......................... .. 701/301
`6,516,099 B1
`2/2003 Davison
`6,552,681 B1 * 4/2003 Hayward etal. .... .. 342/357.06
`6,567,980 B1
`5/2003 Jain et al.
`6,597,818 B2
`7/2003 Kumar et al.
`6,681,231 B1
`1/2004 Burnett
`2001/0038718 A1 11/2001 Kumar et al.
`2002/0035451 A1
`3/2002 Rothermel
`2002/0055924 A1
`5/2002 Liming
`2002/0118224 A1
`8/2002 Le‘fanon et a1~
`2002/0183072 A1 12/2002 Steinbach et al.
`2003/0050927 A1
`3/2003 Hussam
`2004/0008866 A1
`1/2004 Rhoads et al.
`
`FOREIGN PATENT DOCUMENTS
`WO 01/41000
`6/2001
`WO 01/98925
`12/2001
`
`W0
`W0
`
`OTHER PUBLICATIONS
`
`
`
`E23 312%. 1iiiiiiiiiiiiiiiiiiiiiiiii1534955169,‘?32252? 701/213
`
`
`
`66059919919 Solutions from S91’ 9099 * cited by examiner
`
`(58) Field of Search .......................... .. 342/352, 357.01,
`342/357.06, 357.07, 357.12; 701/207, 213,
`215
`
`Primary Examiner—Dao Phan
`(74) Attorney, Agent, or Firm—Sacco & Associates, PA
`
`(56)
`
`References Cited
`
`(57)
`
`ABSTRACT
`
`U_S_ PATENT DOCUMENTS
`
`5,450,329 A * 9/1995 Tanner ..................... .. 364/449
`5,528,518 A
`6/1996 BFadShaW et a1‘
`5’873’056 A
`2/1999 Llddy et a1‘
`5,971,595 A 10/1999 Grant et al.
`6,161,105 A 12/2000 Keighan et a1‘
`6,173,287 B1
`H2001 Eberman et aL
`6,195,122 B1
`2/2001 Vincent
`6,222,482 B1
`4/2001 GueZiec
`6,253,239 B1
`6/2001 Shklar et al.
`6,281,797 El * 8/2001 Forster et al- --------- -- 340/5723
`62827362 B1
`8/2001 Murphy et a1~
`
`6:304:864 B1
`6,307,573 B1
`6,327,533 B1
`
`10/2001 Liddy et al.
`10/2001 Barros
`12/2001 Chou
`
`A method and system for tracking an object by generating
`GPS coordinates for the object and a bearing associated With
`a movement of the Object The GPS Coordinates include a
`latitude, a longitude, and an altitude, Which are processed.
`The GPS coordinates can be processed to correlate the
`.
`.
`.
`.
`.
`.
`.
`altitude of the object With an identi?er that identi?es a level
`Within a structure. An icon representing the object then can
`be accurately located in a ?rst vieW of a three dimensional
`model. An indicator can be associated With the icon to
`indicate the object’s level, a bearing of the object, and/or the
`object’s GPS coordinates. The object’s GPS coordinates can
`be compared With a second object location to determine
`dispatch instructions. The object can be a person, a vehicle,
`Watercraft or an alrcra?'
`
`19 Claims, 2 Drawing Sheets
`
`2119
`
`Generate GPS
`mordlnales
`
`205
`
`Process GPS
`coordiiiaus
`
`(‘m-relate Iltliilde
`with :Iriiclun'.
`
`Locate in a an site
`model in icon
`rspresmling 6mm
`
`Ruiz Food Products, Inc.
`Exhibit 1010
`
`

`

`U.S. Patent
`
`Dec. 21, 2004
`
`Sheet 1 0f 2
`
`US 6,833,811 B2
`
`User interface
`
`Tracking and Location
`Software
`3D Site
`Model
`
`Wireless
`|
`Y
`Ambulance
`GPS
`
`fl50
`
`I25
`
`Fig. 1
`
`EMT
`
`/ 155
`
`GPS
`
`I25
`
`Fire Truck f 140
`GPS
`\
`125
`
`Wiyq1§$5~
`
`\ "/6 \‘P"
`
`\
`A
`Fire Fighter /' I45
`GPS
`w
`125
`
`Police Cruiser
`GPS
`
`125
`
`Police Officer
`GPS
`\
`125
`
`Ruiz Food Products, Inc.
`Exhibit 1010
`
`

`

`U.S. Patent
`
`Dec. 21, 2004
`
`Sheet 2 0f 2
`
`US 6,833,811 B2
`
`Receive GPS data
`I 305
`and bearing data
`for multiple objects
`
`l
`
`Compare object locations and
`“10
`bearings to determine which
`object is best suited to be f 3
`dispatched in response to a
`crisis
`
`Dispatch object
`best suited to f 315
`respond
`
`Fig. 3
`
`Generate GPS f 205
`coordinates
`
`l
`
`GPS coordinates
`transmitted to‘ computer I 210
`having tracking and
`location software
`
`l
`
`Process GPS /. 215
`coordinates
`
`Correlate altitude
`with structure
`level
`
`f 220
`
`i
`
`Locate in a 3D site
`model an icon
`representing object
`
`,. 225
`
`Fig. 2
`
`Ruiz Food Products, Inc.
`Exhibit 1010
`
`

`

`US 6,833,811 B2
`
`1
`SYSTEM AND METHOD FOR HIGHLY
`ACCURATE REAL TIME TRACKING AND
`LOCATION IN THREE DIMENSIONS
`
`BACKGROUND OF THE INVENTION
`
`1. Statement of the Technical Field
`The present invention relates to the ?eld of geographic
`information systems (GIS) technology, and more particu
`larly to a representation of an object being tracked in a
`three-dimensional geographic model.
`2. Description of the Related Art
`Computer-based object tracking systems have become
`available to provide object location and tracking informa
`tion. For example, Automatic Vehicle Location (AVL) sys
`tems are available that utiliZe a Global Positioning System
`(GPS) to obtain data that can be used to monitor a vehicle
`location. The vehicle location data can be presented to a user
`at a monitoring station, typically via a computer interface.
`The user can monitor the vehicle location from the moni
`toring station.
`In addition to a monitoring station, a typical AVL system
`commonly includes mobile units, a Wireless communication
`netWork, and a computer system incorporating geographic
`information systems (GIS) technology. A mobile unit is a
`device that can be installed in a vehicle to enable the vehicle
`to be monitored and tracked, and typically includes a GPS
`receiver and a Wireless transmitter. The mobile unit receives
`positioning signals from GPS satellites in the form of code
`sequences and converts these code sequences to pseudo
`range information or standard GPS code (NMEA). Pseudo
`ranges from a minimum of four different satellites are
`required in most instances for position calculation. These
`pseudo ranges or NMEA codes are subsequently transmitted
`via the Wireless netWork to the monitoring station for
`position calculation.
`The computer system incorporating GIS technology is
`usually equipped and con?gured to process GPS data and to
`monitor vehicle locations. The computer system performs
`?ltering of the pseudo range signals or raW GPS data
`transmitted from the mobile units and further reduces these
`ranges into map coordinates for display. Current systems
`may also perform position corrections by using differential
`continuous positioning system (CPS) data obtained from a
`station in the vicinity of the vehicle being monitored.
`Most conventional systems using GIS technology process
`GPS data according to tWo-dimensional (2D) spatial refer
`ences. Still, conventional GIS technologies can be con?g
`ured to process topographic data, in addition to rudimentary
`2D data, usually in the form of a digital elevation model.
`Based upon the topographic data, isometric vieWs and
`contour maps can be generated. Tracking system users,
`hoWever, have recogniZed the limitations of a 2D modeling
`paradigm for modeling three-dimensional (3D) phenomena,
`even When combined With topographic data.
`Notably, some GIS technologies can integrate scene gen
`eration systems for the 3D visualiZation of data, but the
`elevation coordinate data in these systems has been included
`only to “drape” a tWo-dimensional mapping over topo
`graphic data to produce What is knoWn as a 25D model.
`Importantly, the use of a 25D model ought not to be
`confused With 3D. The elevation information in a 25D
`model is limited to the pre-determined elevation data for a
`geographic surface, such a road. Accordingly, application of
`25D models is primarily limited to monitoring motor
`vehicles and the like.
`
`10
`
`25
`
`35
`
`40
`
`45
`
`55
`
`65
`
`2
`Notably, in a 25D, one elevation is typically assigned for
`an entire structure. Hence, ?oors in multilevel structures,
`such as high rise of?ce buildings and apartment buildings,
`cannot be accurately represented in a 25D model.
`Accordingly, the current tracking technology does not pro
`vide a means for tracking personnel, for eXample ?re
`?ghters, as the personnel travel betWeen ?oors in a multi
`level structure. Further, current tracking technology cannot
`provide accurate 3D images from various perspectives
`Within a scene, for eXample, the vieW of a bank from the
`perspective of a police of?cer positioned on the roof of a
`building located across the street from the bank.
`
`SUMMARY OF THE INVENTION
`
`The present invention relates to a method and a system for
`tracking and locating objects and representing those objects
`as icons Within a highly accurate three-dimensional (3D)
`model. The present invention tracks an object, such as a
`person, a vehicle, or an aircraft, by generating GPS coordi
`nates for the object and a bearing associated With a move
`ment of the object. In particular, the GPS coordinates
`include a latitude, a longitude, and an altitude. Importantly,
`the GPS coordinates can be processed to correlate the
`altitude of the object With an identi?er that identi?es a level
`Within a structure. An icon representing the object then can
`be accurately located in a ?rst vieW of a three dimensional
`model. Further, an indicator can be associated With the icon
`to indicate the object’s level, a bearing of the object, and/or
`the object’s GPS coordinates.
`The GPS coordinates of the object also can be compared
`With a location of a second object to generate a comparison.
`The comparison can be processed to determine the content
`of a communication that is transmitted to the object, for
`eXample a dispatch message. The communication can be
`transmitted Wirelessly to the object and can be encrypted
`prior to being transmitted. The object can be a person, a
`vehicle, a Watercraft or an aircraft. Lastly, biological
`statistics, mechanical statistics, fuel level, speed, velocity
`and other parameters of the object can be monitored.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a block diagram of a system for tracking and
`locating objects Within a highly accurate three dimensional
`model in accordance With the present invention.
`FIG. 2 is a How chart for tracking and locating objects
`Within a highly accurate three dimensional model in accor
`dance With the present invention.
`FIG. 3 is a How chart for providing dynamically adjusted
`computer aided dispatch based on object location in accor
`dance With the present invention.
`
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENTS
`
`The present invention relates to a method and a system for
`tracking and locating objects and representing those objects
`as icons Within a highly accurate three-dimensional (3D)
`model. Importantly, the movements of various objects
`throughout an area can be monitored. For eXample, the
`locations and movements of police cruisers, helicopters,
`rescue vehicles, and personnel can be continually monitored
`throughout a city. More importantly, resources, such as
`personnel, can be accurately tracked When traveling through
`a city and, in particular, Within multilevel structures. For
`eXample, ?re ?ghters can be precisely located, tracked and
`monitored as they move about Within a high rise structure
`
`Ruiz Food Products, Inc.
`Exhibit 1010
`
`

`

`US 6,833,811 B2
`
`3
`during a structure ?re. Further, police officers can be tracked
`as they give vehicle or foot chase to a criminal, for example
`in a multilevel parking garage.
`In another arrangement of the present invention, accurate
`3D images from the perspective of an object being tracked
`can be presented to a user. During a bank robbery, for
`example, a supervisor can vieW the bank from perspective of
`a police of?cer positioned on a roof near the bank. The
`perspective of other police of?cers at different positions
`around the bank also can be presented to the supervisor for
`improved situational aWareness. Accordingly, supervisors
`and dispatchers are provided detailed information of a
`particular scenario Which can be used to better evaluate
`existing circumstances, thereby leading to a better decision
`making process and improved resource allocations, both of
`Which improve public service.
`Referring to FIG. 1, a block diagram 100 of a system for
`tracking and locating objects Within a highly accurate three
`dimensional model is shoWn. The system includes tracking
`and location (T & L) softWare 105, 3D mapping softWare
`(3D site model) 110, and a user interface 115. Further, each
`object being tracked can include a global positioning satel
`lite (GPS) receiver 125. For example, there can be a GPS
`receiver 125 in a police cruiser 130, on a police officer 135,
`in a ?re truck 140, on a ?re ?ghter 145, in an ambulance 150,
`or on an emergency medical technician 155. Still, many
`other objects can carry a GPS receiver 125 to enable object
`tracking of manned and unmanned objects. Other examples
`include trains, aircraft (helicopters, ?xed Wing, etc.), Water
`craft and so on.
`Each GPS receiver can be connected to a transmitter to
`transmit GPS coordinates to the T & L softWare 105 using
`the communications netWork 120. For example, in the case
`Where a GPS receiver is in a vehicle, the GPS receiver can
`connect to existing RF transmission equipment, such as a
`police radio. If a GPS receiver is being carried on a person,
`hoWever, the GPS receiver can include a transmitter. In
`another arrangement, a GPS receiver can integrate With a
`cell phone or a mobile radio. Or it can integrate With other
`communications devices including those operating on radio
`frequencies or optical Wavelengths.
`The T & L softWare 105 can receive an object’s latitude,
`longitude and altitude coordinates, and bearing data from a
`GPS receiver associated With the object. The T & L softWare
`105 then can place an icon representing the object into a 3D
`site model 110 that is presented to a user through the user
`interface 115, for example on a video monitor. Importantly,
`an indicator can be presented in the icon or associated With
`the icon to indicate the bearing of the object. For example,
`a velocity of the object can be presented, indicating both the
`speed at Which an object is moving and the direction the
`object is moving in. In particular, an arroW can be presented
`With the icon to indicate a direction the object is moving.
`The direction also can be presented numerically or graphi
`cally. For example, degrees can be indicated numerically or
`With a compass style indicator. The speed at Which the object
`is moving also can be presented numerically or graphically.
`For example, speed can be indicated numerically or With an
`icon that represents a speedometer display. An indicator also
`can be associated With the icon to indicate the GPS coordi
`nates of the object.
`The 3D site model 110 can be an accurate model of an
`area incorporating geographic features and structures. For
`example, the 3D site model 110 can be a model of a city,
`including roads, bridges, structures, etc. The 3D model can
`be generated using techniques knoWn to the skilled artisan.
`
`15
`
`35
`
`40
`
`45
`
`55
`
`65
`
`4
`For example, source imagery can be used to generate
`polygons representing features and structures to be shoWn in
`the 3D site model 110. Notably, the source imagery can be
`any form of feature identi?cation, for example information
`generated by aerial and satellite photography, electro-optical
`imaging, infrared detection, synthetic aperture radar (SAR),
`hyperspectral imaging, light detection and ranging
`(LIDAR), and even handheld photographs. The model
`resulting from the polygons then can be shaded and textured
`to provide a photo-realistic and accurate representation of
`the area.
`A database can be associated With the 3D site model and
`structures in the 3D site model 110 can be assigned
`attributes. For example, the composition of structures can be
`identi?ed. Special features and comments related to a struc
`ture also can be noted, for example, Whether a structure has
`a basement, the age of a structure, Whether a structure has a
`?re escape and/or sprinkler system, and so on. In one
`arrangement, the internal layout of particular structures can
`be incorporated in the 3D site model 110, for example, the
`elevation (altitude) of each ?oor and the location of stair
`Wells and elevators Within the structure. Moreover, the
`database can be structured in a manner Wherein the attributes
`associated With each building are organiZed by ?oor or
`altitude.
`The T & L softWare 105 can be stored on a data storage
`device, such as a data storage associated With a computer
`system. For example, the T & L softWare 105 can be stored
`on a magnetic storage medium, an optical storage medium,
`a magneto-optical medium, etc. The T & L softWare 105 can
`be executed on a computer or any other device incorporating
`a processor capable of processing 3D graphical information.
`For example the T & L softWare 105 can be executed on a
`server, a Workstation, a personal computer, a laptop
`computer, a mobile computer, a hand held computer, a body
`Worn computer, etc.
`As previously noted, a communications netWork 120 can
`be used by a GPS 125 to communicate GPS data to the T &
`L softWare 105. The communications netWork can include
`the Internet, a Wide area netWork (WAN), a local area
`netWork (LAN), a mobile communications netWork, a public
`sWitched telephone netWork, or any other netWork capable
`of transmitting GPS data. For example, the GPS receivers
`125 can communicate via a Wireless netWork, such as a
`cellular communications netWork or an IEEE 802.11 net
`Work. Importantly, the communications netWork 120 can
`include a myriad of systems capable of transmitting GPS
`data.
`A user, for example a supervisor or a dispatcher, can use
`the user interface 115 to interact With the T & L softWare
`105. For example, the user interface can comprise a display,
`a keyboard, and a mouse. HoWever, the user interface is not
`limited to these devices. For example, the user interface can
`include a projector, a joystick, speech recognition hardWare
`and softWare, speakers, and any other device a user can use
`to interact With a softWare package.
`FIG. 2 is a How chart 200 for tracking and locating an
`object Within a highly accurate three dimensional model.
`Referring to step 205, GPS data for the object can be
`generated by a GPS receiver 125 and transmitted to the T &
`L softWare 105, as previously noted. For example, the GPS
`data can be transmitted to a computer having the tracking
`and location softWare, as shoWn in step 210. For example,
`the GPS data can be Wirelessly transmitted from the GPS
`receiver to a basestation, Which can Wireline transmit the
`GPS data to the computer. Still, other transmission tech
`niques can be used, as is Well knoWn to the skilled artisan.
`
`Ruiz Food Products, Inc.
`Exhibit 1010
`
`

`

`US 6,833,811 B2
`
`10
`
`15
`
`25
`
`35
`
`5
`Referring to step 215, the computer can pass the GPS data
`to the T & L software 105, Which can process the GPS data
`and select a 3D site model correlating to the GPS data. For
`example, a 3D site model can be selected for a particular city
`or a particular area Within a city. Importantly, When the
`latitude and longitude coordinates correspond to the location
`of a multilevel structure, the altitude coordinate can be
`resolved into a ?oor or level designation, as shoWn in step
`220. For example, if a ?re ?ghter is at an altitude of 100 feet
`in a particular structure, the altitude can be cross referenced
`to the attributes associated With the structure in the 3D site
`model to determine an accurate ?oor number correlating to
`that altitude. Referring to step 225, an icon representing the
`object can be accurately located in the 3D site model at the
`location identi?ed by the GPS data received from the GPS
`receiver 125. The icon can be located in the 3D site model
`using a coordinate system employed by the T & L softWare
`105, as is knoWn to those skilled in the art of tracking and
`location softWare. For example, the latitude, longitude and
`altitude coordinates can be translated into X, Y and Z
`coordinates Within the T & L softWare’s local space coor
`dinate system using geospatial to local space coordinate
`system softWare. Further, an indicator, such as a number,
`letter or symbol, can be associated With the icon to indicate
`a ?oor number or level. As previously noted, the indicator
`also can indicate the object’s GPS coordinates and bearing
`data.
`In a further arrangement, accurate 3D images from the
`perspective of an object being tracked can be presented via
`the user interface, for example to a supervisor or planner.
`The GPS data for an object can be processed by the T & L
`softWare 105, Which can then access the selected 3D site
`model. The T & L softWare 105 then can display through the
`user interface the portions of the 3D site model correlating
`to the actual scene that is vieWable from the objects vantage
`point. For example, a user can use a cursor to select an object
`in a 3D site model being displayed or the user can toggle
`through any tracked object being displayed to select one to
`be “active.” When an object is selected, the user can be
`provided With a selection of vantage points Within the 3D
`site model that correlate to the perspective as Would be seen
`by a person located Where the selected object is located.
`Additional vantage points can be presented as Well. For
`example, a top vieW of an object moving through a scene, an
`overhead “chase” vieW from a perspective that is behind and
`slightly above an object and Which folloWs the object
`through a scene, a rear “chase” vieW from a perspective
`behind the object, and so on. Notably, there are a myriad of
`vieWs and perspectives Which can be displayed. All such
`arrangements Will be understood to be included in the
`present invention.
`When a vantage point is selected, that vantage point can
`be displayed in the current WindoW, in a second WindoW, or
`on a different display. Further, user selectable icons can be
`provided on the display to enable the user to pan, Zoom and
`quickly change vantage points Within the 3D site model.
`These features can be of utmost importance in real-time
`scenarios, such as natural disasters, structure ?res, hostage
`situations, police chases, acts of terror, etc. Additional user
`options can be provided as Well. For example, data related
`to the selected (active) object can be displayed on the screen.
`For example, if the selected object is a ?re truck, data
`associated With the ?re truck can be provided on the display.
`The T & L softWare 105 also can monitor parameters
`associated With an object. For example, the T & L softWare
`105 can monitor biological statistics of a person, such as
`pulse, respiration, body temperature, brain activity, and so
`
`40
`
`45
`
`55
`
`65
`
`6
`on. For example, a ?re ?ghter can be equipped With pulse,
`respiration, and body temperature measuring devices. The T
`& L softWare 105 also can monitor operational parameters
`for objects that are machines, such as vehicles, aircraft,
`Watercraft, etc. For example, mechanical statistics, such as
`mechanical stresses, tire pressure, oil pressure, fuel level,
`speed, velocity, and other parameters can be measured using
`sensors that are knoWn in the art. Data generated by the
`monitoring devices can be transmitted to the T & L softWare
`105 using the same transmitter used for transmission of the
`GPS data. Alternatively, a separate transmitter can be pro
`vided to transmit the parameter measurement data.
`FIG. 3 is a How chart 300 for providing dynamically
`adjustable computer aided dispatch based on object location.
`Referring to step 305, The T & L softWare 105 can receive
`GPS data (coordinates and bearing) for multiple objects
`being monitored. Referring to step 310, the coordinates and
`bearings of different objects can be evaluated to determine
`Which object is best suited to be dispatched in response to a
`crisis or need. For example, a comparison of the position of
`various objects can be generated and evaluated to select an
`object to dispatch. In one arrangement, other information
`can be evaluated as Well for determining Which object to
`dispatch. For example, evaluation can be based on the siZe
`of the ladder on a ?re truck, the resources allocated for other
`crises, emergencies or events, and other factors that can
`effect the dispatch decisions.
`The T & L softWare 105 then can provide to a dispatcher
`a recommendation for Which object to allocate to a particular
`crisis, emergency or event, as shoWn in step 315. The
`dispatcher then can transmit a communication to the object
`With dispatch instructions. In an alternate arrangement, the
`T & L softWare 105 can automatically transmit a commu
`nication With dispatch instructions to the object. The com
`munication can be sent over the communications netWork
`120 and can be encrypted using knoWn security techniques.
`While the preferred embodiments of the invention have
`been illustrated and described, it Will be clear that the
`invention is not so limited. Numerous modi?cations,
`changes, variations, substitutions and equivalents Will occur
`to those skilled in the art Without departing from the spirit
`and scope of the present invention as described in the claims.
`What is claimed is:
`1. A method for tracking an object, comprising:
`generating GPS coordinates for the object, said GPS
`coordinates comprising a latitude, a longitude, and an
`altitude;
`correlating said altitude With an identi?er for a level
`Within a multi-level structure;
`accurately locating an icon representing said object in a
`?rst vieW of a three dimensional model, Wherein said
`three dimensional model represents at least a portion of
`said multi-level structure; and
`displaying an indicator to indicate said level.
`2. The method of claim 1, further comprising the steps of:
`processing said GPS coordinates to determine a bearing
`representing a movement of said object; and
`displaying an indicator that indicates said bearing.
`3. The method of claim 1, further comprising the step of
`selectively presenting a second vieW of said three dimen
`sional model, said second vieW being presented from a
`perspective correlating to a location of said object deter
`mined by said GPS coordinates.
`4. The method of claim 1, further comprising the steps of:
`comparing said GPS coordinates for said object With a
`location of a second object; and
`
`Ruiz Food Products, Inc.
`Exhibit 1010
`
`

`

`US 6,833,811 B2
`
`7
`selectively transmitting a communication to one of said
`objects based on said comparison.
`5. The method of claim 4 Wherein said transmitting step
`further comprises transmitting a dispatch command.
`6. The method of claim 4 Wherein said comparing step
`further comprises comparing at least one parameter of said
`objects prior to said transmitting step.
`7. The method of claim 6 Wherein said parameter in said
`comparing step is selected from the group consisting of
`physiological data and object readiness data.
`8. The method of claim 1, Wherein said object is selected
`from the group consisting of a person, a vehicle, a Watercraft
`and an aircraft.
`9. The method of claim 1, further comprising the step of
`monitoring a parameter of said object.
`10. The method of claim 9, Wherein said parameter is
`selected from the group consisting of biological statistics,
`mechanical statistics, fuel level, acceleration, and velocity.
`11. An object tracking system, comprising:
`at least one GPS receiver generating GPS coordinates for
`an object and a bearing representing a movement of
`said object, said GPS coordinates comprising a latitude,
`a longitude, and an altitude;
`a processor for processing said GPS coordinates and
`correlating said altitude With an identi?er for a level
`Within a multi-level structure; and
`a three dimensional tracking system for accurately locat
`ing an icon representing said object in a ?rst vieW of a
`three dimensional model, Wherein said three dimen
`sional model represents at least a portion of said
`muiti-level structure, said three dimensional tracking
`system also displaying an indicator to indicate said
`level.
`
`10
`
`15
`
`25
`
`8
`12. The system of claim 11, said tracking system further
`displaying an indicator to indicate said bearing.
`13. The system of claim 11, said tracking system further
`presenting a second vieW of said three dimensional model,
`said second vieW being presented from a perspective corre
`lating to a present location of said object.
`14. The system of claim 11, further comprising:
`means for comparing said GPS coordinates of said object
`to a location of a second object to generate a compari
`son; and
`means for transmitting a communication to said object,
`Wherein a content of said communication is determined
`at least in part by said comparison.
`15. The system of claim 14, Wherein said transmitting
`means Wirelessly transmits said communication to said
`object.
`16. The system of claim 14, further comprising means for
`encrypting said communication.
`17. The system of claim 11, Wherein said object is selected
`from the group consisting of a person, a vehicle, a Watercraft
`and an aircraft.
`18. The system of claim 11, further comprising means for
`monitoring a parameter of said object.
`19. The system of claim 18, Wherein said parameter is
`selected from the group consisting of biological statistics,
`mechanical statistics, fuel level, acceleration, and velocity.
`
`Ruiz Food Products, Inc.
`Exhibit 1010
`
`

`

`UNITED STATES PATENT AND TRADEMARK OFFICE
`Certi?cate
`
`Patented: December 21, 2004
`Patent No. 6,833,811 B2
`On petition re uesting issuance of a certi?cate for correction of inventorship pursuant to_ 35 U.S.C. 256, it
`has been found at the above identi?ed patent, through error and without any deceptive intent, improperly
`sets forth the inventorship.
`. _
`_
`‘
`_
`Accordingly, it is herebly certi?ed that the correct inventorship of this \rgatent is: Michael P. Zeitfuss, Satelhte
`Beach, FL; ose h M. emethy, West Melbourne, FL; Joseph A. enezia, Melbourne, FL; and Shawn
`Gallagher, Palm ay, FL.
`Signed and Sealed this Fourteenth Day of February 2006.
`
`THOMAS H. TARCZA
`Supervisory Patent Examiner
`Art Unit 3662
`
`Ruiz Food Products, Inc.
`Exhibit 1010
`
`