a
`
`~*
`
`‘
`
`*
`
`AE
`04/09/01
`
`Please type a plus sign (+) inside this box > [+]
`
`PTO/SB/016 (2-01) o
`Approved fro use through 10/31/2002. OMB 0651-0031
`Ex
`U.S. Patent and Trademark Office: U.S. DEPARTMENT OF COMMERCE
`Under the Paperwork Reduction Act of 1995, no persons are required to respondto a collection of information unless it contams a valid OMB control number.
`a
`5
`KR
`
`PROVISIONAL APPLICATION FOR PATENT COVER SHEET
`This is a request for filing a PROVISIONAL APPLICATION FOR PATENTunder37 CFR 1.53(c).
`
`INVENTOR(S)
`
`Given Name(first and middle [:f any])
`WAYNEL.
`
`Family Name or Summame
`KILMER
`
`K. STEPHEN
`
`JOHNT.
`
`BOOK
`
`FIORE
`
`
`
`Residence
`
`(City andeither State or Foreign Country)
`SARTELL, MN
`
`FAIRFAX, VA
`
`DERWOOD, MD
`
`
`separately numbered sheets attached hereto
`1 Additional inventors are being named on the
`TITLE OF THE INVENTION(280 characters max)
`A DATA RECORDING SYSTEM PROVIDING INSTANT PLAYBACK AND EVENT MARKING
`
`Direct all correspondence to:
`Customer Number
`
`CORRESPONDENCE ADDRESS
`>
`:
`22204
`
`
`
`Place Customer Number
`Bar Code Label here
`
`OR
`1 Firm or
`Individual Name
`Address
`Address
`
`“Type Customer Number here
`NIXON PEABODY LLP
`8180 Greensboro Drive
`
`22102
`VA
`State
`McLean
`City
`
`
`
`Country Telephone|(703) 790-9110USA (703) 883-0370
`
`ENCLOSED APPLICATION PARTS(check ail that apply)
`
`
`
`Specification
`
`Number ofPages
`
`24
`
`+ 11 cp¢s), Number
`
`O pDrawing(s)
`
`Number ofSheets
`
`| (1 Other (specify)
`
`
`
`
`
`
`
`t
`
`Old‘8’NO969F
`10/60/t0AOC
`
`
`
`
`
`x] Application Data Sheet. See 37 CFR 1.76
`METHOD OF PAYMENTOF FILING FEES FOR THIS PROVISIONAL APPLICATION FOR PATENT
`
`Applicant claims small entity status. See 37 CFR 1.27.
`A check or money order is enclosed to cover the filing fees
`(1 $+The Commissioner is hereby authorized to charge filing
`fees or credit any overpayment to Deposit Account Number:
`(1 Paymentby credit card. Form PTO-2038 is attached.
`The invention was made by an agency of the United States Government or under a contract with an agency of the United States
`Government.
`No.
`C1 Yes, the nameofthe U.S. Government agency and the Government contract numberare:
`
`FILING FEE
`
`AMOUNT(3)
`
`
`
`$75
`
` i —4Respectfully submitted,. re ; Date | 04/09/01
`
`
`
`
`
`
`
`
`
`
`REGISTRATION NO.
`SIGNATURE
` 43,143
`
`,
`.
`(ifappropriate)
`
`
`
`
`j
`
`
`
`TYPED or PRINTED NAME_Daniel S$. Song Docket Number: 7J44806-2
`
`
`
`TELEPHONE_(703) 790-9110
`USE ONLY FOR FILING A PROVISIONAL APPLICATION FOR PATENT
`This collection of information is required by 37 CFR 1.51. The information is used bythe public to file (and by the PTO to process) a
`provisional application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This collection is estimated to take 8 hours to
`complete, including gathering, preparing, and submutting the complete provisional application to the PTO. Time will vary depending upon
`the individual case. Any comments on the amountof time you require to complete this form and/or suggestions for reducing this burden,
`should be sent to the Chief Information Officer, U.S. Patent and Trademark Office, U.S. Department of Commerce, Washington, D.C.
`20231. DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Box Provisional Application, Commussioncr
`for Patents, Washington, D.C. 20231.
`NVA177337.1
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 001
`
`

`

`om
`
`
`
`INVENTOR INFORMATION
`
`Inventor One Given Name:: Wayne L
`Family Name:: KILMER
`Postal Address Line One:: 906 Sunray Court
`City:: Sartell
`State or Province:: MN
`
`Country:: U.S.A.
`Postal or Zip Code:: 50377
`City of Residence:: Sartell
`State or Province of Residence:: MN
`Country of Residence:: U.S.A.
`Citizenship Country:: U.S.
`Inventor Two Given Name:: K. Stephen
`Family Name:: BOOK
`Postal Address Line One:: 9801 John Robert Way
`City:: Fairfax
`State or Province:: VA
`
`Country:: U.S.A.
`Postal or Zip Code:: 22032
`City of Residence:: Fairfax
`State or Province of Residence:: VA
`Country of Residence:: U.S.A.
`Citizenship Country:: U.S.
`Inventor Three Given Name:: John T
`Family Name:: FIORE
`Postal Address Line One:: 5728 Artesian Drive
`City:: Derwood
`State or Province:: MD
`
`Country:: U.S.A.
`Postal or Zip Code:: 20855
`City of Residence:: Derwood
`State or Province of Residence:: MD
`Country of Residence:: U.S.A.
`Citizenship Country:: U.S.
`
`CORRESPONDENCE INFORMATION
`
`Correspondence Customer Number:: 22204
`Fax One:: 703-883-0370
`Electronic Mail One:: pluther@nixonpeabody.com
`
`APPLICATION INFORMATION
`
`
`Title Line One::
`A DATA RECORDING SYSTEM PROVIDING INSTAN
`Title Line Two::
`T PLAYBACK AND EVENT MARKING
`Formal Drawings?:: No
`Application Type:: Provisional
`Docket Number:: 744806-2
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 002
`
`

`

`Secrecy Order in Parent Appl.?:: No
`
`REPRESENTATIVE INFORMATION
`
`Representative Customer Number:: 22204
`Registration Number One:: 43143
`Registration Number Two:: 20932
`
`Registration Number Three:: 24312
`Registration Number Four:: 26477
`Registration Number Five:: 27997
`Registration Number Six:: 28290
`Registration Number Seven:: 32815
`Registration Number Hight:: 35483
`Registration Number Nine:: 36092
`Registration Number Ten:: 38285
`Registration Number Eleven:: 35212
`Registration Number Twelve:: 34339
`Registration Number Thirteen:: 39715
`Registration Number Fourteen:: 43077
`Registration Number Fifteen:: 45285
`Registration Number Sixteen:: 41345
`Registration Number Seventeen:: 38434
`
`Source::
`
`PrintEFS Version 1.0.1
`
`saw#
`
`
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 003
`
`

`

`Patent Information
`
`Inventors
`
`
`
`Wayne L. Kilmer|906 Sunray Court, Sartell, MN 50377
`
`
`K. Stephen Book|9801 John Robert Way, Fairfax, VA 22032
`
`
`|
`John T. Fiore
`5728 Artesian Drive, Derwood, MD 20855
`
`
`
`
`Assignee
`Monitoring Technology Corporation, 2731B Prosperity Avenue, Fairfax, VA 22031
`
`Title
`
`A Data Recording System Providing Instant Playback and Event Marking
`
`Abstract
`
`A data recording system stores a stream of video, audio, or other sampled signal data to a
`circular buffer. The circular buffer maintains a recording ofthe most recent signal values.
`Oncethe bufferis full, the newer data overwrites older data. The contents of the buffer
`can be displayed, played, or output to a signal reconstruction device from any location in
`the buffer selected by the user. The speed ofthe display, playback, or output can vary
`from single step to faster than real time. The direction can be forward(in the time
`sequence as it was recorded)or reverse (opposite the recording sequence). The user can
`manually mark positions in the buffer as an important area (event) or an external
`triggering device such as a control system, process upset sensor, or vision analysis system
`can mark event positions. The instant the manual or automatic event occurs the system
`can immediately display, play back or outputthe data signal without requiring the
`transfer of the data from thecircular buffer to another buffer. Optionally, an event clip
`consisting of data before andafter the event can be transferred to a different buffer for
`temporary or permanent use, =
`,
`
`The circular buffer is implemented as a memory mappedfile. This allows use of the
`caching capabilities of the operating system to automatically transfer the file contents
`between memory and disk as needed.
`
`
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 004
`
`

`

`Description
`
`System Architecture
`
`
`
`
`
` Signal Processor
`Signalsource:
`video,
`
`audio,or other
`NNNNNNN
`
`
`analog ordigital
`
`
`Client Computer
`
`Signal source:
`video,
`audio, or other
`analog ordigital
`data
`
`Signal source:
`
`
`video,
`audio, or other
`
`analog ordigital
`Client Computer
`data
`
`data
`
`
`
`
`
`
`
` Database
`Server, and/or Client,
`I
`
`
`and/or Signal Processor
`Externa
`Event
`
`
`
`Source
`
`
`
`
`
`Figure 1: System Architecture
`
`The system consists of the following elements:
`Signal Source
`The signal consists ofa video, audio, or other analog ordigital
`signal source.
`
`Signal Processor
`
`
`
`If the signal is in analog form, the signal processorfirst digitizes
`the signal. If desired, the signal data can be compressed to save on
`storage requirements. The signal processor analyzes the signal
`data to identify distinguishing features. The analysis data is stored
`
`along with the signal data and an accurate time stamp in the
`
`
`
`
`
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 005
`
`

`

`Network
`
`circular buffer. The time stamps allow the synchronization of the
`multiple input sources. Event information can also be placed in
`the curricular buffer.
`
`The different system components communicate over a network.
`The network can consist of a local area network, wide area
`network, or the Internet.
`
`Server and Database|The server computer is responsible for maintaining the database
`of signal processor, event, and event clip information. One server
`is always required.
`
`
`
`
`
`
`Event Source
`
`An external triggering device such as a control system, process
`upset sensor, or vision analysis system can interface to the server
`to indicate the time of an event and can send relevant data about
`the event.
`Client Computer The client computer displays or reconstructs the contents ofany
`circular buffer. It also showsa history of event information and
`can display eventclips.
`
`The simplest system would consist of a single computer performing the functions of a
`signal processor, server and client.
`
`Signal Processor
`Figure 2 depicts the Signal Processor logic. The logic supports several modes of
`operation. The Signal Processor can compress the signal data to save storage space and
`can analyze the image by applying various pattern recognition algorithmsto classify the
`information content in the signal. An important function of the Signal Processoris to
`mark in the circular buffer when a event occurs and associate with this event any relevant
`data.
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 006
`
`

`

`
`
`Signal
`Source
`
`Analyze
`Compressed ?
`
`
`Analyze
`Uncompressed ?
`
`
`
`no
`
`Digitize
` Compress
`
`
`
`
`
`
`Analyze
`Analyze
`Uncompressed
`Compressed
`
`
`
`Signal Data
`Signal Data
`
`
`
`
`
`
`
`Add Timestamp, and
`Analysis Data to
`
`Signal Data
`
`
`Add Signal Data to
`Circular Buffer
`
`End
`
`Figure 2: Signal Processor Logic
`
`Event
`Data
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 007
`
`

`

`Circular Buffer
`Thecircular buffer can be implemented as a reserved area in memory,a diskfile, or as
`storage in a looped media. A memory-mapped architecture combines the access speed of
`memory with the large storage capacity of a disk file.
`
`Memory Mapped Circular Buffer
`The memory mapped buffer allows multiple viewer clients and the data serverto
`simultaneously access the real-time buffer files on disk dynamically, in the same
`way they access ram memory,via address pointers. Multiple sections of the dynamic data
`buffer on disk are mapped to specific ranges of addresses within the servers ram
`memory. The content of the memory mapped buffer is accessed by dereferencing the
`pointer in the designated memory address range. Data is written to the memory
`mapped buffer by assigning a value to the dereferenced pointer. Data movement to and
`from the disk is handled by lower level caching algorithmsthat optimizes the memory
`mapped buffer access speed to the disk caching hardware. Semaphores are used to
`implement data integrity managementofthereal-time buffer. This configuration allows
`maximum access real-time buffer utilization with the minimum disk latency and
`performance penalty. The memory mapped buffer can be implemented across several
`disk drives to further increase the storage capacity.
`
`
`
`Disk Drive 1
`
`Disk Drive N
`
`Frame Based File Format
`In somecases, the nature of the signal data is such that it can be naturally segmented into
`frames that represent self contained pieces of information. Video data consists of a
`sequenceofframes that each represents an individual image. Thefollowingfile formatis
`suitable for this type ofdata:
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 008
`
` Client 1 MMBuffer View
`
`
`
` Client N MMBuffer View
`
`
`
`
`Data capture MMBuffer
`
`i
`
`
`

`

`eo
`Re
`
`Format 128
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Frame n Header: Size
` Frame n: Frame Data
`Signal Data Viewer Architecture
`Theclient software can view the contents of the Signal Data Circular Buffers. A block
`diagram of the viewer is shown in Figure 3.
`The Signal Data Viewer handles 3 types of data; Analysis, Frame and Event. The
`Analysis data represents information relating to the content or change in content of the
`signal data. The Analysis Viewer Moduledisplays this analysis information. Usually this
`information is displayed as a trend ofan analysis feature as a function oftime. The user
`can identify unique positionsin this trend and view the signal data associated with these
`positions.
`The Signal Data maybestored in compressed format. If so, the data is first decompressed
`and then passed to the Signal Viewer Module for display. The Signal Display Control
`Module allowsthe user to view or reconstruct the signal in a forward and reverse play
`modeat various speeds. The user can also navigate with a slider or other user control to
`
`Frame 1: Frame Data
`
`Frame n Header: Time Stamp
`.
`Frame n Header: Page
`
`Frame n Header: Offset
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 009
`
`

`

`arbitrary positions in the buffer. The signal viewer module can also outputa portion of
`the Signal Data to a Save Modulethat can save the data in an appropriate formatfor use
`by external programs. The Save Module can compress the Signal Data using a standard
`compression technique to save on storage space.
`The Event History Module displays the Event Data. The user can display the saved event
`clips associated with the event.
`
`
`Analysis, Signal and Event Data
`
`yy
`Analysis
`Decommpressor
`Analysis Viewer
`Display Control
`Module
`Module
`Module
`
`
`.
`Event History
`Module
`
`Output Module
`
`Saved
`Signal Data
`
`File
`
`
`
`
`Control Module
`
`Signal Viewer
`Module
`
`Signal Display
`
`Video Driver
`
`Figure 3: Signal Data Viewer Architecture
`
`Signal Data Viewer Flowchart
`Figure 4 showsa flowchart of the Signal Viewer. The user interacts with the viewer by
`requesting specific positions in the buffer for display or output. One possible meansis the
`use ofa slider bar to identify specific positions in the buffer for output. Forward and
`reverse buttons can identify the direction of change for the requested position and other
`user controls can determine the rate of change.
`Thebuffer has two uniquepositions, the head andtail. The head represents the position in
`the buffer of the most recent data and thetail the position of the oldest data leaving the
`buffer. The head andtail are considered as real-time positions where the viewer outputs
`the signal data in the buffer in a live output mode.
`Atother positions in the buffer, the user requests the positions by manually indicating the
`new position by entering a time in a dialog, by sliding the pointer in the slider bar to a
`new position, or by selecting a particular play mode from the currentbuffer position.
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 010
`
`

`

`
`
`
`
`Connect to
`Circular Buffer
`
`Get newest
`data item in
`
`
`
`
`Get requested
`buffer position
`
`
`buffer
`
`
`
`Gettime of requested
`position and get data
`item nearestto this
`
`time
`
`
`
`Get oldest data
`item in buffer
`
`
`
`
`
`
`
`
`
`Display signal
`and analysis
`
`
`
`
`Event data ai
`
`
`Display event
`
`this time?
`
`marker and data
`
`|_
`
`
`
`Requested
`position in
`ealtime mode?
`
`
` Has user
`
`
`requested a new
`position?
`
`
`Figure 4: Signal Viewer Flowchart
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 011
`
`

`

`Event signals form external devices can trigger the system throughaserial interface.
`
`Event Serial interface
`
`
`1000
`
`Lm317
`Voltage Regulator
`
`|
`y
`
`\
`
`out
`
`Cu
`
`—ADS
`
`1uf
`
`bzo
`
`G EVENT
`
`S
`
`270
`
`9-20
`VOLTS
`pc
`
`ot
`
`be-
`
`dof
`
`
`
`Rl+
`
`-1- DC - of external power supply
`-2- DC + of external power supply
`-3- connected to pin 5 of DB9F serial port connector
`-4- connected to pin 9 of DB9F serial port connector
`-5- connected to break contact
`
`-€- connected to break contact
`
`Figure 5: Event Interface
`
`6.
`GONTACT
`
`&-
`GONTACT
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 012
`
`

`

`20 / 20 Hindsight User’s Manual
`
`place picture here
`
` bent
`
`DRAFT
`
`NOT FOR DISTRIBUTION
`
`Preliminary Draft (Notfor Distribution)
`
`jo
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 013
`
`

`

`Monitoring Technology Corporation
`2731B Prosperity Avenue
`Fairfax, Virginia, 22031
`
`(703) 698-3520
`
`
`
`Preliminary Draft (Notfor Distribution)
`
`i
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 014
`
`

`

`This publication is provided for informational purposes only andis subject to change
`without notice. No part of it may be reproduced ortransmitted by any meansor in any
`form, without prior written consent from Monitoring Technology Corporation (MTC)
`MTC makesno warranty of any kind with regard to material, including, but not limited
`to, the implied warranties or merchantability and fitness for a particular purpose. MTC
`shall not beliable for errors, omissions, or inconsistencies, which may be contained.
`herein or for incidental or consequential damages in connection with the furnishing,
`performance,or use of this material. Information is furnished under a license agreement
`or nondisclosure agreement with MTC ora third part vendor. Any software may be used
`or copied only in accordance with the terms of the agreement.
`
`All products mentioned in this manual are trademarked or copyrighted by their respective
`manufacturers.
`
`Changes or modifications not expressly approved by the manufacturer could void the
`user’s authority to operate the equipment.
`
`
`
`Preliminary Draft (Not for Distribution)
`
`{Z
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 015
`
`

`

`Table of Contents
`
`System Overview ......c:ccsssscsosorsrersssesssssssosessssssorrssnsnenssaeorersseseaceressorssvtecsonentsorecrsecoreereesees 5
`System Setup...sssscesssssscccorseserssorsersecceessssesnscssccaceessecseeanesconesassssoscosseesonssessnessaascssescsossscoses 5
`System Components...csessscscsssccssececcssssssecssscssseesesesesecseessecesscecsssusscossenesessnssescsensessas 5
`Connecting the System Components...........cscssssscsssssssessssecsssssssssssecessssasassecessssescetscesecs 5
`Connecting the camera Video Cable........ssssssssssssssssssesssesssscsessssscsscsssvescossessavsavsesacsssenvans 6
`Connecting the camera power Cable ..........c.sscsssssssssseesscssssssecsssessssssusscsssesssesecussasesevsneeees 6
`Cameras and Video Format ..........cssssssssssscssssecessssssessssssssssecssseseseseossrssessessseceoseresevoassens 7
`Camera Setup ......ssccsssssssssessesssavssscssececessssnssacsesecsssscancessecsessterseeeesceesssanseesssssssssussnssaasens 8
`Electronic Shutter Speed Setting .........csscsssssccsesssssssssessessescsssesecssesssessesecsvescerssassossass 8
`Video Frame Sync Setting ........seccsssssscsssssssassecstssssssssesnesessencssssssscssrsssnsessvassenssesscesens 8
`Lens Setting and Adjustment... sessssssssesessssssssssssscsssesssssssssscsesessssesecsssssnvevcsoeerers 8
`External Trigger ......scsosssssssssssssssssssssssessssesesssessnsseescenseesesecsssssoesecetssseseessessenseassessesssensaes 9
`Software Setup .....scsssssssscsseseeseerscessssseessssvessssesssseesecsesoussceessucarsstaresessessensssesaneeseesenss 10
`Systema Operation.....scsssecsssssosssscssssssssssssscccsssaccesssessevenessnencersvsesnsersvessoreeveneeressorsesscereoesee LE
`General Display Layout ...........sssscessssessesecesssscaesscaesssssesaeseacsesseeeesecasecseneencacsesssesssenee ll
`Position Slider Bar... ecsssscscssssssessssssssessssssacsessacsescaeseaesenenssesassseetesesecsessonsossescscensvses 12
`
`
`
`Command Buttons .....cccccsssssccesscscscessesssersconsssesssssssessecssssecsasensetecusenseesasesssesscneesesees 13
`Movie History .....sccccccecssssssssssscsssesessesecscsusessssesusessseusesessescscsossessscvsssassesssessverenesnesuenenees 14
`
`Troubleshooting Guide .........ssssscssssesessssssssseessesssecesesscnsssescsssssecsessunsssssassevsesessenescecees 14
`
`
`
`Preliminary Draft (Not for Distribution)
`
`13
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 016
`
`

`

`
`
`System Overview
`
`The 20/20 Hindsightis a video event capture tool that is used to capture process upsets in
`a production or packaging line. Plant engineers can replay these events to observe the
`upset in detail and in slow motion to determine the root cause. The system continuously
`records one or more video signals to capture buffers and displays the contents of these
`’ buffers while recording is in progress. When an event happens, the operator views the
`event in the buffer and can manually make a movie of the event. A movie can also be
`made automatically by an interface to a control system, process upset sensor, or vision
`analysis system. A databasestores the event information for easy review of the event
`history.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Place example here
`
`System Setup
`
`System Components
`The following components make up the 20/20 Hindsight system:
`
`
`Cabling
`System unit power cord
`
`cable
`
`
`Camera power supply
`Camera power cable
`
`Connecting the System Components
`Before powering the computer, plug the keyboard, mouse and video monitorinto the
`computer. Connect the computer and video monitor to the AC power source.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Preliminary Draft (Not for Distribution)
`
`i4
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 017
`
`

`

`Connecting the camera video cable.
`Connect the camera cable to the computer with
`the coaxial video cable (Figure 1). (The video
`coaxial cable may be bundled together with the
`camera power cable.) This cable has an RCA
`connector that plugs into the computer video
`capture card, Plug the RCA connector into the
`input labeled Video on the card. The other end of
`the video coax cable has a BNC connectorfor
`connection to the video output on the back of the
`
`Figure 1: Video input connection
`
`
`
`
`
`
`CAUTION! ALWAYS CONNECT THE CAMERA POWER
`
`CABLE TO THE BACK OF THE CAMERA FIRST, BEFORE
`PLUGGING THE CAMERA POWER TRANSFORMERIN TO
`
`THE AC POWER SOURCE
`
`camera (Figure 2)
` transformerthat plugs into the AC power source (Figure3).
`
`
`
`
`Connecting the camera powercable
`The camera power cable has two leads at one end that connect to the 24 volt AC power
`inputterminals on the back ofthe camera. Connecteither wire to terminal 1. Connect the
`other wire to terminal 2. At the other end of the camera power cable is a small
`
`Figure 2: Camera view, showing power and video connections
`
`Preliminary Draft (Not for Distribution)
`
`is
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 018
`
`

`

`Video Camera Back Panel
`
`BNC Video-Out
`
`
`
`
`
`AC Power
`
`Tenminats
`
`
`RCA Connectorto
`Computer Video Input
`
`
`
`Figure 3: Camera Connections
`
`Cameras and Video Format
`The 20/20 Hindsight system employs a standard CCDtype closed circuit TV (CCTV)
`camera. This camera outputs an analog baseband, or composite video signal compatible
`with the video input ofa television monitor, or the video input of the Hindsight video
`capture card. The video signal is carried over a 75-ohm coax cable from the camerato the
`Hindsight computer. The video signal is digitized (and compressed)in the Hindsight
`system, and digital video data is stored on the computer’s hard disk. Digital video data is
`stored in a circular buffer. As the storage capacity of the buffer is reached, the oldest data
`is overwritten by new incoming video data.
`
`
`
`Both black-and-white and color cameras are available. The camera will adhere to one of
`two standard video formats: NTSC or PAL.Theparticular variant of PAL used is PAL B-
`G. The following table presents the differences between NTSC and PALfor the
`characteristics important to 20/20 Hindsight.
`
`
`Parameter
`
`
`Output Standard
`RS-170
`Resolution (horizontal X 640X480|768 X 576
`
`
`
`vertical)
`
`
`
`Frame Rate 30/second|25 / second
`
`
`
`
`
`Field Rate 60/second|50/ second
`
`
`
`
`Fora particular installation, the selection ofNTSC vs. PAL video standard for the 20/20
`Hindsight system is dependent upon the power line frequency standard in use at the
`locality. If the location uses 60 Hz power, 20/20 Hindsight will use NISC cameras and
`
`Preliminary Draft (Not for Distribution)
`
`lo
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 019
`
`

`

`
`
`video equipment. If the location uses 50 Hz power, 20/20 Hindsight will use PAL
`cameras and video equipment.
`Both NTSC and PAL video standards produce interlaced video signals, where the even
`lines of a frameare captured in onefield, and the odd lines are captured 1/60" or 1/50" of
`a second later, respectively, in the subsequent field. Two successivefields, 1 even plus1
`odd, make up a frame.In an ordinary video frame display, a fast-moving objectwill
`appear blurry, becausethe frameis the interlaced composition of two fields captured at
`‘slightly different times. The Hindsight Viewer will analyze the video image and display
`the two fields separately so that no interlace blurring occurs. The Hindsight video update
`rate is 60 images / second for NISC cameras and 50 images / second for PAL.
`
`Camera Setup
`Cameras have a Setup menuthat controls the important functionsof the camera. Each
`camera will have a different setup procedure. See the camera manual fordetails on how
`to program specific cameras. Some of the important parameters are discussed below.
`
`Electronic Shutter Speed Setting
`The camera electronic shutter speed setting controls the amountoftimethat light energy
`is integrated (averaged) by the camera for each field. The longer the shutter time, the
`more light that contributes to the image. Generally longer shutter timesyield a brighter,
`sharper picture. However, by keeping the shutter open longer, you increase the distance a
`moving object will travel across the image during the time the shutter is open. This has
`the effect of blurring moving details. To ‘freeze’ a moving object, you want a fast shutter
`time. Of course this means less time to integrate the incident light, so you need lots of
`light on the video view. You can always adjustthe electronic shutter setting for more
`light, trading off a little of your ability to capture fast movingdetail clearly.
`
`Video FrameSyncSetting
`In the interest of video quality, especially as related to lighting, it is advantageous to use a
`video standard with a refresh rate equal to the powerline frequency. The camera frame
`rate can be synchronized with the powerline frequency. This assures that every video
`‘field will be captured at the same point (the same phase) in the powerline cycle.
`Although it is not apparent to the human eye,there is a cyclic variation in the intensity of
`artificial electric light that follows the cycling ofthe AC power line frequency. If the
`camera frame rate is not synchronized with the variations in light intensity, each frame
`will be captured in a slightly different lighting environment. The gradual drift ofthe
`frame capture timevs. the light intensity cycle will cause a slowly cycling light and dark
`variation in the apparent brightness of the video picture. In a color signal, whites will
`appear to darken to gray or yellow, and return to white in a slow cycle.
`
`Lens Setting and Adjustment
`Thestandard 8-48 mm zoom lenshas three adjustmentrings, focus, zoom, and aperture
`(Figure 4). Focus is the most forward adjustment ring on the lens. Zoom is the center
`adjustment. Apertureis the rear adjustment. The aperture adjustment has twoeffects, one
`ofwhich will also interact with the shutter speed setup on the camera electronic settings.
`
`Preliminary Draft (Notfor Distribution)
`
`i
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 020
`
`

`

`The aperture ring controls the size of the opening through which light must pass in order
`to fall upon the light-sensing element of the camera. Opening the aperture increases the
`opening, allowing more light to reach the camera, and giving a brighter picture. You
`might think that widest possible opening is best, but in some cases there is a competing
`criteria. The size of the aperture also controls the depth offield of the focus ofthe lens.
`Bythis is meant the range ofdistance, near to far, that will be in focus at the same time
`for a given setting of the focus adjustment. A small aperturesetting, while letting in little
`light, will on the other hand provide a greater depth offield. A large aperture setting,
`while letting in more light, will on the other hand providea lesser depth offield. If the
`video view attempts to a wide range ofboth foreground and backgrounddetail, you will
`need sufficient depth of field to keep both the near and far extremesof the view in focus.
`Of course you can always adjust the electronic shutter setting for more light, trading off a
`little of your ability to capture fast moving detail clearly. In practice you must use
`judgmentto find the best trade-off of these interacting parameters.
`
`
`
`
`
`
`
`
`
`Figure 4: Rainbow 8-48 mm lens, showing the focus, zoom, and aperture adjustmentrings
`
`External Trigger
`The 20/20 Hindsight system can respond external events, making a movie automatically
`using the external trigger interface. The external trigger could come from a control
`system, process upset sensor, or vision analysis system. External events are signaled to
`20/20 Hindsight by a contact closure, such as a relay.
`
`Preliminary Draft (Not for Distribution)
`
`-
`
`IS
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 021
`
`

`

`Connect the externaltrigger interface box to the 20/20 Hindsight capture computer using
`the DB9M/DBO9Fserial communications cable. Plug the serial cable DB9F(female) into
`serial port COMIon the capture computer. Plug the serial cable DB9M (male) into the
`mating connector on the external trigger interface box. Connect the contact closure leads
`from the signaling system to terminals 1 and 2 on the external trigger interface box.
`Connect the trigger interface power supply cable to the mating connector on the interface
`box, and plug the power supply in the AC power source.
`
`There is a momentary push-button switch on the external trigger interface box, which can
`be used to simulate a contact closure. Push this button to test the serial cable connection
`and make a movie.
`
`A movie will be made when the external contacts go from open to closed. The external
`signal must open and close again to make a subsequent movie. The 20/20 Hindsight
`system will not respond to subsequentevents less than 1 second following a recognized
`event.
`
`Software Setup
`The Capture Configuration dialog is invoked by clicking onthe button in the
`
`upper right corner of the program.
`
`Name
`
`Buffer Size
`(Megabytes)
`
`Event Offset
`(milliseconds)
`
`Figure 5: Capture Configuration
`
`This is the nameofthe video signal. Usually this would
`describe the location ofthe field of view.
`
`This parameter specifies how much disk space you wish to
`dedicate to the circular video buffer. The size of the buffer
`determines the number of hours and minutes of video data that
`can be stored before the buffer begins to overwrite.
`This parameterspecifies the time delay from the actual
`occurrence of an event until the event trigger reaches the
`20/20 Hindsight System. The system will select a video
`
`Preliminary Draft (Not for Distribution)
`
`lq
`
`Motorola v. Stellar
`
`Motorola Exhibit 1030
`Page 022
`
`

`

`trigger framethat is earlier than the trigger arrival by the time
`specified here. Use this parameter to synchronize movies to
`the process and to synchronize movies to each other in a
`multiple camera system, where each camera is viewing the
`processat a different point along the processline.
`
`This parameter specifies the number of frames of video to be
`included in the moviesbefore the trigger frame. There are 60
`frames per second for NTSC cameras and 50 framesper
`second for PAL cameras.
`
`This parameter specifies the number of framesof video to be
`included in the movies after the trigger frame.
`This parameter specifies the maximum number of movies to
`be saved. When the maximum number of movies is reached,
`the oldest movies will be discarded as additional new movies
`are made.
`
`Number Of Frames
`Before Event
`
`Number Of Frames
`After Event
`
`Maximum Number
`Of Clips On Capture
`
`System Operation
`The Hindsight softwareis invoked byselecting the Hindsight Viewer program in the
`Start Menu, Programs. The Viewer program displays the contents of the video buffer and
`any movies that have been saved out ofthe buffer.
`
` Position Slider Bar
`
`General Display Layout
`Controls on the display allow the user to easily manipulate the viewsto identify the
`important frames ofinterest (Figure 5):
`Movie Display Window Thevideo stored in the buffer is displayed in the window. The
`video can be played forwardor reverse in steps ofsingle
`frames or in time unit steps of seconds, minutesor hours.
`The position slider bar graphic