`
`
`IIIIIHIIIIIIIIIII'I-‘IIIIIIlLilIIIIIIIIIIIIIIIIIIIIIIIIIIII-IIIIIIIIII'IIIIIIII'IIIIIIIIIIIIIIIIIIIIlII'lII‘IlIllIIlIIllIla
`
`
`
`UNITED STATES DEPARTMENT OF COMMERCE
`
`United States Patent and Trademark Office
`
`November 07, 2014
`
`THIS IS TO CERTIFY THAT ANNEXED IS A TRUE COPY FROM THE
`
`RECORDS OF THIS OFFICE OF THE FILE WRAPPER AND CONTENTS
`
`APPLICATION NUMBER: 09/?90,331
`
`FILING DATE: April 11, 2002
`
`By Authority of the
`
`
`
`
`,
`Under Secretary of Commerce for Intellectual Property
`and Director of the United States Patent and Trademark Office ,
`
`
`
`M. TARVER
`
`Certifying Officer
`
`
`
`
`Apple Ex. 1004
`
`Page 1
`
`Page 1 of 315
`
`Samsung Exhibit 1004
`
`

`

`
`
`The te_rm of this patent
`
`’
`
`ubsequentto'
`
`2;
`93
`’ I--.<
`
`.9
`U)
`
`PATENT NUMBER
`
`o ‘
`LIJ
`DU)
`2
`
`APPLICATION NO.
`037/{90381
`
`CONT/PRIOR CLASS
`D
`358
`
`SUBCLASS '
`AFITUNIT
`#00 26:22
`
`“I
`V"
`
`,
`
`APPLICANTS
`
`TITLE
`
`HIGINALV
`
`DISCLAIMER
`
`
`
`
`
`
`
`
`‘
`‘ m ofthis” patenlshall
`3.
`o't xtendbeyond the expiration date-
`
`Page 2 of 315
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 2
`
`Page 2 of 315
`
`Samsung Exhibit 1004
`
`

`

`PATENT APPLICATION SERIAL NO.
`
`US. DEPARTMENT OF COMMERCE
`PATENT AND TRADEMARK OFFICE
`FEE RECORD SHEET
`
`02/26/2001 EHRILEI
`
`00000016 09790381
`
`01 FE:201
`02 FD:203
`
`355.00 OF
`198.00 0P
`
`Rd 'ustnent date: 05/03/2002 UTRUUHGI
`02 20/2001 EHQILEI
`00000016 09790361
`01 FC:201
`-355.00 00
`
`05/03/2002 UTRUDNGl 00000072 500259
`
`09790381
`
`01 FD:201
`
`15.00 CH
`
`355.00 HP
`
`PTO-1556
`
`(5/87)
`‘UIS, GPO: 2000-465-987/39595
`
`Apple Ex. 1004
`
`Page 3
`
`Page 3 of315
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 3
`
`Page 3 of 315
`
`Samsung Exhibit 1004
`
`

`

`
`
`Page 1 of 1
`
`
`COMMISSIONER FOR PATENTS
`UNITED STATES PATENT AND TRADEMARK OFFICE
`VVASHINGTUN. 0.6. 2023!
`
`www.uspto.gov CONFIRMATION NO. 5404
`
`Bib Data Sheet
`
`'
`SERIAL NUMBER
`09/790,381
`.
`. PPLICANTS
`David A. Monroe, San Antonio, TX;
`
`FILING DATE
`04/11/2002
`RULE ,
`
`'
`
`GROUP ART UNIT
`2622
`
`'
`
`ATTORNEY
`DOCKET NO.
`069834.000038
`
`* CONTINUING DATA ***k**********kfi*******t*
`THIS APPLICATION IS A DIV OF 09/006,073 01/12/1998 ABN :TCDfi P
`* FOREIGN APPLICATIONS k**************i****
`
`IF REQUIRED, FOREIGN FILING LICENSE GRANTED,,,, SMALL ENTITY w,
`
`Stephen F. Schlather
`Bracewell & Patterson, L.L.P.
`711 Louisiana, Suite 2900
`
`
`
`‘ pparatus for capturing, converting and transmitting a visual image signal via a digital transmission system
`
`El All Fees
`
`CI 1.18 Fees (Filing)
`
`FILING FEE FEES: Authority has been given in Paper
`RECEIVED No.
`to Charge/credit DEPOSIT ACCOUNT
`.
`for followmg.
`
`F] 1.17 Fees (Processing Ext. of
`lJme )
`CI 1.18 Fees ( Issue)
`
`D Other
`
`CI Credit.
`r. mamma'lr‘m’pwmmmflwars'5'.'M1WW’tvW”WWWWM’WHfitmuiwxmwanvurWmnmmmtunttmmmrmu:
`
`Apple Ex. 1004
`
`R
`
`Page 4
`
`Page 4 of 315
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 4
`
`Page 4 of 315
`
`Samsung Exhibit 1004
`
`

`

`www.uspto.gov CONFIRMATION N0. 5404
`
`
`
`Page 1 of 1
`
`COMMISSIONER FOR PATENTS
`UNITED STATES PATENT AND TRADEMARK OFFICE
`WASHINGTON. D.C. 2025”
`
`Bib Data Sheet
`
`SERIAL NUMBER
`09/790381
`. PPLICANTS
`
`FILING DATE
`0221,2001
`RULE
`
`David A. Monroe, San Antonio, TX;
`
`GROUP ART UNIT
`2622
`
`ATTORNEY
`DOCKET NO.
`069834000038
`
`* CONTINUING DATA ***********************1¢*
`THIS APPLICATION IS A DIV OF 09/006,073 01/12/1998 ABN
`
`fr FOREIGN APPLICATIONS ****k***************
`
`IF REQUIRED, FOREIGN FILING LICENSE
`GRANTED ** 03/26/2001
`
`*"‘ SMALL ENTITY **
`
`I oreign Priority claimed
`
`D D
`”°
`yes
`:5 USC 119 (a-d) conditions D D D M t
`fl
`at
`Allovggrsice m
`e 3 er
`Examiner‘s Si- nature
`
`STATE OR
`SHEETS
`co‘LI‘iTRY DRAWING
`
`TOTAL
`CLAIMS
`42
`
`INDEPENDENT
`CLAIMS
`1
`
`Stephen F. Schlather
`Bracewell & Patterson. L.L.P.
`711 Louisiana, Suite 2900
`Houston ,TX 77002
`
`ITLE
`
`
`
`pparatus for capturing, converting and transmitting a visual image signal via a digital transmission system
`
`D All Fees
`
`CI 1.16 Fees ( Filing)
`
`FILING FEE FEES: Authority has been given in Paper
`RECEIVED No.
`to charge/credit DEPOSIT ACCOUNT
`.____for followmg.
`
`I: 1 17 Fees ( Processing Ext- of
`tIme )
`D 1.18 Fees( Issue)
`
`D Other
`
`D Credit
`
`
`Apple Ex. 1004
`
`Page 5 of 315
`
`Page 5
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 5
`
`Page 5 of 315
`
`Samsung Exhibit 1004
`
`

`

`£7? 2 d—i/
`
`Attorney DocketNo.
`
`.
`
`-
`
`“834000024
`
`D12!
`
`
`"laUIMI?Wllllllllllllllllllllllllll
`
`
`"
`UTILIT
`PATENT APPLICATION
`TRANSMITTAL
`(Only for new nonprovisional applications under 37 CFR
`
`1.53(b))
`
`
`ADDRESS TO:
`Commissioner of Patents
`Box Patent Application
`
`Washington, DC 20231
`
`
`.
`’
`First Named Inventor
`
`Title
`
`
`
`David A. Monroe
`
`
`
`Express Mail No.
`
`EL285224761US
`
`APPLICATION ELEMENTS
`See MPEP chapter 600 concerning utility patent application contents
`l. L FEE Transmittal Form PTO/SB/l7(Sllbl}1[fin
`duplicate)
`?§:§;ag;:ill§:_small emlty Stams'
`2’ —'
`3. _X_ Specification
`[Total Pages: _30_]
`4. __ Drawing(s) (35 USC 113)
`[Total Sheets: _]
`5. _ Oath or Declaration
`[Total Pages: _]
`a. _ Newly executed (original or copy)
`b. _ Copy from a prior application (37 CFR 1.63(d))
`(for canti'nuation/divisional with No. 17 completed)
`i. __
`DELETION OF INVENTORgS)
`Signed statement attached deleting
`inventor(s) named in the prior application, see
`37 CFR 1.63(d)(2) and 1.3303).
`6. L Application Data Sheet. See 37 CFR 1.76
`7. _ CD-ROM or CD-R in duplicate, large table or
`Computer Program (Appendix)
`8. _ Nucleotide and/or Amino Acid Sequence Submission
`(ifapplicable' all necesyqyy)
`a. _ Computer Readable Form (CRF)
`b. _ Specification Sequence Listing on:
`i. CD-ROM or DC—R (2 copies); or
`ii. Paper
`Statements verifying identity of above
`copies
`
`c. __
`
`
`
`ACCOMPANYING APPLICATION PARTS
`
`9. _ Assignment Papers (cover sheet & document(s)
`
`10- __ 37 CFR 3.7303) Statement
`(Wl'e’l there is “’1 “SSig’I’ne’lU
`—
`Power Of Attorney
`
`11- _ English Translation Document (ifapplicable)
`
`12. __.
`
`Information Disclosure
`Statement (IDS)/PTO‘1449
`__ COPies of IDS Citations
`13- _ Preliminary Amendment
`
`14. _)<_I_ Return Receipt Postcard (Itemized)
`
`15. _ CCI’tlfiCd Copy Of Priority DOCUant(S)
`(ifforel'gn Priority is Claimed)
`
`
`16 _ Other?
`
`[7.
`
`If a CONTINUING APPLICATION, check appropriate blank and supply the requisite information below and in a preliminary
`amendment, or in an Application Data Sheet under 37 CFR 1.76:
`__ Continuation
`of prior application No.: 09/006,073
`L Divisional
`Prior application information: Examiner
`
`Group/Art Unit
`
`__ Continuation-impart (CIP)
`
`For CONTINUATION OR DIVISIONAL APPS only: The entire disclosure of the prior application, from which an oath or declaration is supplied
`under Box 5b, is considered a part of the disclosure of the accompanying continuation or divisional application and is hereby
`incorporated by reference. The incorporation can only be relied upon when a portion has been inadvertently omitted from the submitted
`application parts.
`
`18. Correspondence Address
`
`
`
`__ Customer Number or Bar Code Label
`
`or -
`
`i Correspondence address below
`
`(Insert Customer No. or Attach bar code label here)
`
`
`
`
`
` Dae:___X-a/~o__l WeStep 1e F. Schlather, Reg. No. 45,081
`
`Name
`
`Attn: Stephen F. Schlather
`
`BRACEWELL & PATTERSON, L.L.P.
`
`711 Louisiana, Suite 2900
`Address
`City
`Houston
`Comm
`USA.
`
`
`
`State
`Telephone
`
`77002
`Zip Code
`| Texas
`
`(713) 221-1339
`Fax
`(713)221-2141
`
`Apple Ex. 1004
`
`Page 6 of 315
`
`Page 6
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 6
`
`Page 6 of 315
`
`Samsung Exhibit 1004
`
`

`

`mt
`
`
`FEE TRANSM :
`
`
`
`
`Complete if Known
`
`1
`
` L FOR FY 2000
`
`
`
`
`
`
`09/006,073 ‘
`i Application Number
`
`l Filing Date
`
`First Named Inventor
`David A_ Monroe
`Examiner Name
`
`Group / Art Unit
`
`069834000024
`Attorney Dockct N0.
`$ 553.00
`Total Amount of Payment
`
`
`METHOD OF PAYMENT (Check one)
`1. L The Commissioner is hereby authorized to
`charge indicated fees and credit any overpayments to:
`Deposit Account No:
`50—0259
`Deposit Account Name:
`Bracewell & Patterson, L.L.P.
`
`Fee
`Paid
`$
`is
`
`$
`
`$$ $
`
`3%
`
`$
`
`3
`
`$
`
`$
`$
`
`$
`$
`
`130
`$
`$2,520
`$ 920*
`
`130
`$
`$2,520
`$ 920*
`
`S 390
`
`$
`
`195
`
`35 890
`
`$1,390
`
`$1,890
`
`$ 310
`$ 310
`
`$ 270
`$ 1,510
`
`$ 445
`
`is 695
`
`$ 945
`
`$
`$
`
`155
`155
`
`135
`$
`$1,510
`
`
`
`
`
`
` FEE CALCULATION (continued)
`3. Additional Fees
`
`Large
`Small
`-
`Fee Description
`
`
`
`
`Entity
`Entity
`
`
`
`
`$
`130
`$ ‘ 65
`Surcharge — late fee or oath
`
`
`$
`50
`$
`25
`Surcharge - late provisional
`
`
`
`
`filing fee or cover sheet
`
`
`
`
`Non-English specification
`
`
`
`
`Charge any additional Fee Required Under 37
`__X_
`Request for Reexamination
`
`
`CFR §§ 1.16 & 1.17
`
`
`Requesting publication of SIR
`
`
`
`
`prior to Examiner action
`
`
`
`Requesting publication of SIR
`$1,840*
`$1,840*
`Applicant claims small entity status.
`alter Examiner action
`
`
`See 37 CFR 1.27
`$ 110
`$
`55
`Extension for reply within
`$
`
`
`
`first month
`
`
`
`2. _X_ Payment Enclosed:
`Extension for re 1 within
`.
`
`
`Credit card __ Money Order
`L Check
`second month p y
`
`
`
`
`
`Extension for reply within
`
`
`
`'
`.
`_
`third month
`
`
`
`
`
`1: 32's” F1““ Fee
`Extension for reply within
`
`
`
`Large
`Small
`fourth month
`Entity
`Entity
`'Extension for reply within
`
`
`Fee
`Fee ($)
`fifth month
`
`,
`.
`,
`,
`($)
`Notice of Appeal
`
`
`
`
`
`
`$710
`$355 UtilitflgFee
`3 355-00
`Filing a brief in support of an
`
`
`
`$320
`$160
`Desrn Filing Fee
`appeal
`
`
`
`
`$490
`$245
`Plant Filin-
`Request for oral hearing
`
`
`
`$355
`Reissue Filing Fee
`Petition’to institute a public use
`
`
`
`
`
`
`
`
`
`
`$ 75
`Provisional Filin Fee
`progét’admg
`.
`
`
`
`Subtotal 1)
`Petition to reVive -
`unavmdable
`
`
`
`
`
`
`2. Extra Claim Fees
`
`
`
`
`
`
`Claims
`Extra
`
`
`
`
`
`
`Total
`42 —20** = 22
`x s 9.00
`$ 198.00
`
`
`
`
`
`
`
`
`
`
`
`
`Petitions to the Commissioner
`I d
`3H _
`$
`$
`Petitions related to provisional
`11 ep. —— _
`—
`X
`
`
`
`
`applications
`|_
`
`
`
`
`
`
`
`
`
`
`Submission of Information
`Multiple Dependent
`$
`
`
`
`
`
`D$0105.11": Statement
`_
`**or number previously paid, if greater.
`For Reissues, see below
`
`
`Recording each patent aSSIgnment
`
`
`
`gfgggggfy (times number 0f
`Fee Description
`Filing a submission after final
`
`
`
`
`Claims in excess of 20
`rejection (37CFR§1.129(a))
`
`
`For each additional invention to
`Independent claims in excess of 3
`
`
`
`
`
`be examined (37 CFR § 1.129(b))
`Multiple dependent claim, if not paid
`
`
`
`
`Request for Continued
`**Reissue independent claims over original
`Examination (RCE)
`
`patent
`
`
`
`
`
`Request for expedited
`
`**Reissue claims in excess of 20 and over
`
`examination of a design
`
`
`application
`original patent.
`
`
`Other fee (specify):
`Subtotal 2)
`
`
`
`
`
`
`
`
`
`
`
`
`Fee
`Description
`
`
`
`
`
`
`
`$
`
`110
`
`$1,240
`
`$1,240
`$ 440
`$ 600
`
`$
`3
`
`$
`
`$
`
`$
`
`130
`50
`
`240
`
`40
`
`710
`
`$ 710
`
`$ 710
`
`$ 900
`
`$
`
`55
`
`$ 620
`
`$ 620
`$ 220
`$ 300
`
`$ 130
`$
`50
`
`$
`
`$
`
`240
`
`40
`
`$ 355
`
`$
`
`355
`
`$ 355
`
`S 900
`
`Petition to revive -
`unintentional
`
`Utility issue fee (or reissue)
`Dwg? Issue fee
`Plant issue fee
`
`$
`
`$
`
`$
`35
`$
`
`35
`$
`
`as
`
`S
`
`39
`
`53
`
`Date: X-g («91
`
`PTO/SB/17 (08-00)
`
`Phone: 713 221—1339
`
`Submitted by
`
`gtegéen F. gohlatheu Reg. No. 45,081
`
`Apple Ex. 1004
`
`Page 7 of 315
`
`Page 7
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 7
`
`Page 7 of 315
`
`Samsung Exhibit 1004
`
`

`

`
`
`
`
`APPARATUS FOR CAPTURING, CONVERTING AND TRANSMITTING
`A VISUAL IMAGE SIGNAL VIA A DIGITAL TRANSMISSION SYSTEM
`
`BACKGROUND OF THE INVENTION
`
`FIELD OF THE INVENTION
`
`5
`
`10
`
`
`
`The invention is generally related to image capture and transmission systems
`
`and is specifically directed to an image capture, compression and transmission system
`
`for use in connection with land line and wireless telephone systems.
`
`DISCUSSION OF THE PRIOR ART
`
`Industry has developed and continues to develop and enhance techniques for
`
`scanning, compressing, transmitting, receiving, decompressing, viewing and printing
`
`documents. This technology, encompassing the full body offacsimile transmission and
`
`reception, is currently in widespread use. The current standards, CCITT Group III and
`
`Group IV, define methods to scan and transmit high quality, bi-level images with a high
`
`15
`
`degree of success and has become commercially acceptable throughout the world.
`
`However, gray scale documents are not easily transmitted because the scanners and
`
`algorithms are not tailored to the function. Three dimensional objects will not fit into
`
`the flat document scanners and cannot be transmitted.
`
`Examples of systems that have addressed some of these issues are shown in
`
`20
`
`US. Patent No. 5,193,012 which shows a video to facsimile signal converter, and US.
`
`Patent No. 3,25 1,937 which discloses a system for transmitting still television pictures
`
`over a telephone line.
`
`Wire photography, and its extension , radio photography, have long been used
`
`by the news media. The most common form involvesan input device that converts
`
`25
`
`photographs into encoded signals for communication over telecommunications facilities
`
`or radio. At the receiving end, reproducing equipment reconvcrts the encoded image
`
`signals by exposing photographic film or other sensitized paper. The term facsimile is
`
`often use with these products.
`
`Apple Ex. 1004
`
`Page 8 of 315
`
`Page 8
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 8
`
`Page 8 of 315
`
`Samsung Exhibit 1004
`
`

`

`
`
`
`
`
`
`Still video equipment has recently become available from vendors such as
`
`Kodak, Canon and Sony, and is again primarily used by the television and print media,
`
`although applications are expanding rapidly in such areas as insurance investigations
`
`and real estate transactions. A still video camera captures a full color still video image
`
`5
`
`that can be reproduced using a special video printer that converts the still video image
`
`data into hard copy form. For applications requiring communication of the still video
`
`image, transmit/receive units are available wherein the image begins and ends as a
`
`videovimage.
`
`The Photophone from Image Data Corporation is an example of a specialty
`
`10
`
`product
`
`that combines a video camera, display and storage facility in a terminal
`
`package. One terminal can send a real time or stored still Video image to another for
`
`display or storage, or printing on special video printers. Again, the signal begins and
`
`ends as a video image.
`
`Another example of a specialty product is peripheral equipment available for
`
`15
`
`personal computers that enables the input/output, storage and processing of still video
`
`images in digitized formats. For instance, the Canon PV—540 is a floppy disk drive that
`
`uses conventional still video disks, digitizing and a still video image using a
`
`conventional format, and communicates with the computer through a standard
`
`communications 1/0 port.
`
`20
`
`US. Patent No. 5,193,012 discloses a still-video to facsimile conversion
`
`system for converting the still—Video image frame into ahalf-tone facsimile reproduction
`
`without having to store an entire intermediated gray scale image frame by repeatedly
`
`transmitting the still—video image frame from a still-video source to an input circuit with
`
`a virtual facsimile page synchronization module . This system permits image to
`
`25
`
`facsimile conversion by utilizing a half tone conversion technique.
`
`While the various prior art systems and techniques provide limited solutions
`
`to the problem of transmitting visual images via a facsimile transmission system, all
`
`fall short of providing a reliable and convenient method and apparatus for readily
`
`capturing, storing, transmitting and printing visual images in a practical manner.
`
`30
`
`Apple Ex. 1004
`
`‘
`
`Page 9
`
`Page 9 of 315
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 9
`
`Page 9 of 315
`
`Samsung Exhibit 1004
`
`

`

`
`
`
`
`
`
`mi!52"
`I)“ll
`
`SUMMARY OF THE INVENTION
`
`The subject invention is an image capture, compression and transmission,
`
`system that is specifically designed to permit reliable visual image transmission over
`
`land line or wireless communications using commercially available facsimile
`
`5
`
`transmission techniques. The invention incorporates a camera and signal converter into
`
`an integrated unit wherein the converted signal may be transmitted on a real time basis
`
`or may be stored in memory for laterlrecall and transmission. The design of the
`
`invention permits maximum flexibility, with the camera/converter/telephone or other
`
`transmission device being designed in a modular configuration wherein any or all ofthe
`
`10
`
`devices may exist as integrated or independent units.
`
`The preferred embodiment permits capture of a video image using a digital
`
`camera, an analog camera, or a video camera such as a camcorder. The captured Video
`
`image is then converted into still frame digitized format for transmission over any of
`
`a variety of transmission systems ranging from Group—III facsimile to computer, or to
`
`15
`
`a like device at a remote location, in any protocol desired. The invention recognizes
`
`that once the signal is digitized, the transmission protocols are virtually endless.
`
`For example, the present invention, permits a still frame visual image to be
`
`captured at a remote location and sent immediately, over wireless communication
`
`systems, to a remote location such as, by way of example, a computer system wherein
`
`20
`
`the image could be merged directly into newsprint. The image may also be sent to and
`
`printed as a hard copy using any Group-III facsimile machine, anywhere in the world.
`
`Where desired, the images may be stored in memory for later recall, and may be
`archived on a portable medium such as a memory card or the like.
`
`The system ofthe subject invention is particularly useful for applications where
`
`25
`
`immediate transmission ofvisual images ofscenes, people and objects is desirable and
`
`sophisticated equipment is not always available for receiving the information. The
`
`system also provides a unique and reliable means for transmitting Visual data to and
`
`from remote locations, such as, by way of example, law enforcement and emergency
`vehicles and the like.
`
`30
`
`In the preferred embodiment of the invention, the system includes a video
`
`Apple Ex. 1004
`
`Page 10 of 315
`
`Page 10
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 10
`
`Page 10 of 315
`
`Samsung Exhibit 1004
`
`

`

`
`
`
`
`
`
`camera and an integral cellular telephone, wherein the telephone using the standard
`
`audio mode or future digital modes, can be used to transmit and receive visual image
`
`signals. A desk model is also disclosed and permits connection to a standard land line
`
`telephonic system. A mobile console model is disclosed for use in law enforcement
`
`5
`
`vehicles, and the like. Other communication systems are also supported by the subject
`
`invention, including hardwired networks, radio and satellite transmission and the like.
`
`A local facsimile machine may be incorporated with the unit and can serve as
`
`a printer for providing hard copy of the captured image at the point of capture, as well
`
`as being adapted for receiving facsimile transmissions in the standard fashion.
`
`10
`
`The circuitry is disclosed for supporting any of the preferred configurations
`
`from a basic real time transmission system via Group-III fax to a comprehensive system
`
`supporting both land line and wireless transmission of image, audio and documentary
`
`data at both a local and remote station.
`
`The subject invention also permits digitized collection ofaudio signals through
`
`15
`
`the use of an internal microphone, and external input device, a cellular telephone, land
`
`line telephone, wireless radio or other communication system, and digitized audio
`
`playback, as well. The playback can be via an internal speaker, out an external out jack
`
`to a remote device or via a cellular telephone, land line telephone, Wireless radio or
`
`other communication system.
`
`20
`
`The digitized image and audio capture features permit association of audio
`
`with an image, as well as data with the image. Useful data associated with the image
`
`includes GPS from either internal or external GPS devices, range information from
`
`ranging devices, date and time, and text which may be input from an integrated
`
`keyboard or from a remote device.
`
`25
`
`It is an important feature of the invention that the system supports storage of
`
`images in an interim storage format including raw video, compressed video, interim
`
`gray scale format and/or half tone format. The image can also be stored in the selected
`
`output mode, such as by way of example, a Group III facsimile mode. The versatile
`
`capability of the system permits transmission of captured data to a standard bi-level
`
`30
`
`facsimile machine such as Group III, to gray scale facsimile systems or full color
`
`Apple Ex. 1004
`
`i
`
`Page 11
`
`Page 11 of 315
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 11
`
`Page 11 of 315
`
`Samsung Exhibit 1004
`
`

`

`
`
`
`
`facsimile systems, as well as to other remote receiving devices such as, by way of
`
`example, personal computers and network servers. The data may be transferred in any
`
`ofa variety offormats and protocols including JPEG, FAX, wavelets, emerging imagery
`
`5
`
`formats, FAX and computer data protocols. The invention is adapted to operate in
`multiple modes, with a unitary capture and send mode or separate capture and store, and
`send modes.
`
`
`
`In the preferred embodiment, the system is adapted for tagging a collected
`
`image, video, audio, and other data such as a GPS information, with geospatial
`
`information and real time clock and added text. This permits the complete historical
`
`10
`
`data to be transmitted simultaneously with the image signal.
`
`It is contemplated that the system ofthe invention would be self-contained with
`
`an integral power unit such as a disposable battery, rechargeable battery source or the
`
`like. Therefore, the system is adapted to power up when in use and power down or
`
`“sleep” when not activated, preserving power during idle time. The power systems for
`
`15
`
`the video camera,
`
`the video input circuits and converters,
`
`the modem or other
`
`transmission devices and other high drain components may be isolated and only
`
`powered when needed. This also permits use of ancillary firnctions, such as use as a
`
`cellular telephone, to proceed without draining the power source by powering idle
`
`components. The processor clock rate may also be slowed down during idle mode to
`
`20
`
`further conserve power.
`
`Where desired, the system also includes camera operation control capability
`
`through the use of a digital/analog circuits for converting digital commands to analog
`
`signals for controlling the gain, pedestal, setup, white clip, lens focus, white balance,
`
`lens iris, lens zoom and other functions of the camera from a local input device, a
`
`25
`
`remote device or as automatic or programmed functions. The central processor may
`
`also be used to control camera shutter rate. Other camera features and parameters
`
`which may be controlled in this manner are compressor resolution ( such as high,
`
`medium, low user settings) corresponding to compression rate parameters, field/frame
`
`mode, color or monochrome, image spatial resolution (640x420 pixels, 320x240 pixels,
`
`30
`
`for example), lens and camera adjustments, input selection where multiple cameras or
`
`Apple Ex. 1004
`
`'
`
`Page 12
`
`Page 12 of 315
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 12
`
`Page 12 of 315
`
`Samsung Exhibit 1004
`
`

`

`
`
`
`
`
`
`2
`xi»3.5...th
`
`Video sources are used and the like.
`
`When an integrated communications device is used, such as by way of
`
`example, a cellular telephone, the telephone can be isolated from the rest ofthe system
`
`to permit independent use, and independent power up and power off and other cellular
`
`5
`
`phone functions.
`
`In operation, the system permits not only the manual capture, dial (select) and
`
`send of images, but may also be fully automated to capture, dial and send, for example,
`
`on a timed sequence or in response to a sensor such as a motion sensor, Video motion
`
`detection, or from a remote trigger device. The remote trigger also may be activated by
`
`10
`
`an incoming telephone signal, for example.
`
`The remote device may also be use for remote loading and downloading of
`
`firmware, and for setting of the programmable parameters such as to provide remote
`
`configuration ofsampling modes during capture, compression rates, triggering methods
`
`and the like.
`
`15
`
`The triggering fiinction permits a multitude of sampling schemes for a simple
`
`triggered activation for capturing an image upon initiation to a trigger signal to more
`
`complicated schemes for capturing and transmitting images prior to and after receipt of
`
`the trigger signal. The trigger function can be set to operate, for example, on a time per
`
`sample and number of sample basis, or time per sample and total sample time basis, or
`
`20
`
`number of samples and total time basis. Depending on application, the trigger can
`
`sample in a prior to and after signal mode, using in combination the time per sample
`
`and number of samples prior and after signal basis, a total time basis, a percent prior
`
`versus percent after trigger basis, time per sample basis, time prior to and time after
`
`trigger basis, and other combination. For example, if the image capture device is
`
`25
`
`positioned to monitor traffic accidents at a specific location, and an audio signal sensor
`
`identifying a crash were used as the trigger, it would be desirable to collect image
`
`sample both prior to and after the trigger signal. The number of samples, total sample
`
`time, and percentage of samples prior to and after trigger would be controlled by the
`
`specific application.
`
`30
`
`Circular sampling techniques are supported by the data capture system of the
`
`Apple Ex. 1004
`
`Page 13 of 315
`
`Page 13
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 13
`
`Page 13 of 315
`
`Samsung Exhibit 1004
`
`

`

`
`
`
`
`
`
`present invention. This is particularly useful when triggering events are used to initiate
`
`transmission of collected image data over the communications system. For example,
`
`if a triggering event is motion detected at a motion sensor, it may be useful to look at
`
`the images captured for a period of time both prior to and after the actual event. The
`
`5
`
`circuitry of the subject invention permits any circular sampling technique to be utilized
`
`depending upon application, such as prior to an after trigger, only after trigger or only
`
`before trigger or prior to and after the trigger point. Again, as an example, it may
`
`desirable to look primarily at images captured before a triggering event if the event is
`
`a catastrophic event such as an explosion or the like. Other circular sampling
`
`10
`
`techniques may be employed, as well, incorporating multiple cameras, for example,
`
`wherein different fields are sampled depending upon the time frame in a sequence of
`events.
`
`It is, therefore, an object and feature of the invention to provide an apparatus
`
`for capturing, converting and transmitting a visual image via standard facsimile
`
`15
`
`transmissions systems.
`
`It is another object and feature of the invention to provide an apparatus for
`
`compressing the visual image data in order to minimize the capacity requirements ofthe
`
`data capture and storage system.
`
`It is an additional object and feature of the invention to provide an apparatus
`
`20
`
`for capturing and storing a visual image for later recall and review and/or transmission.
`
`It is yet another object and feature ofthe invention to provide an apparatus for
`
`storing a captured video image in digital format on a portable storage medium.
`
`It is an additional object and feature of the invention to provide an apparatus
`
`capable of sending and receiving telephonic audio messages, facsimile documents and
`
`25
`
`captured visual images to and from standard, readily available remote stations.
`It is a further object and feature of the invention to provide the means and
`
`method for capturing images prior to, prior to and after, or after a triggering event.
`
`It is also an object and feature ofthe invention to provide for multiple triggering
`
`events and/or optional Viewing or review of the captured images prior to printing or
`
`30
`
`transmission.
`
`Apple Ex. 1004
`
`Page 14 of 315
`
`Page 14
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 14
`
`Page 14 of 315
`
`Samsung Exhibit 1004
`
`

`

`
`
`
`
`
`
`It is another object and feature of the invention to provide an apparatus which
`
`may be activated from a remote location for initiating the capture of images by the
`
`device.
`
`Other objects and features will be readily apparent from the drawings and
`
`5
`
`detailed description.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`Fig. 1 is a block diagram ofa basic facsimile camera configuration for capturing
`
`an image via a camera and transmitting it via Group—III facsimile transmission to a
`
`10
`
`standard hard copy medium.
`
`Fig. 2 is similar to Fig.
`
`l, but incorporates a memory storage capability,
`
`permitting storage and optional review or viewing of the image prior to transmission.
`
`Fig. 3 is similar to Figs. 1 and 2, but incorporates a data compression scheme
`
`for increasing the capacity of the memory and for increasing efficiency oftransmission.
`
`15
`
`Fig. 4 includes the capture and transmission configuration of Fig. 2, with
`
`multiple transmission format capability including Group-III facsimile, personal
`
`computer, modem, parallel and serial transmission schemes.
`
`Fig. 5 is an exemplary schematic diagram supporting the configurations shown
`
`in each of Figs. l—4.
`
`20
`
`Figs. 6A, 6B, and 6C, are block diagrams of the physical components of
`
`desktop, portable and comprehensive console embodiments of the invention,
`
`respectively.
`
`Fig. 7A and 7B are perspective drawings of a hand held device for capturing,
`
`storing and transmitting an image in accordance with the invention (new drawings to
`
`25
`
`replace Frassinito design.
`
`Figs. 8A-8L (Formerly Fig. 12) comprises a schematic diagram for an exemplary
`
`embodiment of the circuit for supporting the subject invention.
`
`Fig. 9 is a diagram of the various triggering sequence options.
`
`Apple Ex. 1004
`
`Page 15 of 315
`
`Page 15
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 15
`
`Page 15 of 315
`
`Samsung Exhibit 1004
`
`

`

`
`
`
`
`
`
`DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
`
`The image capture and transmission system ofthe subject invention is suited for
`
`capturing one or more single frame analog image or a digital image data signal and
`
`transmitting the captured signal via any of a plurality of transmission schemes to a
`
`5
`
`remote receiving station where the image is downloaded in a suitable format for
`
`viewing and printing on hard paper copy, a CRT screen image, or other medium. The
`
`system is particularly well suited for sending and/or receiving images Via a standard
`
`Group III facsimile transmission system and permits capture of the image at a remote
`
`location using an analog or digital camera. Two generic configurations are shown and
`
`10
`
`described, the first, where each image is transmitted as it is captured, and the second,
`
`which permits capture, storage, and selective recall ofcaptured images for transmission.
`
`The invention also contemplates a portable storage medium, wherein the captured
`
`stored medium may be removed from the capture device and archived for later use.
`
`While a system for black and white (gray tones) for Group—III facsimile transmission
`
`15
`
`is described in detail herein, the invention could be readily adapted to transmission of
`
`color images utilizing the teachings of the present invention using industry standard
`
`color Video standards and circuits. Both portable, or hand held, and stationary, or
`
`desktop, units are described. The circuitry utilized for both is configurations is
`
`identical , but stationary configurations do not need a battery.
`
`20
`
`Figs. 1-5 are circuit configuration diagrams for the various capture, storage and
`
`transmission schemes. The physical embodiments utilized to employ the teachings of
`
`the schemes taught in Figs. 1-5 are not limited. Figs. 6-10 are exemplary physical
`
`embodiments of the subject invention.
`
`Turning now to Fig. l, the simplest embodiment ofthe invention incorporates
`
`25
`
`a standard analog or digital camera device 10 for capturing a visual image in the typical
`
`fashion. The camera 10 may be operator activated as indicated at 12, or may be
`
`programmed to be activated at selected intervals or in response to certain conditions.
`
`For example, a motion detector may be utilized to activate the camera 10 in a
`
`surveillance installation. Once activated, the camera 10 captures a visual image in
`
`30
`
`typical fashion through a lens (see lens 192, for example, in Fig. 7A). In the illustrated
`
`Apple Ex. 1004
`
`Page 16 of 315
`
`Page 16
`
`Samsung Exhibit 1004
`
`Apple Ex. 1004
`
`Page 16
`
`Page 16 of 315
`
`Samsung Exhibit 1004
`
`

`

`
`
`
`
`-10-
`
`
`
`embodiment, the captured image is then transmitted to a gray scale bit map memory
`
`device 16, from which it is output to a half-tone conversion scheme 18 to be input into
`
`a binary bit map 20 for formatting the captured image in a configuration suitable for
`
`transmission via a Group-III facsimile system. The signal generated at 22 by the binary
`
`5
`
`bit map 20 is input into a Group-HI encoding a