US007365871B2
`
`(12)
`
`United States Patent
`Monroe
`
`(10) Patent N0.:
`(45) Date of Patent:
`
`US 7,365,871 B2
`Apr. 29, 2008
`
`(54) APPARATUS FOR CAPTURING,
`CONVERTING AND TRANSMITTING A
`VISUAL IMAGE SIGNAL VIAA DIGITAL
`TRANSMISSION SYSTEM
`
`_
`.
`.
`(76) Inventor‘ Davld A‘ Monroe’ 740 Lm°°.1n Center’
`7800 1H'10 West’ San Am°n1°> TX
`(Us) 78230
`_
`_
`_
`_
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`_
`( * ) Notice:
`
`(21) Appl. N0.: 10/336,470
`
`(22) Filed:
`
`J an- 3, 2003
`
`7/1979 Darby
`4,163,283 A
`4,179,695 A 12/1979 Levine et a1.
`4,197,536 A
`4/1980 Levine
`4,516,125 A
`5/1985 SchWab et a1.
`4,530,014 A
`7/1985 D’Alayer
`de Costemore D’Arc
`386/119
`3/1987 Withers et a1. ........... .. 347/226
`4,652,926 A
`8/1987 Hannon et a1. ............. .. 377/58
`4,688,244 A *
`5/1989 Bellman, Jr. et a1.
`4,831,438 A
`7/1989 Murge
`4,845,629 A
`g/1989 Everett, Jr, et a1,
`4,857,912 A
`4,884,132 A * 11/1989 Morris et a1. ............. .. 358/479
`4,891,650 A
`1/1990 Sheifer
`4,910,692 A
`3/1990 Outram
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`(65)
`
`Prior Publication Data
`
`EP
`
`220752
`
`5/1987
`
`US 2004/0001214 A1
`
`Jan. 1, 2004
`
`(Continued)
`
`Related US. Application Data
`
`OTHER PUBLICATIONS
`
`-
`-
`-
`(62) 132N115
`
`,
`
`-
`-
`of applfathon Ndo' 09/006’073’ ?led on Jan‘
`
`,noW a an one .
`
`Anonymous, “New & Old: Web-ready Camera Server, LAN Video
`Connects”, Security Distributing & Marketing; Apr. 1998; 28, 5; p.
`
`58'
`
`(51) Int. Cl.
`G06K 1/00
`
`(2006.01)
`
`(Continued)
`_
`Primary ExammeriHOuShang Safalpour
`
`_
`
`_
`
`(52) US. Cl. ................... .. 358/1.15; 358/402; 358/403;
`358/407
`
`(57)
`
`ABSTRACT
`
`(58) Field Of Classi?cation Search ............. .. 358/1.15,
`_
`_
`358/402, 403, 407, 442; 468, 474
`See aPPhCaUOn ?le for Complete Search 1115101'3’ -
`References Cited
`
`(56)
`
`U.S. PATENT DOCUMENTS
`
`2,642,492 A
`3,251,937 A
`3,751,159 A
`3,864,514 A
`4,074,324 A
`
`6/1953 Hammond, Jr. ............ .. 348/24
`5/1966 Hoag ........... ..
`358/410
`8/1973 Fisher
`355/20
`2/1975 Lemelson
`358/409
`2/1978 Barrett ..................... .. 358/296
`
`An image Capture, Conversion, compression, storage and
`transmission system provides a data signal representing the
`image in a format and protocol capable of being transmitted
`over any of a plurality of readily available transmission
`systems and received by readily available, standard equip
`ment receiving stations. In its most comprehensive form, the
`system is capable of sending and receiving audio, documen
`tary and visual image data to and from standard remote
`stations readily available throughout the World.
`
`15 Claims, 73 Drawing Sheets
`
`WEI-IN!
`FAX IPHONE
`
`VIDEO IN
`
`Iron Dome, Exh 1001
`
`

`

`US 7,365,871 B2
`Page 2
`
`US. PATENT DOCUMENTS
`
`6/1990 Finelli et a1. ............. .. 348/375
`4,937,676 A
`7/1990 Nakamura ..
`.358/401
`4,942,477 A
`6/ 1991 Reid
`5,027,104 A
`6/1991 Kawashime et a1.
`5,027,114 A
`7/ 1991
`5,032,911 A
`9/ 1991
`5,047,870 A
`2/1992 Pomerleau
`5,091,780 A
`4/1992 Erickson
`5,109,278 A
`5/1992 Erickson
`5,111,291 A
`5,166,746 A 11/1992 Sam er a1~
`5,191,601 A *
`3/1993 Ida et a1. ............... .. 348/14.01
`5,193,012 A
`3/1993 Schmidt .................. .. 358/3.16
`5,218,367 A
`6/1993 Sheffer et a1.
`5,235,432 A
`8/1993 Creedon et a1. .......... .. 358/479
`5,243,340 A
`9/1993 Norman eta1~
`5,243,530 A
`9/1993 Stamferet a1~
`5,268,698 A 12/1993 Smith, Sr. et al.
`5,283,643 A
`2/1994 Fujimoto
`5,321,615 A
`6/ 1994 Frisbie et 31
`5,334,982 A
`8/ 1994 Owen
`5,351,194 A
`9/ 1994 Rose et a1~
`5,400,031 A
`3/1995 Fins
`5,408,330 A
`4/1995 Squicciarini et a1.
`5,412,708 A *
`5/1995 KatZ ..................... .. 348/14.05
`5,432,838 A
`7/1995 Purchase
`5,440,337 A
`8/1995 Henderson et a1.
`5,440,343 A
`8/1995 Pamlski
`5,448,243 A
`9/1995 Bethke et a1.
`5,463,595 A 10/1995 Rodhall et 31
`5469371 A 11/ 1995 Bess
`5,497,149 A
`3/1996 Fast
`5,508,736 A
`4/1996 Cooper
`5,509,009 A
`4/1996 Laycock
`5,515,176 A
`5/1996 Galen et a1. .............. .. 358/403
`5,517,683 A *
`5/1996 Collett et a1. .......... .. 455/5751
`5,530,440 A
`6/1996 DenZer er a1~
`5,539,452 A
`7/1996 Bush et a1. ............ .. 348/14.13
`5,546,194 A
`8/1996 Ross ........................ .. 358/445
`5,550,646 A
`8/1996 Hassan et a1. ............ .. 358/442
`5,553,609 A
`9/1996 Chen eta1~
`5,557,254 A
`9/1996 Johnson GU11‘
`5,557,278 A
`9/1996 Piccirillo et a1~
`5,598,167 A
`V1997 Ziderhand
`5,612,668 A
`3/1997 Scott
`5,627,753 A
`5/1997 Brankin et a1.
`5,629,691 A
`5/1997 Jain
`5,636,122 A
`6/1997 shah et a1.
`5,642,285 A
`6/1997 Woo
`5,666,157 A
`9/1997 Avid
`5,666,159 A
`9/1997 Parulski et a1. ........ .. 348/2112
`5,670,961 A
`9/1997 Tomote et a1.
`5,677,979 A 10/1997 sqniooiarini
`5,684,716 A 11/1997 Freeman ................... .. 345/723
`5,689,300 A 11/1997 Shibata et a1. ......... .. 348/14.07
`5,689,442 A 11/1997 Swanson
`5,712,679 A
`1/1998 Coles
`5,712,899 A
`1/1998 Pace, 11
`5,714,948 A
`2/1998 Farmakis et a1.
`5,742,336 A
`4/1998 Lee
`5,751,346 A
`5/1998 Dozier
`5,777,551 A
`7/1998 Hess
`5,777,580 A
`7/1998 Janky et a1.
`5,793,416 A
`8/1998 Rostoker et a1.
`5,825,283 A 10/1998 canrhi
`5,835,059 A 11/1998 Nadel et a1.
`5,850,180 A 12/1998 Hess
`5,867,804 A
`2/1999 Pilley et a1.
`5,917,405 A
`6/1999 Joso
`5,926,210 A
`7/1999 Hackett et a1.
`5,933,098 A
`8/ 1999 Haxton
`5,938,706 A
`8/1999 Feldman
`
`5,974,158 A 10/1999 Auty et a1.
`5,983,161 A 11/1999 Lemelson et a1.
`5,999,116 A 12/1999 Evers
`6,002,427 A 12/1999 Kipust
`6,009,356 A 12/1999 Monroe
`6,067,571 A
`5/2000 lgarashi et a1‘
`6,069,655 A
`5/2000 Seeley
`6,072,600 A
`6/2000 Wertsberger .............. .. 358/479
`6,078,850 A
`6/2000 Kane et 31‘
`6,084,510 A
`7/2000 Lemelson et a1.
`6,092,008 A
`70000 Bateman
`6,100,964 A
`8/2000 De Cremiers
`6,133,941 A 10/2000 Ono
`6,154,658 A 11/2000 Caci
`6,157,317 A 12/2000 Walker
`6,181,373 B1
`1/2001 Coles
`6,195,609 B1
`2/2001 Pilley et a1.
`6,226,031 B1
`5/2001 Barraciough et a1.
`6,246,320 B1
`6/200l Nlonroe
`6,259,475 B1
`7/2001 Raniaonandran et a1.
`6,275,231 B1
`8/2001 Obradovich
`6,278,965 B1
`8/2001 Glass et a1.
`6,282,488 B1
`8/2001 Castor et a1.
`6,292,098 B1
`9/2001 Ebata
`6,356,625 B1
`3/2002 Casteiani
`6,385,772 B1
`5/2002 Counney
`6,424,370 B1
`7/2002 Courtney
`6,462,697 B1
`10/2002 Khmer et 31‘
`6,476,858 B1
`11/2002 Ramirez Diaz et a1.
`6,504,479 B1
`1/2003 Lemons
`6,522,352 B1
`2/2003 Strandwitz et al.
`6,525,761 B2
`2/2003 Sato et a1.
`6,549,130 B1
`4/2003 Joso
`6,556,241 B1
`4/2003 Yoshirnnra et a1.
`6,570,610 B1
`5/2003 Kipulst
`6,628,835 B1
`9/2003 Brill
`6,646,676 B1
`110003 DeGrace
`6,662,649 B1
`12/2003 Knight et a1.
`6,675,386 B1
`1/2004 Hendricks et a1‘
`6,698,021 B1
`2/2004 Amini
`6,720,990 B1
`4/2004 Walker et a1‘
`7,113,971 B1
`9/2006 Ohi et a1.
`2003/0071899 A1
`4/2003 Joso
`2005/0055727 A1
`3/2005 crearner et a1.
`2005/0138083 A1
`6/2005 Rastegar
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`JP
`JP
`JP
`JP
`JP
`JP
`JP
`WO
`WO
`WO
`W0
`W0
`
`232031
`532110
`209397
`613109
`613110
`613111
`744630
`785536
`06268582 A
`6-301898
`9-282600
`HEI-10-66058
`A-10-155040
`9-251599
`11-160424
`W090/04242
`W095/27910
`W096/12265
`W097/37336
`W098/52174
`
`8/1987
`3/1993
`7/1993
`8/1994
`8/1994
`8/1994
`11/1996
`7/1997
`9/1994
`10/1994
`10/1997
`3/1998
`6/1998
`4/1999
`6/1999
`4/1990
`10/1995
`4/1996
`10/1997
`11/1998
`
`OTHER PUBLICATIONS
`Anonymous, “The Eye’s Mind: the Brains Behind Online Moni
`toring”, Security: Jun. 1998; 35, 6; p. 68.
`
`Exh p. 2
`
`

`

`US 7,365,871 B2
`Page 3
`
`Zalud, Bill, “New & Old: Web-ready Camera Seriver, LAN Video”,
`Security: Mar. 1998; 35,3; p. 52.
`Mesenbrink, John, “Remote Video Surveillance: Breakthroughs
`Continue in LANs, WANs”, Security Distributing & Marketing;
`Mar. 2000; 30.4, p. 23.
`Mahonen, Petri, “Wireless Video Surveillance: System Concepts”,
`Proceedings International Conference on Image Anaysis and Pro
`cessing, ICIAP’99.
`Colombo, Ailan B., “Internet Video: Ride the Wave” Security
`Distributing & Marketing, Oct. 2000; 30, 13, p. 71.
`Anonymous, “SIA Police Chiefs Call Meeting on Public CCTV
`Law”, Security, Jan. 1999; 35, 1, p. 52.
`Mesenbrink, John, “Remote Video Surveillance: The Best of Both
`Worlds”, Security: Mar. 2000; 37, 3, p. 37.
`Anonymous, “School District sets Video Surveillance Standard”,
`Security, Jun. 2000, 37, 6; p. 43.
`Gold, Lessing E., “Remote Surveillance saves time, money”, Secu
`rity Distributing & Marketing, Jan. 1999; 29, 1, p. 105.
`Anonymous, “Video Security System Alternative”, Community
`Banker; Sep. 2000; 9,9, p. 52.
`Zalud, Bill, “Conquering Digital Marks CCTV Inovations”, Secu
`rity, Apr. 2000; 37, 4, p. 43.
`Anonymous, “Surveillance Cameras Harbour Racing Secrets”,
`Security, Jan. 2000; 37, 1, p. 29.
`Everett, H.R.. Laird, R.T., Gilbreath, G., Heath-Pastore, T.A.,
`Inderieden, R.S., Grant, K., Jalfee, D.M., “Multiple Resource Host
`Architecture for the Mobile Detection Assessment and Response
`System”, Space & Naval Warfare Systems Center; Technical Docu
`ment 3026; Aug. 1998.
`Collins, Robert T., Lipton, Alan J ., Kanade, Takeo, Fujiyoshi,
`Hironobu, Duggins, David, Tsin, Yanghai, Tolliver, David,
`Enomoto, Nobuyoshi, Hasegawa, Osamo, Burt, Peter, WiXson,
`Lambert, “A system for Video Surveillance and Monitoring”, CMU
`RI-TR-00-12; 2000 Cameige Mellon University.
`Wiggins, A.E., “Helsinki Journey Time Monitoring System”, May
`12, 1999 at IEE; CCTV and Road Surveillance.
`Kuo. Chin-Hwa, Wang, Tay-Shen, “Design of Networked Visual
`Monitoring Systems”, ISCAS 2000iIEEE Int’l Symposium on
`Circuits and Systems, May 28-31, 2000, pp. 297-300.
`Harrison, Ian, Lupton, David, “Automatic Road Traf?c Event
`Monitoring Information System (ARTEMIS)”, May 12, 1999 at
`IEE; CCTV and Road Surveillance.
`Bradbury, Spencer, “A Paper on Communications Protocols and
`Compression Techniques for Digital CCTV Applications”May 12,
`1999 at IEE; CCTV and Road Surveillance.
`Wunnava, Subbarso V., De La Cruz, Moises, “WEB Based Remote
`Security System (WRSS) Model Development”, Proceedings of
`IEEE SE Con 2000, Apr. 7-9, 2000, pp. 379-382.
`Bryan, W.D., Nguyen, H.G., Gage, D.W., “Man-Portable
`Networked Sensor System,” SPIE Cfr on Sensor Technology f/Sol
`dier Systems, Apr. 1998, SPIE vol. 3394, pp. 79-88.
`
`Balch, Kris, “Replacing 16mm Airborne Film Cameras w/Commer
`cial-Off-The-Shelf Digital Imaging,” SPIE CfriDigitization of
`Battlespace III, Apr. 1998, SPIE vol. 3393. pp. 226-237.
`Hata, Tsukada, BOH, Satoru, Tsukada, Akira, Ozaki, Minoru, “User
`interface using 3D model for video surveillance,” SPIE vol.
`3228,pp. 238-246.
`Yamashiro, Zuiki, Yoshiada, Toshihiro, Utilizing Picture Informa
`tion in the Traf?c Field: The Intelligent Integrated ITV Systems
`(IIIS), (IITS), Proceedings of the 1999 IEEE/IEEJ/JSAI Interna
`tional Conference on Intelligent Transporation Systems, Oct. 5-8,
`1999, pp. 224-229.
`Sato, Kazuya, Tsukada, Akihiro, Matsuda, Furnio, Kawasaki,
`Kaoru, Ozaki, Minoru, “Multimedia Systems for Industrial Surveil
`lance,” SPIE vol. 3020, pp. 182-19.
`Maeda, Hiromi, “About the Internet as ITS” Proceedings of the
`1999 IEEE/IEEJ/JSAI International Conference on Intelligent
`Transporation Systems, Oct. 5-6, 1999, pp. 478-483.
`Infographics Systems, “Network Video Recorder eWave NVR
`Series Digital Recorder/Administrators Manual,” 2001, pp. 1-47.
`Gage, Douglas W., Bryan, W. Dale, Nguyen, Hoa G., “Internetting
`tactical security sensor systems,” SPIE Cfr Digitization of Bat
`tlespace III; Apr. 1998, SPIE vol. 3393, pp. 184-194.
`Kohno, Atsushi, Hata, Toshihiko, Ozaki, Minorr, “Moving Object
`Detection Method Using H.263 Video Coded Data for Remote
`Surveillance Systems” IS&T/SPIE Cfr on Videometrics VI, Jan.
`1999, SPIE vol. 3641, pp. 247-258.
`Gage, Douglas W., “Network Protocols for Mobile Robot Systems”,
`SPIE vol. 3210, pp. 107-118.
`Laird, R.T., Everett, H.R., Gilbreath, G.A., Heath-Pastore. T.A.,
`Inderieden, R.S., “MDARS Multiple Robot Host Architecture”,
`Assn. of Unmanned Vehicle Systems, Jul. 10-12, 1995.
`Smart, J ., “Integrated Workstations for Reliable, Site-Independent
`Security Monitoring and Control”, IEEE Publication CH22645-0/
`88/0000-0145; 1998; pp. 145-149.
`Apr. 1966, Apollo Uni?ed S-Band System, NASA-Goddard Space
`Flight Center, Greenbelt, Maryland.
`Nov. 24, 19976, TELEXIS ViaNet General Information Booklet
`Version 1.3.
`2000, ViaNet 3000 Administrator’s Manual Version 1.1-NetXpress
`Video by TELEXIS, Kanata, Ontario, Canada.
`1999, ViaNet 3000 Operator Manual Version 1.0 by TELEXIS
`NetXpress Video, Kanta, Ontario, Canada.
`1999, viaNet 3000 Administrator Manual Version 1.0-NetXpress
`Video by TELEXIS, Kanata, Ontario, Canada.
`1999, ViaNet 3000 Instruction Manual Operator’s Revision
`l-NetXpress Video by TELEXIS, Kanata, Ontario, Canada.
`
`* cited by examiner
`
`Exh p. 3
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 1 0f 73
`
`US 7,365,871 B2
`
`1200505 bzmzép ZQmmuEES
`
`
`hummus d @2585 H.” Ha
`
`8\ § \ ON
`
`NN
`
`
`
`moan x5 H “505 .EoEE.
`
`
`
`1m J\_ \ S
`
`/
`
`\ a @2588 EEB V
`H.» Hé
`mm .\ mm \ Ergo“.
`
`ZOEEEQQ ._8p6E “58¢
`
`
`
`
`
`uzB l H2:
`
`2.
`
`or
`
`229E200
`.225 e1
`hep-L3
`5.25.3
`
`H .wE
`
`N?
`
`Exh p. 4
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 2 of 73
`
`US 7,365,871 B2
`
`.22E5.55:8>65:6.255
`
`5265
`
`8s8
`.22anwe
`
`2
`
`gm>56
`
`"2:hm
`
`2
`
`N.wE
`
`mag
`
`..5mm.
`
`EsE
`
`an
`
`zoF<o§azzco
`
`.mzzsfi
`
`«mm
`
`5.5ngHnu
`
`2058528a@2585
`
`
`EESOE:.22E.5:225
`5'
`
`
`
`353x5.“”E”.595SE
`
`
`
`Exh p. 5
`
`Exh p. 5
`
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 3 of 73
`
`US 7,365,871 B2
`
`«maaE«EgoE
`
`«83528
`
`
`.5220...SEW—.2—
`Emagmas
`
`:55time2.5:...
`2:E35m:5an
`
`0H
`
`2.mm
`
`am.0:
`
`28523258
`
`dzzéo
`
`.iawnmfl‘zu
`.2:E20328
`
`uze...
`
` zofimeESmo38th
`
`lawmésfig”E..253a.“Hé
`
`853xEH50545...».—
`
`Exh p. 6
`
`Exh p. 6
`
`
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 4 of 73
`
`US 7,365,871 B2
`
`dzzfifi
`
`ch<2z=228 9
`
`Exh p. 7
`
`Exh p. 7
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 5 of 73
`
`US 7,365,871 B2
`
`
`
`Exh p. 8
`
`Exh p. 8
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 6 0f 73
`
`US 7,365,871 B2
`
`0."
`
`0D
`
`1
`
`Nb
`
`
`
`mug. BEER
`
`hi _ 1 ii
`
`“ ~22 EE-Em
`
`Om.n.!\j
`
`03
`
`_ mm“
`
`
`
`2 .\, ullllllmm
`
`m2 828a
`
`mm .wE
`
`mud
`
`Exh p. 9
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 7 0f 73
`
`US 7,365,871 B2
`
`2 ,
`
`RH NB
`
`25
`
`$2 N2
`
`om 6E
`
`a: t E “22% E / L
`
`“53.8 us
`
`50 89> 5
`
`2. gas §./\ 2 ../.
`
`
`
`“.2: “20:52. 92 \U 8E.
`
`g
`
`5%.. 8
`
`A 3%
`
`
`
`
`
`f ‘Ema ‘ E), as w
`
`N3
`
`U
`
`~85:
`
`Exh p. 10
`
`

`

`U.S. Patent
`U.S. Patent
`
`Apr. 29, 2008
`Apr. 29, 2008
`
`Sheet 8 0f 73
`Sheet 8 of 73
`
`US 7,365,871 B2
`US 7,365,871 B2
`
`196
`
`196
`
`Exh p. 11
`
`Exh p. 11
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 9 0f 73
`
`US 7,365,871 B2
`
`FIG. 8A-1
`
`CRT DRIVER
`
`RJll
`CONNECTOR
`
`VIEW FINDER
`
`1
`2 HORZ
`
`( N H
`
`QNO'SUI-IBCDNH
`
`FIG. 8A-3
`
`FIG. 8A-3
`
`Exh p. 12
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 10 0f 73
`
`US 7,365,871 B2
`
`Z
`R 4
`
`awn
`61 B
`
`123456
`123456789
`
`A. A 8 m F
`
`FIG. 8A-3
`
`J13
`
`BATT CONN
`
`Exh p. 13
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 11 of 73
`
`US 7,365,871 B2
`
`FIG. 8A—3
`
`FIG. 8A—1
`FIG 8A—1.—-——————-——.
`9
`FIG. 8A-4
`FIG. 8A—26
`
`FIG. 8A—20)
`
`J8
`’
`INPUTI
`1
`2 mm'
`3 mini
`2
`BATEMP
`’
`
`6 B
`
`EE—ZR
`
`JST
`J7
`
`12
`
`9
`
`.md
`3W
`4W
`gI
`7 ”11H
`8m
`
`PROCESS“
`
`”MR F1G.8A—4 G)
`JST
`118
`1’
`3
`’
`4
`
`JST
`
`' s1
`
`.
`.32
`
`PORTRAIT CAPT
`
`122
`FAX /-PH0NE
`hamm— 1
`__ 2
`HUDFRoMDAA 3
`~
`AUDTODAA
`
`55
`
`7
`__ 8
`88m
`JST
`112
`1
`1 _ B48—ZR
`
`ALAPHAI
`
`DALE“ I—I
`
`
`
`A—DIAL
`
`B38—ZR
`JST
`
`FIG. 8A—5
`1
`
`Exh p. 14
`
`Exh p. 14
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 12 of 73
`
`US 7,365,871 B2
`
`vu<w.GE
`
`
`
`
`+Son;
`
` mNuwmmmgNIia55528IafimlmOmn=>
`
`1255v%M1.5095a
`manmm
`
`
`
`
` .m<m9...._.m_.
`
`W5.0:
`
`Exh p. 15
`
`Exh p. 15
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 29,2008
`
`Sheet 13 or 73
`
`US 7,365,871 B2
`
`828%88655553‘5555ww?vww-ww-d IIIIIIIIIIIIIIIIIIIIIIIII,
`
`CONN25
`
`FIG.
`8A-6
`
`FIG.
`8A-6
`
`xocowouuw-bwruw I I II I I l I
`
`E
`
`h In A?’ to
`
`J16
`_‘
`
`POWER
`ON /OFF
`
`POWER SWITCH
`
`B68-ZR
`JST
`J19
`
`LED /DOOR
`STATUS
`
`AUDIO
`CONNECTOR
`
`STATUS & DOOR
`._
`B68-ZR
`JST
`J7
`w
`
`LINEON
`GND
`LINEOUT
`gm
`CELCLK
`QCTRIQ
`NC
`
`ZHR-7
`.IST
`
`x1
`
`I)
`MICROPHONE
`LS1
`
`SPEAKER
`
`J15
`1
`2
`3
`4
`5
`6
`L
`B68-ZR
`.IST
`J2_O_
`1
`2
`3
`4
`5
`
`PROCESSOR
`
`6
`68-ZR
`JST
`J7
`T
`2
`3
`4
`5
`5
`1
`ZHR-7
`JST
`J27
`1
`
`2
`ZHRT;
`.IST
`J28
`1
`2
`L
`ZHR-2
`
`Exh p. 16
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 14 0f 73
`
`US 7,365,871 B2
`
`+ FIG. 8A-4
`
`1 1 J
`
`FIG. 8A-6
`
`Hm
`
`SERIAL
`CONNECTOR
`
`123456789NHHBMHMUNB222222
`
`012345
`
`CONN25
`
`Exh p. 17
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 15 of 73
`
`US 7,365,871 B2
`
`a
`
`a$3.“.a
`
`3...Nm
`
`i
`
`m25%
`
`*8
`
`
`
`z:lolllllll
`6II!
`3::e6$3:#m.
`$3:93::9m8
`
`.¢052=m2
`ANE8%m35.;“a
`
`Exh p. 18
`
`Exh p. 18
`
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 16 of 73
`
`US 7,365,871 B2
`
`zofiomzzooNmmxflmw
`
`Numwd:
`
`mmzfimm
`
`mun—Ems?
`
`EEmm15.o:_(:H(,2®13:
`
`7mm.9...
`
`mumm6:
`
`o=<>m
`
`Exh p. 19
`
`Exh p. 19
`
`
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 17 0f 73
`
`US 7,365,871 B2
`
`.oE
`
`mamm
`
`_
`
`_
`
`_1 11111 MW ||||||| IL
`
`_ _
`
`n 5 21 m2 _ _ _
`
`39%
`
`u _ j
`
`_ H
`
`_ _ m _ _ w
`
`_ " Alp
`
`_
`
`1:;
`
`AnEEi
`
`w
`
`922 mom
`
`719.22.“ m 3 2
`
`mlmm .oE
`
`2 P502 2 339.2 m N502
`@@
`
`7mm .wE Tmw d:
`
`is .w: aw
`
`Exh p. 20
`
`

`

`U.S. Patent
`
`‘Apr.29,2008
`
`Sheet18 0f73
`
`US 7,365,871 B2
`
`e.33:
`
`33:
`
`255
`
`NE
`
`«503
`
`3:02
`
`0503
`
`a:
`
`am3.v:232$5E;m052a
`
`V
`
`o3<>m
`
`5%
`
`92%-wmA6wmis9%®a:.o:
`3::6aAH2mlmmNmg
`BoH
`“6:55.51“.__2m___p_>>n___Enn8E_mosmzzs_8_0.2__NHu“8_Ha_____"m8"mm
`__SH____IIIIIIIIIIIIIIIL
`
`$dea.
`
`
`
`mtmw.9“.
`
`oz<>mn
`
`8%a.ind:
`
`Exh p. 21
`
`Exh p. 21
`
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 19 of 73
`
`US 7,365,871 B2
`
`'IL‘EE—<<(III_we>mumm8
`
`
`
`mnmm.9...Av
`
`80
`
`ID.a1.3:
`
`>6m2DE7mm.2...
`
`311mg...
`ms5ME88:
`
`«.2HmmoN231H
`It'll!HI6I;
`E:3%-wgag:m8%eIn0522v«Ee133
`In2e13:
`80mm:5.1.3:
`
`.5iSofiaavnm5.
`
`lad:
`
`Exh p. 22
`
`Exh p. 22
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 20 of 73
`
`US 7,365,871 B2
`
`«mm283mmE53MN~52:
`mm2:92
`
`uh
`
`InSNme
`
`2Na2
`
`ms
`
`252
`«252fig
`
`mum
`
`oumw.0:
`
`7mm.9
`
`Exh p. 23
`
`Exh p. 23
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 21 of 73
`
`US 7,365,871 B2
`
`+2258
`
`
`
`Tomdc
`
`Nuom.9...6
`
`33mm.
`
`5:82$.ng
`
`
`
`mumaaflfiflfim¢$m¢$¢$$83~m83mm“
`
`<414
`
`>
`
`mm3mmmma83&52322333933mmNmmwm2
`
`
`Wow.owlmwn/$35.0:3w.3$8a:
`>ebb
`
`Exh p. 24
`
`Exh p. 24
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 22 of 73
`
`US 7,365,871 B2
`
`FIG. 80—2
`
`R9
`
` FIG. 80—1
`
`FIG. 80—1
`
`Exh p. 25
`
`Exh p. 25
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 23 of 73
`
`US 7,365,871 B2
`
`FIG. 80-1
`
`FIG. 30-1 ®{
`I—‘L
`
`0 FIG. 80—4
`
`(I) ”6' 8°"
`0 FIG. 80-4
`
` FIG.
`
`80-1
`
`FIG. 80-1
`
`R12
`
`‘_———" VVV——-
`
`R11
`
`FIG. 80—3
`
`mm
`
`Exh p. 26
`
`Exh p. 26
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 24 of 73
`
`US 7,365,871 B2
`
`em
`
`mm
`
`70m.9...
`
`ME
`
`a:
`
`«.8a:e
`
`3aa:G63»a:
`
`:55
`
`W8.0:e
`
`Exh p. 27
`
`Exh p. 27
`
`

`

`Exh p. 28
`
`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 25 of 73
`
`US 7,365,871 B2
`
`ESE
`
`H a
`
`m.or.
`
`Exh p. 28
`
`
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 26 of 73
`
`US 7,365,871 B2
`
`N13.9“.
`
`s.
`55
`
`Exh p. 29
`
`Exh p. 29
`
`
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 27 of 73
`
`US 7,365,871 B2
`
`Exh p. 30
`
`
`
`POWER OFF
`
`FIG. 80—7
`
`1 2 3 4 5 6 7 8 9
`
`Exh p. 30
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 28 of 73
`
`US 7,365,871 B2
`
`1
`g
`
`4
`5
`5
`7
`8
`9
`1°
`g
`13
`14
`
`15
`
`13
`
`18
`19
`
`
`
`21
`22
`23
`24
`25
`
`R44
`
`_
`
`vmsv m
`
`11
`12
`13
`
`14
`
`15
`16
`17
`18
`19
`20
`
`11
`
`1o
`9
`8
`
`7
`
`6
`5
`4
`3
`2
`1
`
`1:
`
`8
`7
`
`I-XD7
`x05
`x05
`x04
`x03
`x0
`2
`XD
`1
`x3:%ao
`‘
`
`"-XIORD
`
`—XIOWR
`XAO
`
`5
`
`R20
`VIDEN
`
`
`
`
`
`20
`
`5 W
`—DMAKO
`4
`3
`2
`1
`
`T0
`AEN
`
`I-
`
`Exh p. 31
`
`Exh p. 31
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 29 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—5
`
`RESET
`
`r— ————— -I
`
`: MAIN RESET 1
`
`
`
`Exh p. 32
`
`Exh p. 32
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 30 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—6
`
`R49
`
`FIG. 80—10
`
`}.FIG.8D—10
`
`
`
`Exh p. 33
`
`Exh p. 33
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 31 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—7
`
`F——'-—
`ICAPTURE'
`——_——‘
`
`'—————
`ICAPTURE‘
`
`_————l
`
`
`
`] FIG. 8D—10
`
`FIG. 8D—3
`
`Exh p. 34
`
`Exh p. 34
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 32 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—8
`
`FIG. BINDIQHG' 80-10 «3
`
`game. 80—10
`
`
`
`Exh p. 35
`
`Exh p. 35
`
`

`

`U.S. Patent
`
`‘Apr.29,2008
`
`Sheet33 0f73
`
`US 7,365,871 B2
`
`mm=o>m
`
`aim—km
`
`Emzo
`
`con
`
`'3'me
`
`mnom.oE
`
`3%....“
`
`Ea?:22.IEa!é
`30So30m5:00E20SoN8 glam.GE
`
`Exh p. 36
`
`Exh p. 36
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 34 of 73
`
`US 7,365,871 B2
`
`Snow.0:
`
`Eam.rawmun—wGE
`
`
`
`one».2...
`
`mlomd...—H
`
`o¢3.3NV0v3mvmwh.m‘90m3mmmm.wmmmmmmmmmmmon
`
`mmmm
`
`mmmm
`
`hm#@
`
`mmmm
`
`mmmm
`
`¢mmm
`
`mm.mm
`
`mmmm
`
`
`
`onHHm0\.memwmoom.‘on
`
`mmNu
`
`mmmm
`
`mm#h
`
`mmmm
`
`mmmm
`
`¢NNB
`
`MNmu
`
`NNmm
`
`“Nom
`
`MNem.waaazgasmzfinss¢wBDDflma“
`
`#8a:m.
`
`Tom.w:
`
`Exh p. 37
`
`Exh p. 37
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 35 of 73
`
`US 7,365,871 B2
`
`mm!
`
`020
`
`ml
`
`-DK|H|
`
`R41
`
`
`
`FIG.8D—11
`
`(00:031-
`
`Du<Ohcl—D
`
`O-IIOXCED
`
`U)>-¢DU—|¥
`
`(DON
`
`(DOD
`
`mom
`
`(DOV
`
`mom
`
`(DON
`
`wow-
`
`(ODD
`
`24222018161412108642
`
`CONNECTOR
`
`VIN+
`
`HugU
`
`31
`
`252321191715131197i
`
`”(N
`
`W<H
`
`m<o
`
`loxmmg
`
`Ian—mm;
`
`l—OmO
`
`—n:o:n
`
`Io<ox~
`
`macaw-
`
`R21
`
`Exh p. 38
`
`Exh p. 38
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 36 of 73
`
`US 7,365,871 B2
`
`Snow6:
`
`218.9...3
`
`Eom>m
`
`am£86
`
`50>
`
`mum
`
`mm:
`
`I
`
`
`
`_—unnnnuw”mmmam
`
`mmn
`
`22%
`
`.22mm
`
`._.:_._m>
`
`mum
`
`5mm
`
`Exh p. 39
`
`Exh p. 39
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 37 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—13
`
`l l I l I
`
`1
`
`.1
`
`
`
`
`REAL TIME
`CLOCK OSC.
`
`W0—0
`
`P-‘__———_—_—_——_
`
`
`
`FIG. 8D—14
`
`
`
`(9 FIG. 80-14
`
`‘3 FIG. 80-14
`
`
`
`R10
`
`
`
`PROCESSOR
`l/O
`OSCILLATOR
`
`R12
`
`:-
`
`Exh p.40
`
`Exh p. 40
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 38 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—14
`
`
` FIG.
`
`186
`8D—13
`187
`
`133
`1
`189
`FIG. 80-15
`190
`191
`
`
`
`
`
`
`
`
`
`
`
`-ROM
`
`-XMRD
`
`—XMWR
`
`—KBSET
`—XIDRD
`—X|DWR
`-RC
`A206
`-KBRST
`
`KBCLK R17
`
`
`
`
`(9
`
`FIG. 80-13 ‘RESET
`9
`
`FIG. 8D—13 -
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`FIG. 80—17 —>
`
`PROCESSOR
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`1 0
`
`023-10
`
`«bi-IOW—
`
`Dan—ox
`
`wow—1:
`
`NOW-#1:!
`
`How—1:
`
`mHo—l
`
`O—I
`
`Exh p. 41
`
`192
`193
`194
`195
`196
`
`197
`198
`199
`200
`201
`202
`203
`
`fig
`
`206
`207
`208
`209
`210
`
`211
`212
`213
`214
`215
`216
`
`123456789
`
`
`
`
`Exh p. 41
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 39 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—15
`
`"W 6
`
`NON-VOUTOL 5m RAM 4
`
`7
`
`R47
`R48
`
`
`
`FIG. 80—16 —->
`PROCESSOR
`
`
`
`
`FIG. 8D-14
`
`Exh p. 42
`
`Exh p. 42
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 40 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—16
`
`FIG. 8D-17
`
`<— FIG. 80—15
`
`PROCESSOR
`
`Exh p. 43
`
`Exh p. 43
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 41 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—17
`
`*—— FIG. 80-14
`
`PROCESSOR
`
`FIG. 80-16
`
`I-
`
`MA10
`MA9
`MAS
`MA?
`MA6
`
`MA5
`
`MA4
`MAS
`MA2
`MAI
`MAO
`
`Exh p. 44
`
`Exh p. 44
`
`

`

`Exh p. 45
`
`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 42 0f 73
`
`US 7,365,871 B2
`
`FIG. 8D—18
`
`-
`
`s
`
`E L
`
`5 5
`
`x x
`
`A A
`
`o 1
`
`.:.
`
`1110987654321
`
`MODA3
`
`MODM
`
`12
`13
`14
`15
`
`i?
`
`18
`19
`20
`21
`22
`
`EE'gSE
`
`-—X|DRO
`
`RCA3
`
`-RCE
`
`-RCAUX
`
`—RCSHE
`
`—XIDWR
`
`44
`43
`42
`41
`
`3‘3
`
`38
`37
`35
`35
`34
`
`23 24 25 26 27 28 29 303132 33
`
`0 O 0 0 0 0 0 0 R
`
`Hmmrn
`
`Exh p. 45
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 43 of 73
`
`US 7,365,871 B2
`
`Blow.wE
`
`08
`
`mmmwmmmwmofim:::¢:mmmmmbm3#m.M28imm
`
`Em
`
`mm..-8%.
`
`mmE8%.
`
`mm8%-
`
`wxooxtoRm”35.x.
`mm2002 Emacs.
` wmmfi
`“29:4EB952.
`
`“HHH
`
`v2...
`
`em«<8:
`
`Exh p. 46
`
`Exh p. 46
`
`
`
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 44 of 73
`
`US 7,365,871 B2
`
`
`
`FIG.80-20
`
`N05
`
`NCO
`
`Nl‘
`
`NLD
`
`><<F1¢
`
`><<-|¢'O
`
`><<¢D
`
`><<cn
`
`NI!)
`
`><<HH
`
`NV
`
`><<D5D
`
`NW)
`
`><<HO
`
`NN
`
`Imoz
`
`2
`
`mm'co co
`
`v—l
`Fl
`1::
`
`N100
`
`333
`
`wmw
`
`><<I\
`
`><<u>
`
`><<ID
`
`><<~=r
`
`In
`
`to
`
`h
`
`m-
`
`><<m m
`
`><<N Ho
`
`><<--I Hu—c
`
`><<O MN
`
`Hm
`
`d'lDOU—lU—il-Il
`
`H04 '
`Ca
`><><
`
`17
`
`XD3 D418 XD519 X0620
`
`0
`Q
`><
`
`AD
`
`Exh p. 47
`
`Exh p. 47
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 45 of 73
`
`US 7,365,871 B2
`
`
`
`.51
`|-E BUFFER
`II—
`II_[=]E~1_
`III-
`zoco
`20
`1
`
`
`
`7
`
`
`
`x00
`x01 II
`x02 .-
`x03 II
`
`5
`
`5
`
`Exh p. 48
`
`7
`
`x04
`x05 III:
`XDG II-
`xo7 Ill]
`SERIAL
`IE CONTROLLER
`
`RESET
`
`E-
`El-
`[2-
`21 mo
`
`20
`19
`
`XM
`XA2
`
`FIG. 8D-21
`
`1
`1 1
`1
`5 6 7 8
`
`I
`R
`
`o
`4
`
`-
`x
`
`I
`o
`
`R0
`
`r__ _—_ -_ —7
`I
`I]
`I
`SERIAL
`I
`CONTROLLER
`OSC.
`
`I I
`
`I
`I
`L
`
`,I
`
`|
`
`Exh p. 48
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 46 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—22
`
`XA9
`XAB
`XA7
`XA6
`XA5
`XA4
`XA3
`-EISEL
`—CKSEL
`
`-COHSL
`
`AEH
`
`.
`
`'
`XA9
`-FXSEL
`-RCSEL
`—SEL55
`
`ADDRESS
`DECODER
`
`VSHUT
`
`—VIDEN
`-VSELO
`
`-VSEL1
`
`-VSEL2
`
`Exh p. 49
`
`Exh p. 49
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 47 of 73
`
`US 7,365,871 B2
`
`FIG. 8D 23
`
`5
`
`5
`
`R27
`
`R28
`
`101
`-1
`,, .1!
`.I
`-1
`-1
`-1 ‘11
`,, ‘1]
`..
`
`" -
`
`l
`
`-1 .3]
`-1
`16
`IE
`m
`
`5
`
`-DETO
`
`n F
`
`G
`
`80—25
`
`38
`4o
`23
`66
`6
`95
`96
`97
`
`69
`56
`53
`57
`86
`54
`
`-DETl
`
`—BAT2
`—BAT1
`cwp
`
`-CWR
`-CEH
`—CEL
`—CRD
`—REQ
`c015
`
`cowggfla
`
`44
`
`100
`
`98
`
`93
`
`C010
`
`C010
`
`CO9
`
`C08
`
`48
`
`COG
`
`FIG. 8D—24
`
`1
`
`Exh p. 50
`
`
`!!, EJJEEE
`
`EEEEEE
`
`Exh p. 50
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 48 of 73
`
`US 7,365,871 B2
`
`CA25
`
`68
`65
`
`CA19
`
`CA18
`
`x00
`
`x01
`
`x02
`x03
`
`x04
`
`x05
`x06
`x07
`MD8
`MD9
`
`M010
`M011
`M012
`_ M013
`M014
`MD15
`
`2
`
`3
`
`4
`5
`
`7
`
`8
`9
`10
`12
`13
`
`14
`15
`17
`18
`19
`20
`
`RCIRD
`
`112
`
`R31
`
`113
`-RC|
`
`-IOCHK
`22
`R36 .2]
`
`
`
` 1
`
`FIG. 8D—23
`
`
`
`
` RAMCARD
`
`CONTROLLER
`
`
`5
`
`5
`
`XAO
`M1
`XA2
`RCA3
`—Xl0RD
`
`23
`24
`25
`25
`35
`
`37
`—x10wn
`34
`—RCSEL
`27
`-RCBHE
`—RCCAUX 115
`
`—RESEI'
`
`33
`39
`
`R30
`
`5
`
`IORDY
`
`FIG. 8D—24
`
`Exh p. 51
`
`Exh p. 51
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 49 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—25
`
`HG.SD~23
`
`-CRD
`CA11
`
`CA9
`
`CA13
`
`CA14
`
`-43NR
`
`
`
`HI—IHHHHHD—IH\Jmmprt—I
`fififi‘l‘l‘i‘i‘l‘l‘l‘l‘l‘lfifiii‘fii‘liéfifi%fi
`8§Bg$mumm#wmwo°m
`CA4
`wwwwwwmwmmmU1§NNHOCOQNOUI
`
`CYPP
`
`CA16
`
`CA15
`
`CA12
`
`CA7
`
`CA6
`
`CA5
`
`CA1
`
`CAO
`
`N4;
`
`
`
`if;
`
`lflG.BD~26
`¢
`
`Exh p. 52
`
`Exh p. 52
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 50 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—26
`
`mm,
`f—Q—\
`
`T
`
`FIG. 80-25
`
`-DETO
`
`E???
`
`-CE
`
`:1:
`
`CDll
`
`
`
`CA17
`
`CA18
`
`CAZO
`
`CA21
`
`CYPP
`
`CA22
`
`CA23
`
`CA24
`
`CA25
`
`—{Harm
`
`G)
`
`FIG. 80-24
`
`\lm
`
`“NM-k
`
`Exh p. 53
`
`Exh p. 53
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 51 of 73
`
`US 7,365,871 B2
`
`
`
`”Egon.EOE—u
`
`IHwm“NnImmB"VmIM
`
`m
`
`mm:
`
`a3:3.2...
`
`dug”gm.Eéa:
`
`
`
`mmlow.GE
`
`H8...ad
`
`03.
`
`mm:
`
`zoomm
`
`ad
`
`is.
`
`._amoonmSE2.m05%”N328.fl
`5+85
`
`Exh p. 54
`
`Exh p. 54
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 52 of 73
`
`US 7,365,871 B2
`
` 8A7
`
`8A4
`
`8A5
`
`8A8
`
`FIG. 80—29
`
`$07
`305
`305
`$04
`$03
`$02
`SDI
`$00
`
`IORDY "
`-IORD
`-|OWR
`
`IR014
`8A1
`
`8A0
`
`" sue
`$09
`3010
`5011
`$012
`$013
`$014
`$015
`
`h
`I I.
`I I.
`
`- HOTSV
`
`" -ID16
`
`5A2
`
`SOLDER PAD
`
`FIG. 80—st
`
`Exh p. 55
`
`Exh p. 55
`
`

`

`Exh p. 56
`
`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 53 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—29
`
`FIG. 80—28
`
`R
`
`Exh p. 56
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 54 of 73
`
`US 7,365,871 B2
`
`FIG. 8D—30
`
` UNVOWU'l-FwNH
`
`Exh p. 57
`
`Exh p. 57
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 55 of 73
`
`US 7,365,871 B2
`
`FIG. 8E—1
`
`—PMODE
`
`TXDA
`
`RXDB
`
`RXDBF
`
`5
`
`(EN
`
`NIN
`
`01M
`
`GIN
`
`4:»
`
`mm45$"er
`
`(DU'IOJXI—‘O
`
`MN
`
`I—IN
`
`ONXI—‘OCD-(m
`
`TXD
`
`moo
`
`‘01—-
`
`031—-
`
`15xcu< 29
`
`650|NT 30
`
`31
`-1 32
`33
`
`-IORD
`
`-CR7
`
`—CR4
`
`—CR3
`
`34
`
`35
`5 36
`37
`
`GLUE
`
`LOCIC
`
`—IOWR
`
`GOTXD
`
`38
`
`CLKOUT 39
`
`17
`
`IROC
`
`16 mos
`
`15
`14 5
`13
`
`IROA
`
`-RESET
`
`12
`
`-RTS
`
`11
`1o 1-
`9
`
`a
`
`7
`
`RXCB
`
`TXCB
`
`—SR|NT
`
`MRXD
`
`XIN
`
`R53
`
`Exh p. 58
`
`Exh p. 58
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 56 of 73
`
`US 7,365,871 B2
`
`FIG. 8E—2
`
`1o
`
`11
`
`12
`13
`14
`
`5
`
`ooh-max:
`
`RESET
`
`E-
`1
`SYSCLK
`
`Exh p. 59
`
`Exh p. 59
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 57 of 73
`
`US 7,365,871 B2
`
`mmE.9m
`
`¢¢¢¢¢¢¢¢¢mmmmmmmmmmm
`
`Hmmvmofimmofiwmqmohmmo
`
`5&me
`
`._..E>xo
`
`E8...
`
`OWE:
`
`no:
`
`«#0:
`
`m8:
`
`E:
`
`32:22::mzmmm
`
`omwnmmvmmfio-
`
`.mmEma:
`
`82an_.R22fl2z_.2R9:NR8053n8mac23mm388388a38emE80.28
`
`weusea028
`
`Exh p. 60
`
`Exh p. 60
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 58 0f 73
`
`US 7,365,871 B2
`
`FIG. 8E—4
`
`1
`
`3
`5
`
`7
`
`19
`
`21
`
`23
`
`25
`
`9
`11
`13 MODEM BOARD
`15
`CONNECTORS
`17
`
`
`
`
`2
`
`4
`6
`
`8
`
`10
`12
`
`14
`
`16
`
`18
`
`20
`
`22
`
`24
`
`RESET
`
`SYSCLK
`
`D7
`
`D5
`
`D5
`
`D4
`
`D3
`
`D2
`
`01
`
`DO
`
`Exh p. 61
`
`Exh p. 61
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 59 of 73
`
`US 7,365,871 B2
`
`FIG. 8E—5
`
`— ”R L80
`
`-DSR
`39
`38 —CTS
`37
`-DTR
`3: 4‘“
`34
`33
`
`32
`31
`30
`29
`
`650TXD
`RXDB
`16XCLK
`RXCB
`
`5
`
`Exh p. 62
`
`
`
`
` 5
`
`1 4
`4
`
`4 4 4
`2 1 0
`
`7
`A2
`A1 l-a
`A0 ‘1
`{‘1’
`12
`13
`
`4350351
`RXDMA
`
`14
`15
`16
`17
`
`SYNCHRONOUS /
`ASYNCHRONOUS
`cofigggfim
`
`1 2 2 2 2 2 2 2 2 2
`1
`89012345678
`
`-
`s
`Y
`
`s
`
`R s T
`
`D D D D
`7 6 5 4
`
`D D D D T7 5
`3 2 1 o x
`D
`
`x
`I
`N
`
`M
`
`A
`
`Exh p. 62
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 60 of 73
`
`US 7,365,871 B2
`
`mumm.0:
`
`
`
`Emacs.55.50OEEQ
`
`slum.2...
`
`
`
`Exh p. 63
`
`Exh p. 63
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 61 of 73
`
`US 7,365,871 B2
`
`FIG. 8E—7
`
`}©FIG. 8E-8
`
`R2
`
`(D FIG. 8E-8
`
`”’“EaEnXL—IEIEIFLBFI
`RELAY
`I
`
`:
`
`I!
`
`1
`
`KY MODE
`EDMC
`
`KYMIC
`
`
`
`
`TRANSMIT / PTT
`RELAY
`
`
`
`I I
`
`FIG. 8E—8 :—______ |
`
`DIGITAL
`
`
`
`MODE
`DISPLAY
`
`Exh p. 64
`
`Exh p. 64
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 62 of 73
`
`US 7,365,871 B2
`
`C
`FIG. 8E—7
`
`5D
`
`D
`FIG. 8E—7
`
`3
`
`TXGAIN
`
`KYMICD '
`
`
`IPMICC
`C15
`
`
`
`
`033
`1 T21OOpF R3
`3 100
`2
`||
`4
`
`TONE‘ TONE+
`R2
`500 AT&T WV16301T
`
`E
`FIG. 8E—7
`
`F
`
`FIG. 8E—7
`
`9
`
`7 RXDATA
`
`IP—DDO
`
`
`
`KY—DDO
`
`K4
`
`7 RXCLK
`
`IPDDCO
`
`
`
`it
`
`01 —
`
`3-3. 1
`IPADIN
`
`fl:—9
`D7 :
`”4148
`
`KYDDCO
`
`3
`BYPASS RELAYS
`
`,
`BDMC 1
`06 1L2ROHM
`DTD143EK ?
`
`G
`FIG. 8E—9
`
`FIG. 8E—8
`
`Exh p. 65
`
`Exh p. 65
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 63 of 73
`
`US 7,365,871 B2
`
`
`
`a;FIG.8E—10
`
`
` LINERECEIVERS
`
`5 19 20% 23 24 25
`
`5
`
`In
`N
`n‘
`
`03
`I
`“J
`a)
`
`9'
`LL.
`
`
`
`9FIG.8E—8
`
`_.
`“F
`
`_-:
`1:;
`n
`4
`
`“’ §
`
`II
`
`ll
`
`m
`
`32
`
`In
`
`<-
`
`8%
`
`Exh p. 66
`
`Exh p. 66
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 64 of 73
`
`US 7,365,871 B2
`
`FIG. 8E—10
`
`FIG. 8E—11
`
`0
`
`R35
`
`(:24
`
`,
`
`;:..:.:..;.;
`1
`1
`1
`1
`
`1
`
`1
`
`-10
`
`,
`
`.l
`
`19
`20
`21
`
`22
`-1
`,, E]
`24
`
`”NE
`DR'VERS
`
`11
`10
`9
`
`8
`7
`6
`
`TXD
`CLKOUT
`
`-TXDOU
`
`T
`
`—CLKOUT ‘
`
`Ezzlfifl
`
`7 3
`
`4
`
`DTROUT
`
`m
`
`FIG. 8E—9
`
`Exh p. 67
`
`Exh p. 67
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 65 of 73
`
`US 7,365,871 B2
`
`F|G_ 85.11
`
`RADIO / SERIAL
`
`DATA CONNECTOR
`
`
`
`0 FIG. 8E-10
`
`Exh p. 68
`
`Exh p. 68
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 66 of 73
`
`US 7,365,871 B2
`
`RXDBF
`
`R19
`
`R5
`
`R4
`
`8765
`
`1234
`
`R6
`
`h
`
`05
`
`(D
`
`an:
`l”
`1
`
`N
`
`E:-
`a
`0
`
`l-d
`N
`
`I'
`
`(\I
`
`I
`III
`(X)
`
`(D
`L].
`
`3
`0‘
`
`m
`
`II
`
`fi
`‘9
`
`md‘
`n:
`
`m
`
`Exh p. 69
`
`Exh p. 69
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 67 of 73
`
`US 7,365,871 B2
`
`BUSY
`
`CARDBAT BATTERY WRITE
`LOW
`LOW
`PROTECT
`
`STATUS
`LED'S
`
`D4
`I!
`
`
`
`
`-CBATLO
`
`-SYSBATLOW
`
`
`
`
`
`— L
`
`ED6+
`
`
`
`878-ZR
`
`JST
`
`PCMCIA DOOR
`
`/ OPEN SWITCH
`
`$1
`
`POWER 0N
`
`POWER OFF
`
`EMERGENCY
`
`POWER OFF
`
`STBY /
`
`FIG. BG
`
`Exh p.70
`
`Exh p. 70
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 68 of 73
`
`US 7,365,871 B2
`
`PUSH BUTTON SWITCHES
`
`FIG.
`
`8L—2
` FIG.
`
`8L—2
`
`3
`
`3
`
`3
`
`1
`
`2
`
`1
`
`2
`
`1
`
`2
`
`FIG. 8L—1
`
`Exh p. 71
`
`Exh p. 71
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 69 of 73
`
`US 7,365,871 B2
`
`
`
`Ima:9mm;.o:
`
`
`
`3::em...NI.._w.9..—
`
`mma
`
`
`
`Eu8259825%:
`8$39.5805.2
`
`50S
`
`a:mm8Emm83mm
`
`8..GNVme329.hewe383mmBEmm8ammmm8m.
`
`mmEma:
`
`m..._m
`
`d:.8mm
`
`mm
`
`mm
`
`mm
`
`wm
`
`mm
`
`owmfimfihmfimfifimfimfi2onwNamem
`
`
`
` .mo.32SEm7.5o:9:.mwmmmmm6mmmm85mmm
`
`Exh p. 72
`
`Exh p. 72
`
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 70 of 73
`
`US 7,365,871 B2
`
`FIG. 8L—3
`
`014 R8 013 R9 (312 R10 011 R11 C10 R12 09 R13 C8 R14 C7 R15
`
`:5: w-===jlc:l
`
`FIG.
`8L—2
`
`R16
`
`R17
`
`12121212121212©FIG.8L-4
`
`.
`
`i
`
`a
`
`I
`
`I
`
`-
`
`I
`
`I
`
`I
`
`-.
`
`1' 1-
`
`? .7 0 FIG- 8L4
`
`0 FIG. 8L-4
`
`Exh p. 73
`
`Exh p. 73
`
`

`

`U.S. Patent
`
`2B
`
`
`
`
`
`VII—m.0_II_mugw.GE.9EEmd:a
`
`E1!3:82mEM3mas
`fe2m25.-mmS.n85£83
`
`(any,Ham3,n28mmpnH8mU8H8HE;:5
`mmVHmom
`I!;Na
`
`1OmLmam
`
`
`p..A-.mga:Emonmza
`m¢9aamw_.m2n,mr.0Ga2a_.3%.
`
`ww2mxmgm33:
`
`aflHgmHwmlm_.
`
`Exh p. 74
`
`Exh p. 74
`
`

`

`U.S. Patent
`
`US 7,365,871 B2
`
`mo
`
`8EmSmEmBm..mEmm250mNo<m@530wno<ww,92mwmox...‘m_.vAEmu:NaN
`3SmNNHNmom.SmNN“Nmom.wNewON226.:NowON226.:nmomaD:2.mom22mo...m3m23am.3wm-E3mm:%new3ma3mm:gm3flSum:
`momN“.:N<mmamNH:N<m
`8w‘NMN5.95:0%‘NMN585..
` mNHomemN8m:
`
`
`
`2.76::om<om>mz
`
`
`
`mxohmzzoough—”.52.
`
`m..._m.6:
`
`Exh p. 75
`
`Exh p. 75
`
`

`

`U.S. Patent
`
`Apr. 29, 2008
`
`Sheet 73 of 73
`
`US 7,365,871 B2
`
`md:
`
`Hwyemu2..may2“ofmmEummNH.5.o
`
`#4.!" -.-....
`
`
`
`S
`u, ......... g--.
`
`a ---——u- . --- “--u——--—
`
`g--
`
`maNu«m
`
`mug—E.
`much—um.|.Y
`
`hmmmmmV»maNuHm
`
`£5.E«mac—E.
`
`52.5.Emug—E.
`
`4522E58::
`
`WE
`
`wa
`
`ua
`
`mu
`
`a
`
`h“
`
`umae
`
`.“mu~.:ms=
`
`
`
`r."onumona»a...x».w.mud—25
`
`Exh p. 76
`
`Exh p. 76
`
`

`

`US 7,365,871 B2
`
`1
`APPARATUS FOR CAPTURING,
`CONVERTING AND TRANSMITTING A
`VISUAL IMAGE SIGNAL VIA A DIGITAL
`TRANSMISSION SYSTEM
`
`This application is a divisional application of and claims
`priority from a non-provisional United States Application
`entitled Apparatus For Capturing, Converting And Trans-
`mitting A Visual Image Signal Via A Digital Transmission
`System, Ser. No. 09/006,073, having a filing date of Jan. 12,
`1998, now abandoned; the specification and drawings of
`which are hereby incorporated by reference.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`
`The invention is generally related to image capture and
`transmission systems and is specifically directed to an image
`capture, compression and transmission system for use in
`connection with land line and wireless telephone systems.
`2. Discussion of the Prior Art
`
`SUMMARY OF THE INVENTION
`
`Embodiments provide an image capture, compression and
`transmission system that is specifically designed to permit
`reliable visual image transmission over land line or wireless
`communications using commercially available facsimile
`transmission techniques. Embodiments incorporate a cam-
`era and signal converter into an integrated unit wherein the
`converted signal can be t