I|||||||||||||||||||||||||||||||||l|||||||||ll|||||||||||||||||||||||||||||
`
`USO069307U9I3l
`
`(13)
`
`United States Patent
`Creamer et al.
`
`(10) Patent No.:
`
`(45) Date of Patent:
`
`US 6,930,709 B1
`Aug. 16, 2005
`
`(54)
`
`INTEGRATED INTERNET,n"lN'l‘RANET
`CAMERA
`
`(75)
`
`Inventors: Rob Creamer, Boulder, (TO (US);
`Walter Knapp, Boulder, (TO (US);
`Mark Koch, Broomfield, CO (US);
`Yoshlyuki Araki. Sztitama-ken (JP);
`Richard Helton, Boulder, CO (US)
`
`(73)
`
`Assigneez PENTAX of America, Inc., Montvale,
`NJ (us)
`
`(*)
`
`Notice:
`
`Subject to any disclaimer, the term oftltis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(31)
`
`Appl. No.: 09,I'204,289
`
`(33)
`
`Filed:
`
`Dec. 3, 1998
`
`(60)
`
`(51)
`
`(53)
`
`(58)
`
`(56)
`
`Related U.S. Application Data
`Provisional application No. n‘30t'£|85_.585_. filed on May 15,
`1998, and provisional application No. 6Dt'D67_.31{1. filed on
`Dec. 4, I991
`
`U.S. CI.
`
`Int. CL?
`
`H04N 5,n’232; lI04N SL225;
`I-I04N IIKOO
`34812113; 3483207.];
`348552
`34-8f2U'?.l, 211.3,
`Field of Search
`34¢‘?-t'211.1, 211.8, 211.12, 552, 231.2, 231.6,
`14.01-l4.16, 36, 211.6, 154, 155, 158;
`3S8;’4()3; 7041203
`
`References Cited
`
`U.S. PA'l'EN'l‘ DOCUMENTS
`
`5,185.66? A
`5,283,655 A
`5,477,264 A
`5_.4?9_.2[)6 A ‘*
`5_.6l2_.732 A *
`5,f)33_.6't'8 A "
`5,635,983 A
`3.646.684 A *
`5,724,155 A "'
`
`M1993 Zintntermann
`2.n‘l994 Maeno
`12t’l99S Sarbadhijrari et al.
`I2.-"1?-J95 Ucno ct al.
`3.-‘I99? Yuyanta el al.
`5.31997 Parul-ski cl al.
`I').iI‘J<)7 Oltmori
`7t‘l‘J‘.)'i' Nishizawa el al.
`3.n"l‘)98 Saito
`
`348;-‘2ti..5
`348314.01
`348t'23l.5
`
`348!231.S
`3531402
`
`M1998 Takizawa el all.
`5_.'i'34,4l‘fi A
`8Jt998 Gullichsen etal.
`5,795,425 A
`5_.8l8_.53".7 A "‘ 1Ut"1998 Enokida ct al.
`5,8”i'tJ,I35 A
`2r19<J9 (ilatt ct al.
`5,887,144] A "
`3.31999
`Ilsumi elal.
`5,011,044 A * M1999 Lo ct al.
`5,9‘)(J,94t A
`ll."1‘J9<J
`Jackson el al.
`6_.E)(J5.6l1 A
`12t’1999 Gnllichsen et al.
`
`(Continued)
`FOREIGN PATENT DOCUMENTS
`
`3431441
`
`'.r'[)9f225
`‘i'()9;‘2t.I3
`
`JP
`JP
`
`tJ8lU2837 A “
`08171691 A "‘
`
`4;-‘I996
`7,-‘I996
`
`I104-NIUI/32
`......... ..GO8Br‘25;-‘(II
`
`OTHER PUBLICATIONS
`
`3.3 Connectionless Transport: UDP, Ross and Kurose; httptff
`wvvw—net.cs.u masseclutku roset’transp0rti"U DP.htmI;
`199 6-2000. ‘
`
`(Continued)
`
`Primer‘): Examiner—Wendy R. Garber
`Asnistant Exariiiner—John M. Villecco
`(74) Attorrtqv, Agent, or Firm—Greenblum & Bernstein,
`P.L.C.
`
`(57)
`
`ABSTRACT
`
`An integrated Internet camera includes, as embedded com-
`ponents contained within the camera body and controlled by
`a mieroeontroller, at
`least a network interface device for
`connecting to the Internet, a transport control device for
`packetizing according to Internet protocols, a file transfer
`device for communicating with a destination user directory
`on the Internet, and a
`transmission initiating device for
`initiating the connection and transfer operations of the file
`transfer device and transport control device. The network
`interface device may be a modem, network adapter, or
`adapter for connection to the Internet. Upon capturing the
`digital
`image,
`the camera initiates a connection to the
`Internet, connects to the destination user directory, and
`uploads the digital images. Thereafter, the digital images are
`available to authorized (or any) user having access to the
`Internet.
`
`91 Claims, 22 Drawing Sheets
`
`24.5
`
`
`
`Apple/Twitter
`Apple/Twitter
`Ex. 1003
`Ex. 1003
`IPR1 of U.S. Pat. No. 7,765,482
`IPR1 of U.S. Pat. No. 7,765,482
`
`0001
`
`

`
`US 6,930,709 B1
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`348714.04
`
`34372113
`
`35871.15
`
`272003 Sale elal.
`fi_.5I?_‘3,'7‘61 B2 "'
`37'2U03 Driscoll, Jr. el al.
`6,539,547 B2
`572003 Andersunelal.
`5,557,122 Bl *
`572003 8
`'lzk
`1
`1.
`5,571,271 B1
`772003 2:555 E1941?
`5,591,279 B1
`772003 Hirokielal.
`5,594,032 131 8
`872003 Marlin ml.
`5,503,502 B2
`973003 Lassilcr
`5’524’34¢5 31
`1072003 Anderson 51 :1].
`5,535,259 131
`472004 K0 ana 'el :1].
`fi.720.98'7' B2
`972001
`suzfuki gl
`200170024232 Al
`272003 Nakamura 1-.1 al.
`200370025803 Al
`1172003 Gross
`200370208557 A1
`172[](]4 Nakayama
`2QQ4l,7{){}12311 A1
`OTHER PUBLICATIONS
`
`ilal Photo ra-
`g
`
`g
`
`P.M. Corcoran cl 21]., “Internet Enabled Di
`. . .
`PW’
`"5557 PP" 8434'
`Instruction Manual
`“NI-5C Picona digital camera,
`PC—DC2(l0 and P(.‘—DC20UK", daled Feb. 1997.
`.
`‘
`.
`.
`.
`H
`\7er1fied Enghsh lang11agc lransla110n of NEE P1c0na
`dlgltal camcia,
`Inslruf:l10n Manual
`tor PC—D(...00 and
`PC-DC-200K . dated I‘eb- 1997.
`
`for
`
`* cited by examiner
`
`0002
`
`:'hl‘m8°‘a]|-
`run-‘ion <=la-
`Drisc°|'. 11- =1 91-
`Fisher 91 91-
`
`Hoetah
`Pcriasanly ct al.
`1ga;%hiela1-
`A" 9540“
`Anderson =1 at
`3491426-19
`Murphy 91 a|-
`----- -- 710052
`Safai cl 41-
`-7
`' BIB
`3487'2[l.5
`Elie
`Kiyokawa .............. .. 37-1-87211.3
`Sailo ct al.
`35871.15
`
`..
`
`
`
`mnm“
`7
`
`705725
`35871-15
`'7'097’242
`'»"C'97’232
`
`386F120
`348754
`
`In.°"e at al'
`Fxchlncr
`Schmidt
`Fukuoka
`Furlan el 41.
`Fichlner el :1].
`709,220
`Kfishnamunhy el al‘
`Hameu
`Kjlamura .................. .. 7097217
`Matsui
`3587403
`Aizawa et al.
`
`5,034,715
`5,038,295
`5,043,837
`5,047,254
`5,051,502
`5,055,052
`5,057,571
`5,094,221
`5,134,505
`6,147,598
`5,157,459
`5,188,431
`5,195,511
`5,204,877
`5,208,425
`5,225,449
`5,255,059
`5,278,481
`5,300,975
`5,331,859
`5,350,352
`0,389,464
`5,407,752
`5,438,587
`5,44 I ,9 24
`5,452,529
`
`EEEEEEEEEEEEEEE’E>>3*3“>3“>>3'>>
`
`Bl
`
`-I-I-If
`
`37’2000
`372000
`372000
`472000
`57'2U00
`572000
`572000
`77’2000
`lU'7'200U
`1 17’2000
`"‘ 12.32000
`It
`272001
`272001
`372001
`372001
`572001
`77"2[10l
`81/2001
`1072001
`1 27”2001
`372002
`57'2U02
`(#2002
`872002
`872002
`97"2002
`
`I-I-I-I
`
`0002
`
`

`
`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 1 of 22
`
`US 6,930,709 B1
`
`.E<mo_E_dz
`
`0003
`
`0003
`
`

`
`U.S. Patent
`
`Aug. 16,2005
`
`Sheet 2 of 22
`
`US 6,930,709 B1
`
`FIG.2
`
`0004
`
`0004
`
`

`
`C
`
`2
`
`Us 6,930,709 B1
`
`om>.En5mom<om>wv.
`2M_.NN_.Nmmjompzou
`
`momE3532.
`ENmmjomzzou
`
`mam
`
`Iw_m_.jGm._.ZOQ
`
`.EEm.m
`
`
`
`5%EN_____:____fimmu
`
`mam
`
`9swafigmEa
`_.n_._.n_V_v_oE.w.5
`
`mwm_._.N
`
`on2._¢_mmm_&o._V_.N0.2
`
`mmowzt
`
`
`
`20:02_.m.£
`
`
`
`Emamo9:40
`
`.momzm_m
`
`
`
`amfig”mama
`
`6v_mo_.s._.wz
`
`.21oown_mz_ozm
`Ann,zo_mmmE2oo
`
`_J,m_o...u_w_mE_n__mesa
`
` m_J_m«oW_.2m.%mm..w&<mam420305200d._.EzEw_r.vn_.m__w_u
`
`
`U.S. Patent
`
`mam
`
`E410
`
`xm._._o..._:,_ooova
`
`Em
`
`mopqmm2m0Im._.Ud_.K<IU
`
`m._0d.____2__
`
`>:os_m5_
`
`m.O_n_
`
`_o_zm.__2mao_2
`
`
`
`“ncomgmsomom_.mw._._oEzooomo__2n_m_._.....mow._.2_O_
`
`
`
`
`
` Mm_.SOn__3mmfiompzoommjozpzou~_m._._cEzooa«.022
`
`E9%
`
`mwm
`
`n.w0‘
`D‘!
`
`L.
`
`000
`
`mmzma
`
`«mm
`
`0005
`
`0005
`
`
`
`
`
`
`
`
`
`

`
`U.S. Patent
`
`Aug. 16,2005
`
`Sheet 4 of 22
`
`Us 6,930,709 B1
`
`0006
`
`0006
`
`

`
`U.S. Patent
`
`US 6,930,709 B1
`
`
`
`
`
`
`
`n...._!..0EA_B_._Sm.2.5:._2.Ease»9.32.53swam...o__._.owZOEZEMDme...
`
`
`
`
`
`6:._ua.cmE..a-£w_u____w.._._=“=a...=_........
`
`
`
`
`
`._m,..m«.“..._”u.“M_M._._WE_,.n...._.h-5..
`
`
`
`
`
`
`
`
`....D_.=aDn.wH~w.5az__.cE_.____u_59....._»_§E___msmzn38.:mHoz:.uo._um9_.oo__gwr_L_._w____._____.w&flm_.=u_&MZo_mwwEmZd..Emomma_mmo._uuan.=wZD_.C_wE__n_.
`
`
`
`.z..%_§_e.___.nWmmwman_<¢mm_..._¢oEaa.mxwfiwmc_M__mm5..z.cc__.§_...=.._
`
`
`
`.a.%__.sa>.wom_.___wo._flm.7.99.65_.§m._u:2m.£E=E05».wn.2uuu6¢um:._.oS_:z<.._C.
`
`.093S..uz_.:_§_...m
`
`
`
`
`
`.I._E353aco__nn._..z..to=.__s...!5cébo=.__._.._o>o3wanna:E__uo::3noon...co.un._u.=o_uu$.35...-
`
`
`
`
`
`
`¢=Eu3unionanus...
`
`
`_.mvm._mus=_E3:5.E22:23.?E2».:5fi_E__2m_EE_;
`
`
`
`
`?Ea_w&EmfiauasnEo.smaan_B_.wa:n_._,_2m.%%..._.M,....___x93.EEm3
`
`
`
`
`Lu3.mEEmn_.nE_n_._n=..
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`n:..._anm.Em..m3mEEmanEE_u&m..=_.=uu.2nz____>v_o.:o
`
`
`Eau_u.._.__.EEm&nam5:m_=_nEm._m.3$2._..:a_..aAZ.cL_nu!.E_:oaE=nEEm5.2:Eoo?..w..a&_mu.__=ou2_nz....G2:__m__
`
`
`2.832....__._.._.a.72.3.a..__=Esp.
`
`
`
`uz5nma.o=oa=..a_m:2.2:
`
`
`
`Ex:3.__.$E..E.3;
`
`
`
`zmumzaepu.__"_
`
`
`
`
`
`C..3_!,._a_..__.5.$32..¢BuE__..2:man»
`
`9...EB25:3...”
`
`
`
`.z____.c.o_w_a_._:mE
`
`6”2”:_.o_..m.m._uz2=_
`
`.mus.
`
`92.:3..E_=m_%
`
`ES.2»33:2.
`
`
`
`e§...__,...._.=%25..235as
`
`
`_z.£_§__2_.nEEm5_o_3..a2mE._=&r23..§n
`
`
`
`
`
`85...5mE:w«.23?._mE&:un_._3wm.__nEw._u3:o:._.._3u..
`
`
`
`.EEu5_._o3nm.EER.nEEu&:o_nwmB.Eoo
`
`_.Ew._a_&_.__o___E:.mw.nEw._nnvco:n.5_ma
`
`_._...—_.=._00flEEOC.fl..aZ_.CCw___.._=m__.D:can-Eoafiamn.23»:E26:=:3nu.E00m=20.—.W3__...W_(.m_U{.E_0=.._..._....£_E___sD_w033!u
`
`
`
`
`
`
`
`.z.§...._.
`
`
`
`0007
`
`wzzkomwmZmzo=.<o_z:__..=..__ou1zO_._.n_ODEEmm_:=mmods:
`
`
`
`mm_mm__z¢m<._aDZME£
`
`
`
`
`
`m_zO_._..._m.._mmozrrfimmmfisnxdzE
`
`0007
`
`
`
`
`

`
`U.S. Patent
`
`Aug. 16,2005
`
`Sheet 6 of 22
`
`US 6,930,709 B1
`
`FIG. 6
`
`BOOT!
`
`INITIALIZE
`
`0008
`
`0008
`
`

`
`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 7 of 22
`
`US 6,930,709 B1
`
`FIG. 7
`
`ENABLE USER
`INTERVENTION
`
`
`
`NAU
`
`
`INTERFIUPT?
`
`LOCAUFIEMOTE
`
` COMMAND
`
`LOCAUFIEMOTE
`SETUP SIGNAL
`
`0009
`
`0009
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 8 of 22
`
`US 6,930,709 B1
`
`FIG. 8
`
`
`
` ASS|_GN
`
`IMAGE SLOT
`
`ASSIGN
`NEXT
`
`
`
`ACCORDING
`TO
`
`
`
`AVAILABLE _30
`EVENT
`
`TIMER
`IMAGE SLOT
`
`
`GET
`
`S32
`
`EXPOSURE
`
`
`
`CCD
`
`CAPTURE TO
`
`S34
`
`IMAGE MEMORY
`
`S36
`
`S38
`
`
`JPEG COMPRESS
`
`TO GP DRAM
`
`
`
`
`
`
`
`
`0010
`
`0010
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 9 of 22
`
`US 6,930,709 B1
`
`FIG. 9
`
`DIAL UP OR
`
`CONT. ?
`
` N
`
`350
`
`I DISCONNECT I
`
`0011
`
`0011
`
`

`
`U.S. Patent
`
`Aug. 16,2005
`
`Sheet 10 of 22
`
`US 6,930,709 B1
`
`FIG. 10
`
`DISCONNECT
`
`
`
`
`
`
`
`
`DISCONNECT TCP/IP,
`
`PPP, MODEM AS
`NECESSARY
`
`
`
`0012
`
`REPORTING
`
`ON?
`
`
`
`0012
`
`

`
`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 11 of 22
`
`US 6,930,709 B1
`
`FIG. 11 TCPIIP
`
`CONNECTED?
`
`TCPIIP (PPP)
`CONNECT!
`
`LOGIN, COUNT
`RETRIES, ERROR 3.
`RETURNIF
`
`RETRIES
`
`EXCEEDED
`
`F|'P
`
`CONNECT, COUNT
`RETRIES, ERROR 8:
`
`
`
`
`RETURN IF
`
`RETRIES
`
`EXCEEDED
`
`0013
`
`0013
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 12 of 22
`
`US 6,930,709 B1
`
`FIG. 12
`
`DIAL/FIEDIAL
`
` ENABLE MODEM,
`
`RETURN
`
`0014
`
`0014
`
`

`
`U.S. Patent
`
`Aug. 16,2005
`
`Sheet 13 of 22
`
`US 6,930,709 B1
`
`FIG. 13
`
`
`
`GET FILE INFO FROM
`
`
`
`SERVER
`
`S72
`
`
`
`WRITE FILE
`
`FILE FROM SLOT N
`
`
`
` WRITE/OVERWRITE
`
` S74
`
`
`ACCORDING TO FTP
`
`
`
`DIRECTORY & ATTRIBUTE
`
`S75
`
` DOWNLOAD NEW
`
`
`
`SETUP FILE
`
`IF NECESSARY &
`
`FTP LOGOUT/DISCONNECT
`
`RETURN
`
`
`
`0015
`
`
`
`0015
`
`

`
`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 14 of 22
`
`US 6,930,709 B1
`
`FIG. 14
`
`FTP
`
`CONNECT
`
`ASSEMBLE BATCH LIST
`
`
`
`
`WRITEJOVERWFHTE
`
`
`FILES FROM BATCH LIST
`
`ACCORDING TO FTP
`
`580
`
`DIRECTORY & ATTRIBUTE
`
`DOWNLOAD NEW
`
`SETUP FILE
`
`881
`
`IF NECESSARY
`
`
`
`U DISCONNECT I
`
`
`
`884
`
`0016
`
`0016
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 15 of 22
`
`US 6,930,709 B1
`
`FIG. 15
`
`REPORTING
`
`REPORTING ON?
`
`
`
`ALREADY
`
`
`
`ON NECTED
`
`
`
` TCPIIP
`CONNECTILOGIN
`
`W! RETFIIES]
`
`
`ASSEMBLE SMTP
`S98
`
`
`MESSAGE FROM
`REPORTING BUFFER
`
`
`
`8104
`
`DISCONNECT TCF‘/IF’.
`PPP, MODEM AS
`NECESSARY
`
`
`
`
`0017
`
`0017
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 16 of 22
`
`US 6,930,709 B1
`
`FIG.
`
`16A
`
` REMOTE BUTTOBUSVWTCH
`
`S108
`
`
`
` RECEIVE
`
`NEW
`
`3120
`
`3122
`
`
`
`
`
`PARAMETERS!
`FIRMWARE
`
`
`
`
`D(§;Lh’;"(;’E&
`DISPLAY &
`NEW
`
`CHANGE
`PARAMETERS!
`MENU
`LEVEL
`PARAMETER
`FIRMWARE
`
`
`
`
`
`
`
`DISPLAY &
`CHANGE
`MENU ITEM
`
`
`
`0018
`
`WHITE
`
`0018
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 17 of 22
`
`US 6,930,709 B1
`
`FIG. 16B
`
`
`
`COMMAND
`
`READCOMMAND&
`
`DATA
`
`S130
`
`
`
`
`
`
`PARAMETERSET
`
`TASK EXECUTiON
`
`ERROR
`
`S138
`
`S134
`
`S136
`
`
`EXECUTE
`
`RECORD
`
`ERROR
`
`
`
`SET
`
`PARAMETER
`
`0019
`
`0019
`
`

`
`US. Patent
`
`2f0no1t
`
`1B90
`
`8_z“Ego:m
`
`
`
`5maquW3_om_..m5n=mam¢:a3oEzoo._m:._..&§2musmo
`
`mo._.<mmzm_o
`
`mmpoqmqzo
`
`K04DU
`
`E_.=.n_....
`
`1xzozfimz
`6.,mu.Emm:z_
`
`.wz_ozmW52o_wmm_zn__2oowwm
`
`mm:40M._.ZOOzqmo
`
`mam
`
`2E_.Ez.n:z_
`
`mmjompzou
`
`._(_.r._um
`
`xm_..._oE200
`
`
`otamEGQE.24.1>2SH._.IU_m_.NEzotnmm_.N_.NmewmamNvm
`
`
`.atEm>_.mn_9&09domzmmad.fiu_>m_cNOn.2._<_mm_m__<n:_mwu__2ézzmhxm
`
`
`
`
`.9,._a.£xofimmin»__i63&2.zO:.OE
`.§.._n_m_n_\».6528
`Q3#.._mm_m._::___:ma
`
`
`
`mom_xm_joEzooozo_zBEmom»z_o._
`
`wxmzzm%sou
`
`0020
`
`0020
`
`
`
`
`
`
`
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 19 of 22
`
`US 6,930,709 B1
`
`N8OH
`
`,mm
`
`.+4:gz<m
`
`.EOON
`
`mmom»m>o<mm
`
`3.O_u_
`
`9820mm
`
`9.0:
`
`_
`
`Tlllllllflr
`—mmdmmo¢z_
`
`0021
`
`0021
`
`
`
`
`

`
`S..U
`
`tHEta
`
`6.,mu_>mo_1m_o$_mm:z_a.xmo>__c.wz2weo
`
`m_z_wzmAmamzO_mmwm.¢,__Ou
`
`
`
`5:_.22W“Emma:m:m4umwow
`
`o
`
`
`
`2_.znw_a5n_4mamE.¢n_:o5zoo,m:._§_§
`
`
`
`._<n=Um._.2
`
`O...
`
`55...
`
`mam
`
`E119
`
`mmjompzoo
`
`p.
`
`mm.6<:.s..u
`
`mozauzmo
`
`oN.0_n_
`
`
`
`
`
`._.xm:_n_OW_._.ZOUOW_U_r.4nm._..qmmm_.Z_
`
`US 6,930,709 B1
`
`9._2mommm._._oE.zoo
`
`rmN—N..5:mmFz_NN,Fmm.u.:oEzou
`..._l._,._._._:m9EoE.mx&meson.
`
`_.nmm_._._ox»zo..Sd__D..;_Un.
`
`Sm
`
`zutzmmEmfiwFFm
`._.<,_n_m_o218.._________
`
`5%..
`
`
`
`Un_2._«Emm_<o__.zoEu_2..m_2
`
`
`_iVE2mucus;
`
`._qEmm
`
`mm._
`
`._OI._.ZDU
`
`mam
`
`._OwE.ZDo
`
`mam
`
`25.>2
`
`
`
`_v_9._Fm&____n_D._..=.__
`
`.l._.n_
`
`
`
`EWDEDamqu
`
`
`
`ézmmhxmmmdomzmm
`
`Eosma
`
`Em
`
`0022
`
`0022
`
`
`
`
`
`
`

`
`US. Patent
`
`Aug. 16, 2005
`
`Sheet 21 of 22
`
`Us 6,930,709 B1
`
`©©zO_P<O_._n_&(.0........<Zmm._.Xm
`
`
`
`9.._<o3FN _.m_.m«_muo_E.xo<+mn_n.__m_n_o_.._:.
`n__._.m_mImm5vEo__2zompnwwhmmu.Ew>_.mo
`
`mm_.mm_o_>mam_.w
`
`Edi>2
`
`
`
`¢_.D__=_.u.M_On_PDQZ.
`
`_.._U._..r.5mwea%,,_E.,Vm_.@uEmJomamooNN20333...___:_____45%
`
`Em
`
`m._.w.._.._O~.._._.ZCO
`
`
`
`.E:zxm»z_..mam
`
`.HU".2._mm_m
`
`ENJJOEPZOO
`
`ENEN<nE___._.¢0n_
`
`
`
`mom..<_mmmmmm
`
`mU(_u_Em._.2_Uxmozcmz_2
`
`zo_mmm=.._n_s_oo
`jm2_wzm
`
`._
`
`
`
`._.zm._._om._.zooomo__2n_m._.<m.n.mFz_0SN
`
`AU_Zmimoo:
`m:m<oo..zam__.2.o$4om_u_>un__0
`
`5,Ema
`
`
`
`.853.NE.253sozommm>_mn
`
`amNewnuu
`
`0023
`
`0023
`
`
`
`
`

`
`fmmmmmjoE.zooUomqomfix
`
`2E.E:mEmE_2mm.Em>zoo
`
`
`mm_._._oEzoo
`
`mam
`
`mm5—
`
`.I_B0/
`
`
`W3EE@nm,:.Fm3.5.3v_mo:..._.mz
`Ow,
`
`>._.on_mo©__.Non2oummmm_._o.:.sm
`
`zo.m_>m:m:..Ill:omn__..,6IIINmrFmS5%._._o:__smUIEotbmEonmEoa
`
`
`.n_.N.$99.5mmom__E.
`
`._<_«_mm
`
`:_Oz._.ZOU
`
`mam
`
`24¢>2
`
`
`
`204.5n_____n_O._..__.:
`
`.n_.__.u_
`
`
`
`Emzmoozqo
`
`U.S. Patent
`
`1E
`
`mosma2moEmm»z_6:x«_o__.___.m_z
` .925.__._,n._n_o_2m_._mfi_W~zom_._m.En:
`
`
`-fl
`
`domen
`
`
`
`...Lom_o__e.au._fl..EEuE_
`>._,E_..m2M_.N mm_joE.zoo9.
`
`%mmm
`mmm20¢.
`
`Eomsémo,5mm._._om.Eou
`
`08ammum_CNN
`
`Eozmz
`
`mw.<_2.
`
`24mm
`
`
`
`mm.:om._.zooEmmaO._.
`
`O._.
`
`._4.n___,Uw._.Z
`
`mwm
`
`DUU
`
`.__r_.UUKOmmamooamo
`
`__EE
`
`.51:
`
`DUO
`
`mmame
`
`mum
`
`«mm
`
`KN
`
`mzm:m.._ma.mu2<:oxm
`
`0024
`
`0024
`
`
`
`
`

`
`US 6,930,709 B1
`
`1
`INTEGRATEI) lN'l‘ERNET;’IN'l‘RANl£'t‘
`CAMERA
`
`The present application claims the benefit of U.S. Pro-
`visional Application No. 6tJX[l67,3 10, tiled Dec. 4, 1997, and
`U.S. Provisional Application No. 60;‘085,585, filed May 15,
`1998, which are expressly incorporated herein by reference
`in their entireties.
`
`BACKGROUND ()1: 'I‘l-IE lNV|iN'l‘ION
`
`1. Field of the Invention
`
`The present invention relates to an integrated camera for
`connecting to the Internet and transmitting images over the
`Internet.
`
`2
`In particular, multiple
`functions and excess capabilities.
`microprocessorstcontrollers, power supplies, and communi-
`cation lines are necessary to operate the separate parts of the
`system. Moreover, such systems include many opportunities
`for error because of the many interfaces and communication
`links between discrete devices. Such error may occur as
`ditficulties in setup and configuration and incompatibility
`between devices in operation.
`3. Acronyms
`The following acronyms and abbreviations are used
`throughout the specification. For brevity, the definitions are
`summarized as follows:
`
`‘Jl
`
`IU
`
`2. Description of Background Information
`As the Internet (i.e.,
`the worldwide inter-network. cur-
`rently operated under TCPKIP: Transmission Control
`Protocoltlnternel Protocol} gains more participants and
`becomes more consumer-oriented, the demand for simpli-
`fied ways of providing access to various media increases. A
`large portion of the new participants seek access to the
`“World Wide Web” (i.e., a hypertext-driven global multi-
`media system, hereinafter the "Web“). Archives of digital
`images (photographs and motion video) are now ubiquitous.
`The demand for real-time or live video, whether motion
`video or still video, has dilfcrcnt requirements, but has also
`become strong. Needs in entertainment, advertising,
`education, security, tralfic monitoring, weather monitoring,
`child care monitoring, and surveillance, as well as general
`consumer usage, have driven the creation of an initial wave
`of systems able to place a real-time image. or series of
`images, on the Internet and on the Web.
`However, the prior systems are complex and expensive,
`requiring the use of a general purpose personal computer _
`and a host of peripheral devices to place an image on the
`Internet or Web, as well as attendance by a qualified opera-
`tor. The systems are typically large and lack portability.
`An example of such a prior system is shown in FIG. 1. A
`video camera 110 connects to a "frame grabber” peripheral
`card 112, hosted by the parallel bus 114 of a personal
`computer 122. The frame grabber card 112 decodes a frame
`of an analog video signal from the video camera 110 into a
`digital
`image, and makes the digital
`image available to
`purpose-designed software running on the computer 12.
`Typically, the purpose-designed software eventually com-
`presses the digital image into main memory using the main
`microprocessor of the personal computer 122. In order to
`upload the image to the Internet, the computer 122 requires
`a serial port 118 and attached modern 120, which are hooked
`to the public telephone system 124. The personal computer
`122 uses further software programs running in main
`memory, which include at
`least a modem driver, network
`transmission protocol (e.g., TCPKIP) driver, a telephone
`transmission protocol (e.g., PPP: Point-to-Point Protocol)
`driver, and an file transfer protocol (c.g., FTP: File Transfer
`Protocol) application, to connect to the modern 120, through
`the telephone system 124, and to an ISP (Internet Service
`Provider) 128. 'l'hereal'ter, the personal computer 122 may
`upload the compressed image to a shell account available at
`the ISP I28.
`
`1U
`
`3U
`
`40
`
`45
`
`50
`
`55
`
`oil
`
`Costs for such a system may run to several thousand
`dollars. The computer 122 must be on-site, i.e., relatively
`close to the camera 110, and is large and relatively immo-
`bile. Since the system is an assembly of general—purpose
`components, and the computer 122 is usually dedicated to
`serving the camera 110, the system has numerous redundant
`
`0025
`
`xDSL—(generic) Digital Subscriber Line
`ATM—Asynchronous Transfer Mode
`C(_‘D—Charge Coupled Device
`CCTV—Closed Circuit Television
`
`DNS—Domain Naming System, Domain Name Server
`ExCA—Exchangcable Card Architectu re
`FI'P—File Transfer Protocol
`
`I-ITML—Hypcrtext Markup Language
`IrDA—Infrared Data Association
`
`lSA—Industry Standard Architecture
`lSDN—Integrated Services Digital Network
`lSP—Intemet Service Provider
`
`JPEG——.loint Photographic Experts Group
`MIME——Multipurpose Internet Mail Extension
`NTSC—National Television System Committee
`PAL—Phase Alternating Line
`PCMCIA—Personal Computer Memory Card Intema-
`tional Association
`
`POTS—Plain Old Telephone Service
`PPP~—Point—to—Point Protocol
`SLIP—Serial Link Interface Protocol
`
`SMTP—Simple Mail Transfer Protocol
`TCP;'IP—Transmission Control Protocoltlnternet Proto-
`col
`
`UDPfIP—User Datagram Protocotflnternet Protocol
`URL—Uniform Resource Locator
`USB—Universal Serial Bus
`
`SUMMARY OF THE INVENTION
`
`Accordingly, it is an object of the invention to provide an
`inexpensive and etficient camera having all nccemary func-
`tionality for transmission of real—time and stored digital
`images to the Internet
`in a single, portable standalone
`apparatus (i.e., an embedded system), without requiring the
`use of an external controlling apparatus such as a personal
`computer.
`It is a further object ofthe invention to provide a portable.
`standalone camera that may initiate and independently con-
`trol scheduled tra nsmission of digital images to the Internet,
`where the images become available to any authorized user
`on the Internet.
`
`The above objects are attained by providing an integrated
`Internet camera for transmitting digital images to an Internet
`address, including an image pickup. an optical system for
`forming an image on the image pickup, and an image
`capturing circuit for capturing digital images from the image
`pickup. A network interface device connects to the Internet
`for transmission of the digital image files to the Internet, and
`a file transfer device communicates via the network interface
`
`0025
`
`

`
`US 6,930,709 B1
`
`3
`device. with a destination shell account at a predetermined
`Internet address and transfers the digital image files to the
`destination shell account according to a predetennined file
`transfer protocol. The digital image files in the destination
`shell account are then available to users accessing the
`Internet. A transport control device packetizes the digital
`image files according to a predetermined Internet transport
`control protocol, and controls addressing of the packelized
`digital image files to the predetermined Internet address,
`while a transmission initiating device initiates a connection
`with the Internet via the transport control device and the
`network interface device. A Iirst scheduling device, includ-
`ing timers. schedules transfer of the digital image files to the
`destination shell account by the transport control device and
`the file transfer device. A rnicrocontroller controls opera-
`tions and communication between each of the recited
`
`devices, and a camera body houses therein all of the recited
`devices and the microcontroller.
`
`In another aspect of the invention, an Internet camera
`system for
`transmitting digital
`images via the Internet
`includes a destination shell account having a user directory
`at a predetermined Internet address and an accessing device
`for accessing the user directory of the destination shell
`account via the Internet. As part ofthe system, an integrated
`Internet camera is housed in a camera body. The camera
`body contains an image capturing system, a network inter-
`face device, a file transfer device, a transport control device,
`and a transmission initiating device. The image capturing
`system captures digital images, and the network interface
`device is connectible to the Internet for transmission of the
`
`digital image files to the Internet. The file transfer device
`communicates, via the network interface device, with the
`destination shell account and transfers the digital image files
`to the user directory of the destination shell account accord-
`ing to a predetermined file transfer protocol. The digital
`image tiles in the user directory of the destination shell
`account are then available to the accessing device accessing
`the Internet. A transport control device packetizes the digital
`image files according to a predetermined Internet transport
`control protocol, and controls addressing of the packetized
`digital image files to the predetermined Internet address. The
`transmission initiating device initiates a connection with the
`Internet via the transport control device and the network
`interface device.
`
`In this manner, the portable, standalone integrated Inter-
`net camera may initiate and independently control scheduled
`connections to the Internet and transmission of real-time
`
`digital images to the Internet,without requiring the use ofan
`external controlling apparatus such as a personal computer
`or server, and the images become available to any authorized
`user on the Internet. As part of a system,
`the portable,
`standalone integrated Internet camera may initiate and inde-
`pendently control scheduled connections to a destination
`shell account having a user directory at a predetermined
`Internet address and transmission of real-time digital images
`to the user directory, without requiring the use of an external
`controlling apparatus such as a personal computer or server,
`and the images become available to any authorized user on
`the Internet via the accessing device.
`The network interface device may include a modem for
`connecting to a telephone system connected to the Internet.
`In this case,
`the transmission initiating device includes a
`telephone conversion device that initiates a telephone con-
`nection with the Internet via the modem according to a
`predetermined telephone transmission protocol, and that
`converts between the predetermined telephone transmission
`protocol and the predetermined Internet transport control
`
`‘Jl
`
`IU
`
`1U
`
`3U
`
`40
`
`45
`
`50
`
`55
`
`an
`
`4
`protocol. Accordingly. the integrated Internet camera may
`perform the recited functions over a public or private
`telephone network, or any network or connection using
`telephone transmission protocols or analog data transmis-
`sion.
`
`The integrated Internet camera may include a second
`scheduling device, including timers, for scheduling image
`captures by the image capturing circuit. Accordingly, image
`captures and image transmission may be scheduled at dif-
`ferent times. In this case, the digital image files may include
`information representing a status of one or more timers.
`The integrated Internet camera may further include a
`character generator for generating textual information in the
`captured digital
`images, wherein the character generator
`generates textual information in the captured digital images.
`In this case, the generated textual information may represent
`a status of one or more timers.
`
`The integrated Internet camera may include a serial
`interface adapted to connect to a setup device, the serial
`interface receiving commands for controlling the integrated
`Internet camera from the connected setup device. In this
`manner, the integrated Internet camera may by controlled or
`configured by another device.
`Optionally. one or more of the transport control device
`and tile transfer device further includes a network authen-
`tication device for providing network login authentication
`for connecting to the predetermined Internet address via the
`network interface device.
`In this manner,
`the integrated
`Internet camera may access and transmit files to networks
`having security and authorization provisions.
`The integrated Internet camera may further include a
`configuration device, which includes a configuration infor-
`mation retrieving device and a configuration setting device.
`The configuration information retrieving device retrieves
`configuration information from the destination shell
`account, while the configuration setting device sets opera-
`tional parameters of one or more of the image capturing
`circuit, the network interface device, the file transfer device,
`transport control device, the transmission initiating device.
`and the first scheduling device, according to the configura-
`tion information.
`
`Further, the file transfer device may further include a
`directory selecting device for setting and transmitting a
`destination directory and filename for transferring digital
`image files to the destination shell account, allowing the
`transmission of digital image files to one or more specific
`directories of a destination shell account.
`
`The image pickup may include a color component system
`for forming a color image,
`in which case the integrated
`Internet camera may further include a color adjusting circuit
`for adjusting color properties of the captured digital images.
`The integrated Internet camera may include an image
`compression circuit that generates compressed digital image
`files from the captured digital images, so that the file transfer
`device transfers the compressed digital image files to the
`destination shell account and the transport control device
`packetizes the compressed digital image files according to
`the predetermined Internet transport control protocol.
`In one modification of the system,
`the predetermined
`Internet transport control protocol does not detect errors or
`retransmit erroneous data, thereby increasing a rate of image
`transfer by the file transfer device.
`In another modification the integrated Internet camera
`further includes an E-mail transmission device and E-mail
`
`message assembler. The E-mail message assembler
`0026
`
`0026
`
`

`
`US 6,930,709 B1
`
`5
`
`assembles E-mail messages representing a status of the
`camera and the E-mail transmission device transmits the
`
`E-mail messages to a predetermined E-mail address via the
`transport control device and the transmission initiating
`device.
`
`‘Jr
`
`6
`FIG. 13 is a flow chart of a write file routine of the
`integrated Internet camera shown in FIG. 2;
`FIG. 14 is a flow chart of a batch upload routine of the
`integrated Internet camera shown in FIG. 2;
`FIG. 15 is a flow chart of a reporting routine of the
`integrated Internet camera shown in FIG. 2;
`FIG. 16A is a
`flow chart of a setup routine of the
`integrated Internet camera shown in FIG. 2;
`FIG. 16B is a flow chart of a command routine of the
`
`integrated Internet camera shown in FIG. 2;
`FIG. 17 is a block diagram ofa second embodiment of an
`integrated Internet camera according to the invention;
`FIG. 18 is a block diagram of an addendum to the menu
`and parameter storage structure of FIG. 2 for the second
`embodiment of FIG. 1'7;
`FIG. 19 as a flowchart addendum to image capture routine
`of FIG. 8 for the second embodiment shown in FIG. 17;
`FIG. 20 is a block diagram of a third embodiment of an
`integrated Internet camera according to the invention
`FIG. 21 is a block diagram of a fourth embodiment of an
`integrated Internet camera according to the invention; and
`FIG. 22 is a block diagram of a fifth embodiment of an
`integrated Internet camera according to the invention.
`DESCRIPTION OF TI-IE PREFERRED
`l3MBOI)IMI5N'I‘S
`
`In this case, the E-mail message assembler may assemble
`E-mail messages including the digital
`image files.
`Accordingly, the E-mail transmission device may transmits
`the E-mail message including the digital image files to a
`predetermined E-mail address via the transport control
`device and the transmission initiating device.
`The integrated Internet camera may further include a
`trigger device linked to the camera andfor the rnicrocorttrol-
`ler. In response to triggering of the trigger device, the camera
`initiates an image capture and transfer of the digital image
`files to the destination shell account via the file transfer
`device, the transport control device, and the transmission
`initiating device.
`Optionally, the integrated Internet camera further includes
`a video input for receiving a standard video signal, and the
`image capturing circuit captures the digital images from the
`video input
`instead of from the image pickup.
`In this
`manner, a camcorder or other video source (tuner, CCTV
`network) may he used to supply the digital images to be
`transmitted over the Internet or otherwise.
`
`In another modification, the integrated Internet camera
`further includes a video output for sending a standard video
`signal, wherein the digital image files are transmitted as
`video images to the video output. In this manner, any images
`transmitted over the Internet or otherwise may also be
`supplied to, e.g., a local monitor, recording device. or CCTV
`network.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The present invention is further explained in the descrip-
`tion which follows with reference to the drawings,
`illustrating, by way of non-limiting examples, various
`embodiments of the invention, with like reference numerals
`representing similar parts throughout the several views, and
`wherein:
`
`FIG. I is a block diagram of a prior art system capable of
`transmitting digital images to the Internet;
`FIG. 2 is a perspective view of an integrated Internet
`camera according to a first embodiment of the invention;
`FIG. 3 is a block diagram of the integrated Internet
`camera shown in FIG. 2;
`FIGS. 4A and 4B are schematic diagrams ofthe integrated
`Internet camera of FIG. 2 connected to the Internet;
`FIG. 5 is a block diagram showing a menu and parameter
`storage structure of FIG. 2;
`FIG. 6 is a flow chart of an initialization routine of the
`
`integrated Internet camera shown in FIG. 2;
`FIG. 7 is a flow chart of a main routine of the integrated
`Internet camera shown in FIG. 2;
`FIG. 8 is a flow chart of an image capture routine of the
`integrated Internet camera shown in FIG. 2;
`FIG. 9 is a flow chart of an image transmit routine of the
`integrated Internet camera shown in FIG. 2;
`FIG. 10 is a flow chart of a disconnect routine of the
`
`integrated Internet camera shown in FIG. 2;
`FIG. 11 is a How chart of an file transfer connect routine
`of the integrated Internet camera shown in FIG. 2;
`FIG. 12 is a [low chart of a telephone connect routine of
`the integrated lntemet camera shown in FIG. 2;
`
`IU
`
`1U
`
`3U
`
`40
`
`FIG. 2 shows a first embodiment of the present invention.
`All of the electronic, mechanical and optical components of
`the integrated Internet camera 1 are housed within a camera
`body 201. Accordingly. in the context of this specification,
`“integrated” is equivalent to "seil'-contained”, such that all
`the noted components are supported on or situated within the
`body or casing. As shown in FIG. 2, the camera 1 may be
`connected to the Internet via a network interface device 236
`(comprising, eg, a modem or network card) and a connec-
`tion cable 237 (which may be a telephone wire connected to
`the public network or a network cable connected to a local
`or wide area network). Preferably. the camera body includes
`a threaded camera mount, and is sized and shaped to fit
`industry standard environmental housings for outdoor use.
`A viewfinder 244 allows the operator to view a scene
`corresponding to, or identical to, an image formed on an
`image pickup (shown in FIG.