I|||||||||||||||||||||||||||||||||l|||||||||ll|||||||||||||||||||||||||||||
`
`USO069307U9I3l
`
`(13)
`
`United States Patent
`Creamer et al.
`
`(10) Patent No.:
`
`(45) Date of Patent:
`
`US 6,930,709 B1
`Aug. 16, 2005
`
`(54)
`
`INTEGRATED INTERNET,n"lN'l‘RANET
`CAMERA
`
`(75)
`
`Inventors: Rob Creamer, Boulder, (TO (US);
`Walter Knapp, Boulder, (TO (US);
`Mark Koch, Broomfield, CO (US);
`Yoshlyuki Araki. Sztitama-ken (JP);
`Richard Helton, Boulder, CO (US)
`
`(73)
`
`Assigneez PENTAX of America, Inc., Montvale,
`NJ (us)
`
`(*)
`
`Notice:
`
`Subject to any disclaimer, the term oftltis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(31)
`
`Appl. No.: 091204-,289
`
`(33)
`
`Filed:
`
`Dec. 3, 1998
`
`(60)
`
`(51)
`
`(53)
`
`(58)
`
`(56)
`
`Related U.S. Application Data
`Provisional application No. n‘30t'£|85_.585_. filed on May 15,
`1998, and provisional application No. 6Dt'D67_.31{1. filed on
`Dec. 4, I991
`
`U.S. CI.
`
`Int. CL?
`
`H04N 5,n’232; lI04N SL225;
`I-I04N IIKOO
`34812113; 3481207.];
`348552
`34-8f2U'?.l, 211.3,
`Field of Search
`34¢‘?-t'211.1, 211.8, 211.12, 552, 231.2, 231.6,
`14.01-l4.16, 36, 211.6, 154, 155,158;
`3S8;’4()3; 7041203
`
`References Cited
`
`U.S. PA'l'EN'l‘ DOCUMENTS
`
`5,185.66? A
`5,283,655 A
`5,477,264 A
`5_.4?9_.2[)6 A ‘*
`5,612,732 A *
`5,f)33_.6't'8 A "
`5,635,983 A
`3.646.684 A *
`5,724,155 A "'
`
`M1993 Zintntermann
`2.n‘l994 Maeno
`12t’l99S Sarbadhijrari et al.
`I2.-"1?-J95 Ucno ct al.
`3.-‘I99? Yuyanta el al.
`5.31997 Parul-ski cl al.
`I').1I‘J<)7 Oltmori
`7t‘l‘J‘.)'i' Nishizawa el al.
`3.n"l‘)98 Saito
`
`348;-‘2ti..5
`348314.01
`348t'23l.5
`
`348!231.S
`3531402
`
`M1998 Takizawa el all.
`5_.'i'34,4l‘fi A
`8Jt998 Gullichsen etal.
`5,795,425 A
`5_.8l8_.53".7 A "‘ 1Ut"1998 Enokida ct al.
`5,8”i'tJ,I35 A
`2r19<J9 (ilatt ct al.
`5,887,144] A "
`3.31999
`Ilsumi elal.
`5,011,044 A * M1999 Lo ct al.
`5,9‘)(J,94t A
`ll."1‘J9<J
`Jackson el al.
`6_.E)(J5.6l1 A
`12t’1999 Gnllichsen et al.
`
`(Continued)
`FOREIGN PATENT DOCUMENTS
`
`3431441
`
`'.r'[)9f225
`‘i'()9;‘2t.I3
`
`JP
`JP
`
`tJ8lU2837 A “
`08171691 A "‘
`
`4;-‘I996
`7,-‘I996
`
`I104-NIUI/32
`......... ..GO8Br‘25;-‘(II
`
`OTHER PUBLICATIONS
`
`3.3 Connectionless Transport: UDP, Ross and Kurose; httptff
`wvvw—net.cs.u masseclutku roset’transp0rti"U DP.htmI;
`199 6-2000. ‘
`
`(Continued)
`
`Primer‘): Examiner—Wendy R. Garber
`Asnistant Exariiiner—John M. Villecco
`(74) Attorrtqv, Agent, or Firm—Greenblum & Bernstein,
`P.L.C.
`
`(57)
`
`ABSTRACT
`
`An integrated Internet camera includes, as embedded com-
`ponents contained within the camera body and controlled by
`a mieroeontroller, at
`least a network interface device for
`connecting to the Internet, a transport control device for
`packetizing according to Internet protocols, a file transfer
`device for communicating with a destination user directory
`on the Internet, and a
`transmission initiating device for
`initiating the connection and transfer operations of the file
`transfer device and transport control device. The network
`interface device may be a modem, network adapter, or
`adapter for connection to the Internet. Upon capturing the
`digital
`image,
`the camera initiates a connection to the
`Internet, connects to the destination user directory, and
`uploads the digital images. Thereafter, the digital images are
`available to authorized (or any) user having access to the
`Internet.
`
`91 Claims, 22 Drawing Sheets
`
`24.5
`
`0001
`
`Apple/Twitter
`Apple/Twitter
`Ex. 1003
`Ex. 1003
`IPR2 of U.S. Pat. No. 8,612,515
`IPR2 of U.S. Pat. No. 8,612,515
`
`

`
`US 6,930,709 B1
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`348714.04
`
`34372113
`
`35871.15
`
`272003 Sale elal.
`fi_.5I?_‘3,'7‘61 B2 "'
`372003 Driscoll, Jr. el al.
`6,539,547 B2
`572003 Andersunelal.
`5,557,122 Bl *
`572003 8
`'lzk
`1
`1.
`5,571,271 B1
`772003 2:055 0:941?
`5'.591,279 B1
`772003 Hirokielal.
`5,594,032 131 8
`872003 Marlin ml.
`5,503,502 B2
`973003 Lassilcr
`5’524’34¢5 31
`1072003 Anderson 51 :1].
`5,535,259 131
`472004 K0 ana 'el :1].
`fi.720.98'7' B2
`972001
`suzfuki gl
`200170024232 Al
`272003 Nakamura 1-.1 al.
`200370025803 Al
`1172003 Gross
`200370208557 A1
`172[](]4 Nakayama
`2QQ4l,7{){}12311 A1
`OTHER PUBLICATIONS
`
`ilal Photo ra-
`g
`
`g
`
`P.M. Corcoran cl 21]., “Internet Enabled Di
`. . .
`PW’
`"5557 PP" 8434'
`Instruction Manual
`“NI-5C Picona digital camera,
`PC—DC2(l0 and P(.‘—DC20UK", daled Feb. 1997.
`.
`‘
`.
`.
`.
`H
`\7er1fied Enghsh lang11agc lransla110n of NEE P1c0na
`dlgltal camcia,
`Inslruf:l10n Manual
`tor PC—D(...00 and
`PC-DC-200K . dated I‘eb- 1997.
`
`for
`
`* cited by examiner
`
`0002
`0002
`
`:'hl‘m8°‘a]|-
`run-‘ion <=la-
`Drisc°|'. 11- =1 91-
`Fisher 91 91-
`
`Hoetah
`Pcriasanly ct al.
`1ga;%hiela1-
`A" 9540“
`Anderson =1 at
`3491426-19
`Murphy 91 a|-
`----- -- 710052
`Safai cl 41-
`-7
`' BIB
`3487'2[l.5
`Elie
`Kiyokawa .............. .. 37-1-87211.3
`Sailo ct al.
`35871.15
`
`..
`
`
`
`mnm“
`7
`
`705725
`35871-15
`'7'097’242
`'»"C'97’232
`
`386F120
`348754
`
`In.°"e at al'
`Fxchlncr
`Schmidt
`Fukuoka
`Furlan el 41.
`Fichlner el :1].
`709,220
`Kfishnamunhy el al‘
`Hameu
`Kjlamura .................. .. 7097217
`Matsui
`3587403
`Aizawa et al.
`
`5,034,715
`5,038,295
`5,043,837
`5,047,254
`5,051,502
`5,055,052
`5,057,571
`5,094,221
`5,134,505
`6,147,598
`5,157,459
`5,188,431
`5,195,511
`5,204,877
`5,208,425
`5,225,449
`5,255,059
`5,278,481
`5,300,975
`5,331,859
`5,350,352
`0,389,464
`5,407,752
`5,438,587
`5,44 I ,9 24
`5,452,529
`
`EEEEEEEEEEEEEEE’E>>3*3“>3“>>3'>>
`
`Bl
`
`-I-I-If
`
`37’2000
`372000
`372000
`472000
`572000
`572000
`572000
`77’2000
`1072000
`1 17’2000
`"‘ 12.32000
`It
`272001
`272001
`372001
`372001
`572001
`77"200l
`81/2001
`1072001
`1272001
`372002
`57'2002
`(#2002
`872002
`872002
`97"2002
`
`I-I-I-I
`
`

`
`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 1 of 22
`
`US 6,930,709 B1
`
`.E<mo_E_dz
`
`0003
`0003
`
`

`
`
`
`U.S. PatentU.S. Patent
`
`
`
`Aug. 16,2005Aug. 16,2005
`
`
`
`Sheet 2 of 22Sheet 2 of 22
`
`
`
`US 6,930,709 B1US 6,930,709 B1
`
`
`
`FIG.2FIG.2
`
`
`00040004
`0004
`
`

`
`_o_zm5.__2mao_2
`
`
`
` m:m_«o0_.2n_m__a»o&<mam420305200d._.EzE0m_o_>m_a_J,m_o...u_w_mE_u6v_mo_.s._.wz
`.21oown_mz_ozmuzo_mmmm%_oo
`
`U.S. Patent
`
`A
`
`mopqmm2m0Im._.Ud_.K<IU
`
`m.O_n_
`
`m0¢E_
`
`>:o2mE
`
`24mm
`
`
`
`mm._._9.._._.ZOU
`
`o
`
`cm
`
`Sum
`
`E9%
`
`mwm
`
`mw¢_2_
`
`n_Dv_U_n_
`
`:3om_o
`
`n.w0‘
`D‘!
`
`L.
`
`000
`
`mmzma
`
`«mm
`
`C
`
`2
`
`I)
`
`1B
`
`00058
`
`8
`
`om>.En5mom<om>wv.
`2M_.NN_.Nmmjompzou
`
`momE3532.
`ENmmJ_.6Ezoo
`
`:o._.:smS.zorSmUm—mHE»«.Em_o1EE____:____
`6w_.Saz,
`
`
`H!.momzmm
`
`09on2.:._mmm_&o._v_.N0.220:02_.m.£3_$8.59.
`
`
`
`9m_u_>m_o0_.mmizmmim
`
`mm
`N
`
`Izmjowfizoo
`
`.EEm_m
`
`.2_~m_m
`
`._OwFzou
`
`mam
`
`Em
`
`New
`
`_2<m>2
`
`
`
`v_oE.w._2
`
`.n_._.u_
`
`
`
`Emamo9:40
`
`
`
`“n8m3msowmm_.mw._._oEzoooxo__2om_b..mow»z_O_
`
`
`
`
`
` Mm3013mmjompzoommjompzouxm._._cEzooH4.022
`
`
`
`
`
`
`
`
`
`
`

`
`0006
`
`
`
`8888
`
`
`
`U.S. PatentU.S. Patent
`
`
`
`Aug. 16,2005Aug. 16,2005
`
`
`
`Sheet 4 of 22Sheet 4 of 22
`
`
`
`Us 6,930,709 B1Us 6,930,709 B1
`
`

`
`U.S. Patent
`
`(DS
`
`1B9
`
`0007
`
`38
`
`
`
`
`..a_m:2.2:an:tn.u.._.§.3a_uam:tn:WA.5Ab9C..3_!,._a_..__.5.$32..¢BuE__..2:man»2...o_w_m_.EmE2...2»3..EmE0uz5nma.o=oa=
`
`6”2”:_.o_E.w._u:a_=_uE_=.m_nu%.333Bn__unn.w.__uuuEa:
`
`
`
`
`9zmumzaepW|=u_.mus.
`
`
`
`Uease_..a__%25.E35ea
`
`
`_z.£_§__2_.nEEm5_o_3..a2mE._=&r23..§n
`
`
`
`
`
`85...5mE:w«.23?._mE&:un_._3wm.__nEw._u3:o:._.._3u..
`
`
`
`.EEu5_._o3nm.EER.nEEu&:o_nwmB.Eoo
`
`_.Ew._a_&_.__o___E:.mw.nEw._nnvco:n.5_ma
`
`
`
`
`
`
`
`
`
`
`
`
`mwmcuuumumonHoz.Eo._uxEmu.-0z.E__£_2._sa_aG3Bu..nztu._£._:uOw£53.50:.5~z...cE_.____u_mommaV223mawum..flE__M.Czo_ma._..3z§.__.flzoaaoawas2:.
`
`
`r.._,_§...._§_._..a-__=___,¢._._Ewo.,_fi.”.,_.w._._§.a..§.._§g.m_fi.wn%u.._EEE.
`
`
`
`n:f._.EEm&nam5:m_=_nEm._m.3$2._..:a_..a._nz....G2:__m__Eau_u.._.__nEEm5.2:Eoo?..w..u&_mw.__=ounnz____>v_o.:o
`
`
`
`AZ.cL_nu!.E.305:
`
`
`
`
`
`2.832....__._.._.a.72.3.a..__=Esp.
`
`
`
`._w,..Mw.__”..““_M..__..E._,_pH.._.h.5..
`
`
`
`
`?E..=w&toEmficuasn:2.EEm3_m._.>.u__w:m___&n.zE___§_...m
`
`
`
`
`C..5_!:n.E_.3332Eo3a2..n_:._.wa_..n_.:2m-mmAEw.=..&3823n..E.,__m.E:..u_E§m__._.s_;
`
`
`
`.23oazuzu3352mm..nE.n_._.=._
`
`._,§...._.
`
`
`
`.8329._oEuEan._._.m._..M¢um:._.oS_:z<s_C.E_2r.2:__.§m._u:.z..%_§_e.___.nWmmwman_<¢mm_..._¢oEaa.mxwfiwmc_M__mm5..z.cc__.§_...=.._2sxwc2m.£E=Emum.»inufiuu
`
`
`
`
`
`
`
`
`:_...__.uu::3noon...co.on._u.=o_uu$.35...-.E353aco__nn._..z..to=.__s...!5cébo=.__._.._o>o3wanna
`
`
`
`
`
`
`
`
`¢=Eu3unionanus...
`
`
`
`
`
`6:._ua.cmE..a-£w_u____w.._._=“=a...=_........
`
`
`
`
`
`
`
`n...._!..0EA_B_._Sm.2.5:._2.Ease»9.32.53swam...o__._.owZOEZEMDme...
`
`
`
`
`
`mzo=..._m._m
`
`mmfisnxdzE2wz:..._on_mmZmzo:.<o_z:__.=.__.uu—zD_._.n_ODEEmm_:=mmods:
`.....0z_.Emm
`
`
`
`mm_mm__z¢m<._aDZMEi
`
`
`
`

`
`U.S. Patent
`
`Aug. 16,2005
`
`Sheet 6 of 22
`
`US 6,930,709 B1
`
`FIG. 6
`
`BOOT!
`
`INITIALIZE
`
`0008
`0008
`
`

`
`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 7 of 22
`
`US 6,930,709 B1
`
`FIG. 7
`
`ENABLE USER
`INTERVENTION
`
`
`
`NAU
`
`
`INTERFIUPT?
`
`LOCAUFIEMOTE
`
` COMMAND
`
`LOCAUFIEMOTE
`SETUP SIGNAL
`
`0009
`0009
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 8 of 22
`
`US 6,930,709 B1
`
`FIG. 8
`
`
`
` ASS|_GN
`
`IMAGE SLOT
`
`ASSIGN
`NEXT
`
`
`
`ACCORDING
`TO
`
`
`
`AVAILABLE _30
`EVENT
`
`TIMER
`IMAGE SLOT
`
`
`GET
`
`S32
`
`EXPOSURE
`
`
`
`CCD
`
`CAPTURE TO
`
`S34
`
`IMAGE MEMORY
`
`S36
`
`S38
`
`
`JPEG COMPRESS
`
`TO GP DRAM
`
`
`
`
`
`
`
`
`0010
`0010
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 9 of 22
`
`US 6,930,709 B1
`
`FIG. 9
`
`DIAL UP OR
`
`CONT. ?
`
` N
`
`350
`
`I DISCONNECT I
`
`0011
`0011
`
`

`
`U.S. Patent
`
`Aug. 16,2005
`
`Sheet 10 of 22
`
`US 6,930,709 B1
`
`FIG. 10
`
`DISCONNECT
`
`
`
`
`
`
`
`
`DISCONNECT TCP/IP,
`
`PPP, MODEM AS
`NECESSARY
`
`
`
`0012
`0012
`
`REPORTING
`
`ON?
`
`
`
`

`
`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 11 of 22
`
`US 6,930,709 B1
`
`FIG. 11 TCPIIP
`
`CONNECTED?
`
`TCPIIP (PPP)
`CONNECT!
`
`LOGIN, COUNT
`RETRIES, ERROR 3.
`RETURNIF
`
`RETRIES
`
`EXCEEDED
`
`F|'P
`
`CONNECT, COUNT
`RETRIES, ERROR 8:
`
`
`
`
`RETURN IF
`
`RETRIES
`
`EXCEEDED
`
`0013
`0013
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 12 of 22
`
`US 6,930,709 B1
`
`FIG. 12
`
`DIAL/FIEDIAL
`
` ENABLE MODEM,
`
`RETURN
`
`0014
`0014
`
`

`
`U.S. Patent
`
`Aug. 16,2005
`
`Sheet 13 of 22
`
`US 6,930,709 B1
`
`FIG. 13
`
`
`
`GET FILE INFO FROM
`
`
`
`SERVER
`
`S72
`
`
`
`WRITE FILE
`
`FILE FROM SLOT N
`
`
`
` WRITE/OVERWRITE
`
` S74
`
`
`ACCORDING TO FTP
`
`
`
`DIRECTORY & ATTRIBUTE
`
`S75
`
` DOWNLOAD NEW
`
`
`
`SETUP FILE
`
`IF NECESSARY &
`
`FTP LOGOUT/DISCONNECT
`
`RETURN
`
`
`
`0015
`0015
`
`
`
`

`
`U.S. Patent
`
`Aug. 16, 2005
`
`Sheet 14 of 22
`
`US 6,930,709 B1
`
`FIG. 14
`
`FTP
`
`CONNECT
`
`ASSEMBLE BATCH LIST
`
`
`
`
`WRITEJOVERWFHTE
`
`
`FILES FROM BATCH LIST
`
`ACCORDING TO FTP
`
`580
`
`DIRECTORY & ATTRIBUTE
`
`DOWNLOAD NEW
`
`SETUP FILE
`
`881
`
`IF NECESSARY
`
`
`
`U DISCONNECT I
`
`
`
`884
`
`0016
`0016
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 15 of 22
`
`US 6,930,709 B1
`
`FIG. 15
`
`REPORTING
`
`REPORTING ON?
`
`
`
`ALREADY
`
`
`
`ON NECTED
`
`
`
` TCPIIP
`CONNECTILOGIN
`
`W! RETFIIES]
`
`
`ASSEMBLE SMTP
`S98
`
`
`MESSAGE FROM
`REPORTING BUFFER
`
`
`
`8104
`
`DISCONNECT TCF‘/IF’.
`PPP, MODEM AS
`NECESSARY
`
`
`
`
`0017
`0017
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 16 of 22
`
`US 6,930,709 B1
`
`FIG.
`
`16A
`
` REMOTE BUTTOBUSVWTCH
`
`S108
`
`
`
` RECEIVE
`
`NEW
`
`3120
`
`3122
`
`
`
`
`
`PARAMETERS!
`FIRMWARE
`
`
`
`
`D(§;Lh’;"(;’E&
`DISPLAY &
`NEW
`
`CHANGE
`PARAMETERS!
`MENU
`LEVEL
`PARAMETER
`FIRMWARE
`
`
`
`
`
`
`
`DISPLAY &
`CHANGE
`MENU ITEM
`
`
`
`0018
`0018
`
`WHITE
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 17 of 22
`
`US 6,930,709 B1
`
`FIG. 16B
`
`
`
`COMMAND
`
`READCOMMAND&
`
`DATA
`
`S130
`
`
`
`
`
`
`PARAMETERSET
`
`TASK EXECUTiON
`
`ERROR
`
`S138
`
`S134
`
`S136
`
`
`EXECUTE
`
`RECORD
`
`ERROR
`
`
`
`SET
`
`PARAMETER
`
`0019
`0019
`
`

`
`US. Patent
`
`2f0no1fl
`
`1BW
`
`0020o
`
`moo
`
`mmjompzou2.E_.Ew_mE_
`
`._¢_mm_m
`
`«m_._._oE.zou
`
`oésmEGQE.24.1>2S._.IU_m_.NEzotnmm_.N_.NmewmamNvm
`
`
`
`
`domzmm.n_E:_d___w....mm___d_.DL_@—‘.__d__ZKm..rXmEm>En_DId__U%u__2flu.fiu_>m_c0On.Q.
`
`
`
`
`9,zO:.OE._a.£$04.5n=._nn.:,.__£63&2.
`
`.§.._n_m_a\»JDKHZOU§._::___:2%ma
`
`8_zEmma:m
`
`
`
`5maquW3_om_..m5n=mam¢:a3oEzoo._m:._..&§2mucmo
`
`mo._.<mmzm_o
`
`mmpoqmqzo
`
`K04DU
`
`E_.=.n_....
`
`Ixzo..E.mz
`6.,mu.Emm:z_
`
`owwz_ozm%2o_wmm_zn__2oowwm
`
`mm:40M._.ZOOzqmo
`
`mam
`
`
`
`momHxm_jo.n:zooomo_zoE.¢moE.z_o._
`
`MxmzzmSoou
`
`
`
`
`
`
`
`

`
`U.S. Patent
`
`Aug. 15, 2005
`
`Sheet 19 of 22
`
`US 6,930,709 B1
`
`N8OH
`
`,mm
`
`.+4:gz<m
`
`.EOON
`
`mmom»m>o<mm
`
`3.O_u_
`
`9820mm
`
`9.0:
`
`_
`
`Tlllllllflr
`—mmdmmo¢z_
`
`0021
`0021
`
`
`
`
`

`
`0022m
`
`moo
`
`m907“,
`
`0Eosmo3ézmmhxmmFm9mm.5momzmm
`
`
`
`
`nEm_.b_E.n_(0UK.2._«Emm_<o__._uFmu__2zoEu_2..m_2S_Imucus;
`.n_md_UUat_SL2.
`
`
`
`zutzmzufim&____n_U._..2
`
`25.>2
`
`com
`
`._.q__w_mm0N—N..5:mmFz_NN,Fmm.u.:oEzou
`..._l._,._._._:m9EoE.mx&meson.
`
`_.nmm_._._oEzo.USd._D..;_Un_
`7.mommm._._ox:,_ouMzm._,_oE.zoo
`
`
`mEmfiw—Fm
`._.3n_m_o21Nvmmam
`99___:____aEz8
`
`
`
`
`
`._.xm:_n_Ow:.ZOUOM_U__2.Dm._.(mDmPZu
`
`
`
`
`
`
`
`
`
`,m:._§_§ o%a_.,_N.wowea...0._s..m_oos_m:m¢u._4amn¢mpz2_.znw_a5n_4mamE.¢n_:o5zoo
`
`S..U
`
`tHEta
`
`6.,mu_>mo_1m_oE..._m:z_4awxmo>__c.m.z
`
`uom_z_wzmAmamzO_mmwm.¢,__Ou
`
`mam
`
`E119
`
`mmjompzoo
`
`p.
`
`mm.6<:.s..u
`
`mozauzmo
`
`oN.0_n_
`
`
`
`
`

`
`US. Patent
`
`Aug. 16, 2005
`
`Sheet 21 of 22
`
`Us 6,930,709 B1
`
`0023
`
`mmoo
`
`mm_.Nzo_MM.npu.__._m_m<EN...<zmm:xm_m_.w
`
`m_o_>ma
`
`..zam__.w_.o&cm_u_>un.m_o$EmE.__oxmozcmz.2
`
`
`
`6.2m_.zmn_o..._w._m<o
`
`oJ.
`
`
`
`»comzm._._oEzooomo__..__au.Emom=z_
`
`
`.85..NE.253sozoamm>_mn
`vmflmw mmjofizoo
`
`amNewnuu
`
`mmmzo_mmm_Es_oo
`
`mm_z_wzm
`
`:2E«Ehoom_2§_omomm._._oEzoo
`
`.2<mn_mvm
`
`8mamam_
`
`
`
`am__,%.,.._.H__.,__.N.O_u_
`
`ENEN<nE___._.¢0n_
`
`
`
`mom..<_mmmmmm
`
`
`
`m_.mzu.:oE.zoo
`
`on9._<_mmmRo._—
`
`
`
`Saz._._U._..r.Sw
`
`
`
`..zo._._.:mmbm
`
`405200—__._<_mmm
`
`
`mwdompzoom.mH,M
`
`
`E_._zxm»z_..mam
`
`.HH_._¢_mm_m
`
`:5.>2
`
`
`
`.v_o<5n____n_o_.._a
`
`
`
`wEo__2.E."_
`
`«_uuo_E
`
`
`
`
`
`

`
`0024«
`
`moo
`
`mam
`
`mm5—
`
`.I_B01
`
`
`m35EEnm,:.Fm3.5.3v_mo:..._.mz
`Ow,
`
`>._.on_mo©__.Non2oummmm_._o.:.sm
`
`29m_>m:m:..Ill:omn__..,6IIINmrFmS5%._._o:__smUIEotbmEonmEoa
`
`
`.n_.N.$99.5mmom__E.
`
`._<_«_mm
`
`:_Om._.ZOU
`
`mam
`
`Nvm
`
`24¢>2
`
`
`
`204.5n_____n_O._..__.:
`
`.n_.__.u_
`
`
`
`Emzmoozqo
`
`fmmmmmjoE.zooUomqomfix
`
`2E.E:mEmE_2mm.Em>zoo
`
`
`zm_._._oEzoo
`
`U.S. Patent
`
`1E
`
`mosma2moEmm»z_6:x«_o__.___.m_z
` .925.__._,n._n_o_2m_._m«oW~zom_._m.En:
`
`
`-H
`
`domen
`
`
`
`...Lom_o__e.au._fl..EEuE_
`>._,E_..m2M_.N mm_joE.zoo9.
`
`umamAmmm29.
`
`._.OOmsémo,5
`
`zqmo
`
`mm._._oEzou
`
`O8
`
`mmmmmm
`
`CNN
`
`mw.<_2.
`
`Eozmz
`
`O._.
`
`._4.n___,Uw._.Z
`
`
`
`mm.:om._.zooEmmaO._.
`
`mwm
`
`DUU
`
`.__r_.UUKOmmamooamo
`
`__EE
`
`.51:
`
`DUO
`
`mmame
`
`mum
`
`«mm
`
`KN
`
`mzm:m.._ma.mu2<:oxm
`
`
`
`
`

`
`US 6,930,709 B1
`
`1
`INTEGRATEI) lN'l‘ERNET;’IN'l‘RANl£'t‘
`CAMERA
`
`The present application claims the benefit of U.S. Pro-
`visional Application No. 6tJX[l67,3 10, tiled Dec. 4, 1997, and
`U.S. Provisional Application No. 60;‘085,585, filed May 15,
`1998, which are expressly incorporated herein by reference
`in their entireties.
`
`BACKGROUND ()1: 'I‘l-IE lNV|iN'l‘ION
`
`1. Field of the Invention
`
`The present invention relates to an integrated camera for
`connecting to the Internet and transmitting images over the
`Internet.
`
`2
`In particular, multiple
`functions and excess capabilities.
`microprocessorstcontrollers, power supplies, and communi-
`cation lines are necessary to operate the separate parts of the
`system. Moreover, such systems include many opportunities
`for error because of the many interfaces and communication
`links between discrete devices. Such error may occur as
`ditficulties in setup and configuration and incompatibility
`between devices in operation.
`3. Acronyms
`The following acronyms and abbreviations are used
`throughout the specification. For brevity, the definitions are
`summarized as follows:
`
`‘Jl
`
`IU
`
`2. Description of Background Information
`As the Internet (i.e.,
`the worldwide inter-network. cur-
`rently operated under TCPKIP: Transmission Control
`Protocoltlnternel Protocol} gains more participants and
`becomes more consumer-oriented, the demand for simpli-
`fied ways of providing access to various media increases. A
`large portion of the new participants seek access to the
`“World Wide Web” (i.e., a hypertext-driven global multi-
`media system, hereinafter the "Web“). Archives of digital
`images (photographs and motion video) are now ubiquitous.
`The demand for real-time or live video, whether motion
`video or still video, has dilfcrcnt requirements, but has also
`become strong. Needs in entertainment, advertising,
`education, security, tralfic monitoring, weather monitoring,
`child care monitoring, and surveillance, as well as general
`consumer usage, have driven the creation of an initial wave
`of systems able to place a real-time image. or series of
`images, on the Internet and on the Web.
`However, the prior systems are complex and expensive,
`requiring the use of a general purpose personal computer _
`and a host of peripheral devices to place an image on the
`Internet or Web, as well as attendance by a qualified opera-
`tor. The systems are typically large and lack portability.
`An example of such a prior system is shown in FIG. 1. A
`video camera 110 connects to a "frame grabber” peripheral
`card 112, hosted by the parallel bus 114 of a personal
`computer 122. The frame grabber card 112 decodes a frame
`of an analog video signal from the video camera 110 into a
`digital
`image, and makes the digital
`image available to
`purpose-designed software running on the computer 12.
`Typically, the purpose-designed software eventually com-
`presses the digital image into main memory using the main
`microprocessor of the personal computer 122. In order to
`upload the image to the Internet, the computer 122 requires
`a serial port 118 and attached modern 120, which are hooked
`to the public telephone system 124. The personal computer
`122 uses further software programs running in main
`memory, which include at
`least a modem driver, network
`transmission protocol (e.g., TCPKIP) driver, a telephone
`transmission protocol (e.g., PPP: Point-to-Point Protocol)
`driver, and an file transfer protocol (c.g., FTP: File Transfer
`Protocol) application, to connect to the modern 120, through
`the telephone system 124, and to an ISP (Internet Service
`Provider) 128. 'l'hereal'ter, the personal computer 122 may
`upload the compressed image to a shell account available at
`the ISP I28.
`
`1U
`
`3U
`
`40
`
`45
`
`50
`
`55
`
`oil
`
`Costs for such a system may run to several thousand
`dollars. The computer 122 must be on-site, i.e., relatively
`close to the camera 110, and is large and relatively immo-
`bile. Since the system is an assembly of general—purpose
`components, and the computer 122 is usually dedicated to
`serving the camera 110, the system has numerous redundant
`
`xDSL—(generic) Digital Subscriber Line
`ATM—Asynchronous Transfer Mode
`C(_‘D—Charge Coupled Device
`CCTV—Closed Circuit Television
`
`DNS—Domain Naming System, Domain Name Server
`ExCA—Exchangcable Card Architectu re
`FI'P—File Transfer Protocol
`
`I-ITML—Hypcrtext Markup Language
`IrDA—Infrared Data Association
`
`lSA—Industry Standard Architecture
`lSDN—Integrated Services Digital Network
`lSP—Intemet Service Provider
`
`JPEG——.loint Photographic Experts Group
`MIME——Multipurpose Internet Mail Extension
`NTSC—National Television System Committee
`PAL—Phase Alternating Line
`PCMCIA—Personal Computer Memory Card Intema-
`tional Association
`
`POTS—Plain Old Telephone Service
`PPP~—Point—to—Point Protocol
`SLIP—Serial Link Interface Protocol
`
`SMTP—Simple Mail Transfer Protocol
`TCP;'IP—Transmission Control Protocoltlnternet Proto-
`col
`
`UDPfIP—User Datagram Protocotflnternet Protocol
`URL—Uniform Resource Locator
`USB—Universal Serial Bus
`
`SUMMARY OF THE INVENTION
`
`Accordingly, it is an object of the invention to provide an
`inexpensive and etficient camera having all nccemary func-
`tionality for transmission of real—time and stored digital
`images to the Internet
`in a single, portable standalone
`apparatus (i.e., an embedded system), without requiring the
`use of an external controlling apparatus such as a personal
`computer.
`It is a further object ofthe invention to provide a portable.
`standalone camera that may initiate and independently con-
`trol scheduled tra nsmission of digital images to the Internet,
`where the images become available to any authorized user
`on the Internet.
`
`The above objects are attained by providing an integrated
`Internet camera for transmitting digital images to an Internet
`address, including an image pickup. an optical system for
`forming an image on the image pickup, and an image
`capturing circuit for capturing digital images from the image
`pickup. A network interface device connects to the Internet
`for transmission of the digital image files to the Internet, and
`a file transfer device communicates via the network interface
`
`0025
`0025
`
`

`
`US 6,930,709 B1
`
`3
`device. with a destination shell account at a predetermined
`Internet address and transfers the digital image files to the
`destination shell account according to a predetennined file
`transfer protocol. The digital image files in the destination
`shell account are then available to users accessing the
`Internet. A transport control device packetizes the digital
`image files according to a predetermined Internet transport
`control protocol, and controls addressing of the packelized
`digital image files to the predetermined Internet address,
`while a transmission initiating device initiates a connection
`with the Internet via the transport control device and the
`network interface device. A Iirst scheduling device, includ-
`ing timers. schedules transfer of the digital image files to the
`destination shell account by the transport control device and
`the file transfer device. A rnicrocontroller controls opera-
`tions and communication between each of the recited
`
`devices, and a camera body houses therein all of the recited
`devices and the microcontroller.
`
`In another aspect of the invention, an Internet camera
`system for
`transmitting digital
`images via the Internet
`includes a destination shell account having a user directory
`at a predetermined Internet address and an accessing device
`for accessing the user directory of the destination shell
`account via the Internet. As part ofthe system, an integrated
`Internet camera is housed in a camera body. The camera
`body contains an image capturing system, a network inter-
`face device, a file transfer device, a transport control device,
`and a transmission initiating device. The image capturing
`system captures digital images, and the network interface
`device is connectible to the Internet for transmission of the
`
`digital image files to the Internet. The file transfer device
`communicates, via the network interface device, with the
`destination shell account and transfers the digital image files
`to the user directory of the destination shell account accord-
`ing to a predetermined file transfer protocol. The digital
`image tiles in the user directory of the destination shell
`account are then available to the accessing device accessing
`the Internet. A transport control device packetizes the digital
`image files according to a predetermined Internet transport
`control protocol, and controls addressing of the packetized
`digital image files to the predetermined Internet address. The
`transmission initiating device initiates a connection with the
`Internet via the transport control device and the network
`interface device.
`
`In this manner, the portable, standalone integrated Inter-
`net camera may initiate and independently control scheduled
`connections to the Internet and transmission of real-time
`
`digital images to the Internet,without requiring the use ofan
`external controlling apparatus such as a personal computer
`or server, and the images become available to any authorized
`user on the Internet. As part of a system,
`the portable,
`standalone integrated Internet camera may initiate and inde-
`pendently control scheduled connections to a destination
`shell account having a user directory at a predetermined
`Internet address and transmission of real-time digital images
`to the user directory, without requiring the use of an external
`controlling apparatus such as a personal computer or server,
`and the images become available to any authorized user on
`the Internet via the accessing device.
`The network interface device may include a modem for
`connecting to a telephone system connected to the Internet.
`In this case,
`the transmission initiating device includes a
`telephone conversion device that initiates a telephone con-
`nection with the Internet via the modem according to a
`predetermined telephone transmission protocol, and that
`converts between the predetermined telephone transmission
`protocol and the predetermined Internet transport control
`
`‘Jl
`
`IU
`
`1U
`
`3U
`
`40
`
`45
`
`50
`
`55
`
`an
`
`4
`protocol. Accordingly. the integrated Internet camera may
`perform the recited functions over a public or private
`telephone network, or any network or connection using
`telephone transmission protocols or analog data transmis-
`sion.
`
`The integrated Internet camera may include a second
`scheduling device, including timers, for scheduling image
`captures by the image capturing circuit. Accordingly, image
`captures and image transmission may be scheduled at dif-
`ferent times. In this case, the digital image files may include
`information representing a status of one or more timers.
`The integrated Internet camera may further include a
`character generator for generating textual information in the
`captured digital
`images, wherein the character generator
`generates textual information in the captured digital images.
`In this case, the generated textual information may represent
`a status of one or more timers.
`
`The integrated Internet camera may include a serial
`interface adapted to connect to a setup device, the serial
`interface receiving commands for controlling the integrated
`Internet camera from the connected setup device. In this
`manner, the integrated Internet camera may by controlled or
`configured by another device.
`Optionally. one or more of the transport control device
`and tile transfer device further includes a network authen-
`tication device for providing network login authentication
`for connecting to the predetermined Internet address via the
`network interface device.
`In this manner,
`the integrated
`Internet camera may access and transmit files to networks
`having security and authorization provisions.
`The integrated Internet camera may further include a
`configuration device, which includes a configuration infor-
`mation retrieving device and a configuration setting device.
`The configuration information retrieving device retrieves
`configuration information from the destination shell
`account, while the configuration setting device sets opera-
`tional parameters of one or more of the image capturing
`circuit, the network interface device, the file transfer device,
`transport control device, the transmission initiating device.
`and the first scheduling device, according to the configura-
`tion information.
`
`Further, the file transfer device may further include a
`directory selecting device for setting and transmitting a
`destination directory and filename for transferring digital
`image files to the destination shell account, allowing the
`transmission of digital image files to one or more specific
`directories of a destination shell account.
`
`The image pickup may include a color component system
`for forming a color image,
`in which case the integrated
`Internet camera may further include a color adjusting circuit
`for adjusting color properties of the captured digital images.
`The integrated Internet camera may include an image
`compression circuit that generates compressed digital image
`files from the captured digital images, so that the file transfer
`device transfers the compressed digital image files to the
`destination shell account and the transport control device
`packetizes the compressed digital image files according to
`the predetermined Internet transport control protocol.
`In one modification of the system,
`the predetermined
`Internet transport control protocol does not detect errors or
`retransmit erroneous data, thereby increasing a rate of image
`transfer by the file transfer device.
`In another modification the integrated Internet camera
`further includes an E-mail transmission device and E-mail
`
`message assembler. The E-mail message assembler
`0026
`0026
`
`

`
`US 6,930,709 B1
`
`5
`
`assembles E-mail messages representing a status of the
`camera and the E-mail transmission device transmits the
`
`E-mail messages to a predetermined E-mail address via the
`transport control device and the transmission initiating
`device.
`
`‘Jr
`
`6
`FIG. 13 is a flow chart of a write file routine of the
`integrated Internet camera shown in FIG. 2;
`FIG. 14 is a flow chart of a batch upload routine of the
`integrated Internet camera shown in FIG. 2;
`FIG. 15 is a flow chart of a reporting routine of the
`integrated Internet camera shown in FIG. 2;
`FIG. 16A is a
`flow chart of a setup routine of the
`integrated Internet camera shown in FIG. 2;
`FIG. 16B is a flow chart of a command routine of the
`
`integrated Internet camera shown in FIG. 2;
`FIG. 17 is a block diagram ofa second embodiment of an
`integrated Internet camera according to the invention;
`FIG. 18 is a block diagram of an addendum to the menu
`and parameter storage structure of FIG. 2 for the second
`embodiment of FIG. 1'7;
`FIG. 19 as a flowchart addendum to image capture routine
`of FIG. 8 for the second embodiment shown in FIG. 17;
`FIG. 20 is a block diagram of a third embodiment of an
`integrated Internet camera according to the invention
`FIG. 21 is a block diagram of a fourth embodiment of an
`integrated Internet camera according to the invention; and
`FIG. 22 is a block diagram of a fifth embodiment of an
`integrated Internet camera according to the invention.
`DESCRIPTION OF TI-IE PREFERRED
`l3MBOI)IMI5N'I‘S
`
`In this case, the E-mail message assembler may assemble
`E-mail messages including the digital
`image files.
`Accordingly, the E-mail transmission device may transmits
`the E-mail message including the digital image files to a
`predetermined E-mail address via the transport control
`device and the transmission initiating device.
`The integrated Internet camera may further include a
`trigger device linked to the camera andfor the rnicrocorttrol-
`ler. In response to triggering of the trigger device, the camera
`initiates an image capture and transfer of the digital image
`files to the destination shell account via the file transfer
`device, the transport control device, and the transmission
`initiating device.
`Optionally, the integrated Internet camera further includes
`a video input for receiving a standard video signal, and the
`image capturing circuit captures the digital images from the
`video input
`instead of from the image pickup.
`In this
`manner, a camcorder or other video source (tuner, CCTV
`network) may he used to supply the digital images to be
`transmitted over the Internet or otherwise.
`
`In another modification, the integrated Internet camera
`further includes a video output for sending a standard video
`signal, wherein the digital image files are transmitted as
`video images to the video output. In this manner, any images
`transmitted over the Internet or otherwise may also be
`supplied to, e.g., a local monitor, recording device. or CCTV
`network.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The present invention is further explained in the descrip-
`tion which follows with reference to the drawings,
`illustrating, by way of non-limiting examples, various
`embodiments of the invention, with like reference numerals
`representing similar parts throughout the several views, and
`wherein:
`
`FIG. I is a block diagram of a prior art system capable of
`transmitting digital images to the Internet;
`FIG. 2 is a perspective view of an integrated Internet
`camera according to a first embodiment of the invention;
`FIG. 3 is a block diagram of the integrated Internet
`camera shown in FIG. 2;
`FIGS. 4A and 4B are schematic diagrams ofthe integrated
`Internet camera of FIG. 2 connected to the Internet;
`FIG. 5 is a block diagram showing a menu and parameter
`storage structure of FIG. 2;
`FIG. 6 is a flow chart of an initialization routine of the
`
`integrated Internet camera shown in FIG. 2;
`FIG. 7 is a flow chart of a main routine of the integrated
`Internet camera shown in FIG. 2;
`FIG. 8 is a flow chart of an image capture routine of the
`integrated Internet camera shown in FIG. 2;
`FIG. 9 is a flow chart of an image transmit routine of the
`integrated Internet camera shown in FIG. 2;
`FIG. 10 is a flow chart of a disconnect routine of the
`
`integrated Internet camera shown in FIG. 2;
`FIG. 11 is a How chart of an file transfer connect routine
`of the integrated Internet camera shown in FIG. 2;
`FIG. 12 is a [low chart of a telephone connect routine of
`the integrated lntemet camera shown in FIG. 2;
`
`IU
`
`1U
`
`3U
`
`40
`
`FIG. 2 shows a first embodiment of the present invention.
`All of the electronic, mechanical and optical components of
`the integrated Internet camera 1 are housed within a camera
`body 201. Accordingly. in the context of this specification,
`“integrated” is equivalent to "seil'-contained”, such that all
`the noted components are supported on or situated within the
`body or casing. As shown in FIG. 2, the camera 1 may be
`connected to the Internet via a network interface device 236
`(comprising, eg, a modem or network card) and a connec-
`tion cable 237 (which may be a telephone wire connected to
`the public network or a network cable connected to a local
`or wide area network). Preferably. the camera body includes
`a threaded camera mount, and is sized and shaped to fit
`industry standard environmental housings for outdoor use.
`A viewfinder 244 allows the operator to view a scen