`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 1 of 337
`
`
`
`
`
`EXHIBIT 1
`EXHIBIT 1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 2 of 337
`eeeSTATAAT
`
`US007647633B2
`
`a2) United States Patent
`US 7,647,633 B2
`(0) Patent No.:
`*Jan. 12, 2010
`(45) Date of Patent:
`Ederyetal.
`
`MALICIOUS MOBILE CODE RUNTIME
`MONITORING SYSTEM AND METHODS
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`(54)
`
`(75)
`
`Inventors: Yigal Mordechai Edery, Pardesia (IL);
`Nimrod Itzhak Vered, Goosh Tai-Mond
`(IL); David R. Kroll, San Jose, CA
`(US); Shlomo Touboul, Kefar-Haim (IL)
`
`(73)
`
`Assignee: Finjan Software, Ltd., Netanya (IL)
`
`(*)
`
`Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 917 days.
`
`This patent is subject to a terminal dis-
`claimer.
`
`(21)
`
`Appl. No.: 11/159,455
`
`(22)
`
`Filed:
`
`Jun. 22, 2005
`
`(65)
`
`(63)
`
`Prior Publication Data
`
`US 2006/0026677 Al
`
`Feb. 2, 2006
`
`Related U.S. Application Data
`
`Continuation of application No. 09/861,229, filed on
`May17, 2001, now Pat. No. 7,058,822, and a continu-
`ation-in-part of application No. 09/551,302, filed on
`Apr. 18, 2000, now Pat. No. 6,480,962, and a continu-
`ation-in-part of application No. 09/539,667, filed on
`Mar. 30, 2000, now Pat. No. 6,804,780.
`
`(60)
`
`Provisional application No. 60/205,591, filed on May
`17, 2000.
`
`(51)
`
`Int. Cl.
`
`(2006.01)
`G06F 21/24
`(2006.01)
`G06F 1130
`(2006.01)
`GO6F 15/16
`US. C1.
`ciccccccccccececccccecsecesesssscecesseeeseesssees 726/22
`Field of Classification Search ....................... None
`
`(52)
`(58)
`
`5,077,677 A
`
`12/1991 Murphy et al. 0... 706/62
`
`(Continued)
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`
`1091276
`1132796
`
`4/2001
`9/2001
`
`OTHER PUBLICATIONS
`
`Zhong,et al., “Security in the Large: is Java’s Sandbox Scalable?,”
`Seventh IEEE Symposium on Reliable Distributed Systems, pp. 1-6,
`Oct., 1998.
`
`(Continued)
`
`Primary Examiner—Christopher A Revak
`(74) Attorney, Agent, or Firm—King & Spalding LLP
`
`(57)
`
`ABSTRACT
`
`Protection systems and methodsprovide for protecting one or
`more personal computers (“PCs”) and/or other intermittently
`or persistently network accessible devices or processes from
`undesirable or otherwise malicious operations of Java™
`applets, ActiveX™ controls, JavaScript™ scripts, Visual
`Basic scripts, add-ins, downloaded/uploaded programs or
`other “Downloadables” or “mobile code”in wholeor part. A
`protection engine embodimentprovides, within a server,fire-
`wall or other suitable “re-communicator,” for monitoring
`information received by the communicator, determining
`whether received information does or is likely to include
`executable code, and if so, causes mobile protection code
`(MPC)to be transferred to and rendered operable within a
`destination device of the received information, more suitably
`by forming a protection agent including the MPC,protection
`policies and a detected-Downloadable. An MPC embodiment
`further provides, within a Downloadable-destination,for ini-
`tiating the Downloadable, enabling malicious Downloadable
`operation attempts to be received by the MPC, and causing
`(predetermined) corresponding operations to be executed in
`response to the attempts, more suitably in conjunction with
`protection policies.
`
`See application file for complete search history.
`
`41 Claims, 10 Drawing Sheets
`
`
`‘Security’
`! Authentication
`=
`Policies
`
`
`Dataction Engine
`
`422
`421
`Inspection Param
`
`LS
`
`Not Executable
`(NXEQ}
`
`: !
`
`:
`
`
`
`
`Protected Package Engine
`
`
`
`
`User,policy,interfacing
`or other information
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 3 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 3 of 337
`
`US 7,647,633 B2
`
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`International Search Report for Application No. PCT/IB97/01626, 3
`pp., May 14, 1998 (mailing date).
`International Search Report for Application No. PCT/IL05/00915, 4
`pp., March 3, 2006.
`Written Opinion for Application NO. PCT/IL05/00915, 5 pp., Mar.3,
`2006 (mailing date).
`International Search Report for Application No. PCT/IB01/01138,
`44 pp., Sep. 20, 2002 (mailing date).
`International Preliminary Examination Report for Application No.
`PCT/IBO1/01138, 2 pp., dated Dec. 19, 2002.
`Gerzic, Amer, “Write Your Own Regular Expression Parser,’ Nov.
`17, 2003, 18 pp.,.
`Power, James, “Lexical Analysis,” 4 pp., May 14, 2006, Retrieved.
`from the Internet:.
`Sitaker, Kragen “Rapid Genetic Evolution of Regular Expression”
`[online], The MialArchive, Apr. 24, 2004 (retrieved on Dec. 7, 2004),
`5 pp...
`“Lexical Analysis: DFA Minimization & Wrap Up”[online], Fall,
`2004 [retrieved on Mar. 2, 2005], 8 pp.,.
`“Minimization of DFA”[online], [retrieved on Dec. 7, 2004], 7 pp.,
`Retrieved from the Internet:
`
`“Algorithm: NFS -> DFA”[online], Copyright 1999-2001 [retrieved.
`on Dec. 7, 2004], 4 pp.,.
`“CS 3813: Introduction to Formal Languages and Automata- State
`Minimization and Other Algorithmsfor Finite Automata,” [retrieved.
`on May 11, 2003], 38 pp.
`Watson, Bruce W., “Constructing Minimal Acyclic Deterministic
`Finite Automata,” [retrieved on Mar. 20, 2005], 38 pp.
`Chang, Chia-Hsiang, “From Regular Expression to DFA’s Using
`Compressed NFA’s,” Oct., 1992, 243 pp.
`“Products,” Articles published on the Internet, “Revilutionary Secu-
`rity for a New Computing Paradigm”regarding SurfinGate™, 7 pp.
`no date provided.
`“Release Notes for the Microsoft, ActiveX DevelopmentKit,” Aug.
`13, 1996, activex.adsp.or.jp/inetsdk/readme.txt, pp. 1-10.
`Doyle et al., “Microsoft Press Computer Dictionary,” Microsoft
`Press, 2d Edition, pp. 137-138, 1993.
`Finjan Software Ltd., “Powerful PC Security for the New World of
`Java™ and Downloadables, SurfinShield™” Article published on
`the Internet by Finjan Software Ltd., 2 pp. 1996.
`Finjan Sofrtware Ltd., “Finjan Announces as Personal Java™
`Firewall for Web Browsers- The SurfinShield™1.6 (formerly known
`as SurfinBoard),” Press Release of Finjan Releses SurfinShield 1.6,
`pp., Oct. 21, 1996.
`Finjan Software Ltd., “Finjan Announces Major Power Boost and.
`New features for SurfinShield™ 2.0,” Las Vegas Convention Center/
`Pavillion 5 P5551, 3 pp., Nov. 18, 1996.
`Finjan Software Ltd., “Finjan Software Releases SurfinBoard, Indus-
`try’s Fist JAVA Security Product for the World Wide Web,”Article
`published on the Internet by Finjan Software Ltd., Ip., Jul. 29, 1996.
`Finjan Software Ltd., “Java Security: Issues & Solutions,” Article
`published on the Internet by Finjan Software Ltd., 8 pp. 1996.
`Finjan Software Ltd., Company Profile, “Finjan - Safe Surfing, the
`Java Security Solutions Provider,” Article published on the Internet
`by Finjan Software Ltd., 3 pp., Oct. 31, 1996.
`“IBM AntiVirus User’s Guide, Version 2.4,”, International Business
`Machines Corporation, pp. 6-7, Nov. 15, 1995.
`Khare, R., “Microsoft Authenticode Analyzed” [online], Jul. 22,
`1996 [retrieved on Jun. 25, 2003], 2 pp.
`LaDue, M., Online Business Consultant: Java Security: Whose Busi-
`nessis It?, Article published on the Internet, Home PagePress,Inc.,
`4 pp., 1996.
`Leach, Norvin, et al., “IE 3.0 Applets Will Earn Certification,” PC
`Week, vol. 13, No. 29, 2 pp., Jul. 22, 1996.
`Moritz, R., “Why We Shouldn’t Fear Java,” Java Report, pp. 51-56,
`Feb., 1997.
`Microsoft, “Microsoft ActiveX Software Development Kit”[online],
`Aug. 12, 1996 [retrieved on Jun. 25, 2003], pp. 1-6.
`Microsoft® Authenticode Technology, “Ensuring Accountability
`and Authenticity for Software Components on the Internet,”
`
`
`
`
`
`5,359,659 A
`10/1994 Rosenthal ......... 726/24
`
`5,361,359 A
`.
`we 726/23
`11/1994 Tajalli et al.
`5,414,833 A
`5/1995 Hersheyetal.
`ws 726/22
`5,485,409 A
`1/1996 Guptaetal.
`.
`we 726/25
`5,485,575 A
`1/1996 Chess etal.
`..
`.. 714/38
`5,572,643 A
`11/1996 Judson .......
`. 709/218
`5,579,509 A
`11/1996 Furtneyetal.
`.. 703/27
`5,606,668 A *
`2/1997 Shwed .......
`.. 726/13
`5,623,600 A *
`4/1997 Jietal.
`..
`w. 726/24
`5,638,446 A
`6/1997 Rubin ........
`.. 705/51
`
`5,675,711 A
`..
`10/1997 Kephart et al.
`.» 706/12
`5,692,047 A
`11/1997 McManis .......
`. 713/167
`5,692,124 A
`11/1997 Holden etal.
`wee 7226/2
`
`5,720,033 A
`2/1998 Deo we
`wee 726/2
`5,724,425 A
`w+ 705/52
`3/1998 Changetal. .
`
`5,740,248 A
`. 713/156
`4/1998 Fieres et al.
`.
`
`5,740,441 A
`....
`. 717/134
`4/1998 Yellin et al.
`5,761,421 A
`6/1998 van Hoffet al.
`709/223
`5,765,205 A
`.....
`6/1998 Breslau etal.
`. 711/203
`
`5,784,459 A
`7/1998 Devarakondaet al.
`. 713/165
`5,796,952 A
`8/1998 Davis etal.
`.....
`. 709/224
`
`5,805,829 A
`9/1998 Cohenetal.
`.
`. 709/202
`5,832,208 A
`...
`w. 726/24
`11/1998 Chen etal.
`5,832,274 A
`.
`. TITATL
`11/1998 Cutler etal.
`
`5,850,559 A
`. 713/320
`12/1998 Angelo etal.
`
`5,859,966 A
`1/1999 Hayman etal.
`.
`w. 726/23
`
`5,864,683 A
`..
`. 709/249
`1/1999 Boebert et al.
`5,881,151 A
`3/1999 Yamamoto..
`.. 726/24
`
`5,884,033 A
`...
`3/1999 Duvall etal.
`. 709/206
`5,892,904 A
`4/1999 Atkinson etal.
`we» 726/22
`5,951,698 A
`9/1999 Chen etal.
`...
`.. 714/38
`
`5,956,481 A
`.
`we 726/23
`9/1999 Walsh etal.
`5,963,742 A
`. 717/143
`10/1999 Williams ....
`
`5,974,549 A * 10/1999 Golan ...........
`. 726/23
`11/1999 Apperson et al...
`... 705/54
`5,978,484 A
`5,983,348 A * 11/1999 Ji we . 726/13
`5,987,611 A
`11/1999 Freund....
`wee 726/4
`6,088,801 A
`7/2000 Grecsek ...
`wee 726/1
`
`..
`we» 726/22
`6,088,803 A
`7/2000 Tso etal.
`.....
`.. 726/24
`6,092,194 A *
`7/2000 Touboul
`
`6,154,844 A * 11/2000 Touboul etal.
`.
`w. 726/24
`6,167,520 A * 12/2000 Touboul
`........
`. 726/23
`6,339,829 Bl
`1/2002 Beadle etal.
`...
`ws 726/15
`6,425,058 Bl
`7/2002 Arimilli et al.
`..
`. 711/134
`8/2002 Arimilli et al.
`..
`. 711/128
`6,434,668 Bl
`
`8/2002 Arimilli et al.
`..
`. 711/128
`6,434,669 Bl
`6,480,962 BL* 11/2002 Touboul
`........
`.. 726/22
`.
`we 726/23
`6,487,666 Bl
`11/2002 Shanklin et al.
`
`.......... 711/114
`6,519,679 B2
`2/2003 Devireddy et al.
`6,598,033 B2
`7/2003 Rossetal. wc 706/46
`
`6,732,179 BL*
`5/2004 Brown etal.
`.
`. 709/229
`6,804,780 BL* 10/2004 Touboul oe 713/181
`6,917,953 B2
`7/2005 Simonet al. 0... 707/204
`ws 726/22
`7,058,822 B2*
`6/2006 Edery etal.
`.....
`
`........... 713/188
`7,210,041 Bl
`4/2007 Gryaznov etal.
`7,343,604 B2
`3/2008 Grabarnik et al.
`........... 719/313
`.. 726/22
`7,418,731 B2
`8/2008 Touboul
`
`4/2004 Sain cee eee eee 726/13
`2004/0073811 Al
`2004/0088425 Al
`5/2004 Rubinstein et al.
`.......... 709/230
`2005/0172338 Al
`8/2005 Sandu etal.
`.......
`we» 726/22
`
`............ 707/3
`2006/0031207 Al
`2/2006 Bjarnestam et al.
`
`
`
`
`
`
`OTHER PUBLICATIONS
`
`Rubin,et al., “Mobile Code Security,” JEEEInternet, pp. 30-34, Dec.,
`1998.
`Schmid,et al. “Protecting Data From Malicious Software,” Proceed-
`ing ofthe 18 Annual Computer Security Applications Conference,
`pp. 1-10, 2002.
`Corradi, et al., “A Flexible Access Control Service for Java Mobile
`Code,” IEEE, pp. 356-365, 2000.
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 4 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 4 of 337
`
`US 7,647,633 B2
`Page 3
`
`Microsoft Corporation, Oct., 1996, including Abstract, Contents,
`Introduction, and pp. 1-10.
`Microsoft Corporation, Web Page Article “Frequently Asked Ques-
`tions About Authenticode,” last updated Feb. 17, 1997, printed Dec.
`23, 1998.
`Okamoto, E., et al., “ID-Based Authentication System for Computer
`Virus Detection,” IEEE/IEE Electronic Library online, Electronics
`Letters, vol. 26, Issue 15, ISSN 0013-5194, Jul. 19, 1990, Abstract
`and pp. 1169-1170.
`
`Omura, J. K., “Novel Applications of Cryptography in Digital Com-
`munications,” JEEE Communications Magazine, pp. 21-29, May,
`1990.
`Schmitt, D.A., “.EXEfiles, OS-2 style?’ PC Tech Journal , vol. 6, No.
`11, p. 76(13), Nov., 1988.
`Zhang, X. N., “Secure Code Distribution,” TEEE/TEE Electronic
`Library online, Computer, vol. 30, Issue 6, pp. 76-79, Jun., 1997.
`D. Grune, et al., “Parsing Techniques: A Practical Guide,” John
`Wiley & Sons, Inc., New York, New York, USA,pp. 1-326, 2000.
`
`* cited by examiner
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 5 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 5 of 337
`
`U.S. Patent
`
`Jan. 12, 2010
`
`Sheet 1 of 10
`
`US 7,647,633 B2
`
`100
`
`Redundancy Support
`
`{07
`
`
`
`102
` ResourceServer-1
`Subsystem-1
`(Sandbox Protected)
`Resource-1
`
` 105
`
`External
`Network
`Subsystem-N
`
`
`(Unprotected)
`(Internet)
`
`
`ResourceServer-N
`131
`
`
`132
`
`
`Subsystem-M
`
`(Protected
`
`
`
`
`
`121
`
`103
`
`FIG. la
`
`104a
`
`104b
`
`
`
`
`User
`
`
`Device-n
`
`
`
`
`User
`User
`Device-n
`Device-n
`
`
`
`
`
`FIG. 1b
`
`FIG. ic
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 6 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 6 of 337
`
`U.S. Patent
`
`Jan. 12, 2010
`
`Sheet 2 of 10
`
`US 7,647,633 B2
`
`Jopeaywmnipsy93810}
`
`
`waysk¢Zuyeiod¢
`
`AIOWDAyBUDIOM
`
`
`(s)ootaagyndyng
`¢OW|sms
`
`(s)eotaaqynduy
`suoljeotunWiWw07
`oeCOC
`
`C67
`
`607
`
`807
`
`L0c
`
`
`
`d0RJIOUT
`
`102
`
`907
`
`$07
`
`
`
`a]qepesyJoyndwio)
`
`
`
`WMIPsf[238103
`
`
`
`a1qQepesyJojnduros
`
`07
`
`£0¢
`
`NS
`
`007
`
`
`
`
`
`
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 7 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 7 of 337
`
`U.S. Patent
`
`Jan. 12, 2010
`
`Sheet 3 of 10
`
`US 7,647,633 B2
`
`Ppoaloooy
`
`UOTJBULIOJUT
`
`/ayqeynsex7-uoN)
`
`
`
`(ojuyajquincexq
`
`JeMeli4
`
`Oct
`COEToe
`
`UOID9}Ol4
`
`
`
`(4d)sulbu5
`
`tOW
`
`giqe}noexg
`
`JONIce
`
`00¢
`
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 8 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 8 of 337
`
`U.S. Patent
`
`Jan. 12, 2010
`
`Sheet 4 of 10
`
`US 7,647,633 B2
`
`LOY sozAjeuy|||-apeoy=uoneonuauynyit/Aa110d47©__
`
`
`Buu)
`
`oulbug
`
`JOJSUBI]
`
`auibuy
`
`Lopep
`
`weJeguojoedsuy
`
`aulBugvonsa}9g
`
`31qejNDaX®JON
`Fox|104|oanWN
`\EVEZHELEgre
`
`O3XN
`uOneUUOjU|
`
`Joyo,
`
`
`
`SuULdeJIOJUI‘ADITOd
`
`
`
`
`
`
`
`uOHeULTOFUTI9M}010eujbuyabeyxoegpayoajolg
`
`bpOW
`
`‘“Jas- 03x
`
`
`
` L8PcSLL|7|sapiog2!uoneonuayjny|Aunoeg
`
`
`
`FOeSOSOSOOSOSeeHeOeCEETEESSwweweewmwweeeeeeeewweeneroos
`
`eeeeeeJ
`
`807
`
`ow0O0¥
`
`(OAXN)
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 9 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 9 of 337
`
`U.S. Patent
`
`Jan. 12, 2010
`
`Sheet 5 of 10
`
`US 7,647,633 B2
`
`
`
`SIaJBWEIeYd|}Jajqeynoaxy
`
`
`
`suajeWesegBpodaiqeinoaxy409
`
`SiaaWeeYWaed
`
`
`
`siayaueIegJasf)
`
`
`
`SUBJOWEIEYjeIBUaD
`
`
`
`SJQJWEILYSOEUATU
`
`SOP
`
`89°DIA
`
`SINJOWLegWA}ShSc09
`
`JayurqJoss@ooidLe.yoajap-}sod
`
`auibugGupyurqLatin][du[aa
`
`
`$‘OL
`
`daw|'oax|yensuy|senruy
`—_-—
`5104|
`
`“oy8‘EV‘p
`Sa!_Meuig
`yayap-ad)
`(iossaaoid
`
`(vossaidu09)
`
`q9°
`JIA
`
`LOS
`
`eq
`
`Jayde
`
`LSS
`
`sayeyuy
`
`adh4aiid
`
`40}99}28Q
`
`{—~———LjonUuoD|
`“FN
`
`Lev
`
`
`
`JoyesauegeulBug
`
`quaBbyo1Jajsues)Of
`
`Buryuryo1
`
`auiBug
`
`
`
`
`
`
`
`
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 10 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 10 of 337
`
`U.S. Patent
`
`Jan. 12, 2010
`
`Sheet 6 of 10
`
`US 7,647,633 B2
`
`700
`Ny
`
`701
`
`702
`
`340
`
`Protection
`
`a ,
`
`
`
`
`
`
`
`Memory Space-N
`
`MC Initiator
`(VR)
`
`704
`
`703
`
`FIG. 7a
`
`341
`
`\ty
`
`
`
`
`
`
`
`
`807
`
`802
`
`804
`
`
`803
`
`04
`
`g05
`206
`
`
`
`
`Policy Enforcer
`MPC De-Instailer
`
`FIG. 8
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 11 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 11 of 337
`
`U.S. Patent
`
`Jan. 12, 2010
`
`Sheet 7 of 10
`
`US 7,647,633 B2
`
`Monitor re-communicator (e.g. server)
`operation
`
` 901
`
` 903
`
`
`
`Receive information having a protected
`information destination
`(a "potential-Downloadablie")
`
`
`
`
`
`
`Yes
`
`Undetermined
`
`Determine whetherthe potential-
`Downloadable includes executable code
`
`915
`
`No
`
`Includes
`Code ?
`
`Yes
`
`o17
`Cause potentia!l-Downloadable
`
`
`
`ta be delivered to the
` 919
`
`information-destination
`
`
`
`Form a protection agent corresp to mobile
`protection code, potential-Downloadable
`(now a detected-Downloadable) + any
`protection policies
`
`
`
`
`
`Causethe protection agent to be delivered
`to the information-Destination
`
`921
`
`FIG. 9
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 12 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 12 of 337
`
`U.S. Patent
`
`Jan. 12, 2010
`
`Sheet 8 of 10
`
`US 7,647,633 B2
`
`LLOL
`
`ELOL
`
`SOL
`
`G0‘Dl
`
`VolSi
`
`
`
`
`
`‘@poOdUuOHOsjONdaIqoWwWau}ajdno5
`
`
`
`-P9Ala99JpueSa!dijoduoNse}0u1d
`
`
`
`
`
`(palu}fypue‘puodassaloiiodysuyOd
`
`
`
`
`
`
`
`94}0}Bulpioo0eapoouo}Oa}0Jdayiqow
`
`
`
`
`
`WO}pueSisjoweJedUONde}O1dSASIIOY
`
`616
`
`L001
`
`siajowejed
`
`WO}pueSJajoWeJedUONOa}ONdSASLY
`
`£001
`
`
`
`
`
`94}0}Buipsoo0esajoijoduoNda}01d
`
`
`
`SusaedBpodJoUOWeWOJU!ALeUIgapnjoul
`
`
`
`
`
`S}UB}U0Sgj)94]JAYJEYMBUILUAa}EQ
`
`
`
`
`
`-EnuUa}OdayyJaujayMaulWa}aq
`
`
`
`a1Ge;nNdaxeuesajedIpulajqepeojumMOg
`
`
`
`adA}ayy
`
`£16
`
`sigjaueJed
`
`
`
`SOO
`
`
`
`
`
`Atay!|8s0Wajqepeojumog-jeljuajod
`
`
`
`Su}JEU}SJESIPU!IEOLpueLOOLSdajs4]
`
`
`
`
`
`‘B'a)yuaBeuod9}01d&wo}0}UOHeWOYU!
`
`
`
`@aiqepeojumog-jenuajodauyvapisuoa
`
`
`
`
`
`‘apodajqeynoaxesapnjoul
`
`3IGepeojumMog-pajyajep
`
`
`
`
`
`
`
`
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 13 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 13 of 337
`
`U.S. Patent
`
`Jan. 12, 2010
`
`Sheet 9 of 10
`
`US 7,647,633 B2
`
`Install mobile protection code elements
`and policies within a destination device
`
`Load the downloadble without actually
`initiating it
`
`1101
`
`1102
`
`
`
`Form an accessinterceptorfor intercepting
`downloadable destination device access
`attempts within the destination device
`
`1103
`
`initiate the Downloadable within the
`destination device
`
`1105
`
`
`Malicious
`
`access No
`
`
`Yes
`
`;
`ar
`-
`Determine policies in accordancewith the
`access attempt
`
`Execute the policies (including causing an
`allowable response expected by the
`Donwloadable to be returned to the
`
`
`
`Downloadable)
`
`1109
`
`1114
`
`End
`
`FIG. 11
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 14 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 14 of 337
`
`U.S. Patent
`
`Jan. 12, 2010
`
`Sheet 10 of 10
`
`US 7,647,633 B2
`
`1103
`
`L
`
`
`
`
`Install the Downloadable
`
`Modify the Downloadable APi to divert
`malicious access requests to the mobile
`protection code
`
`1201
`
`1203
`
`FIG. 12a
`
`1109
`
`
`
`Receive a Downloadable access request
`via the modified API
`
`1241
`
`
`
`
`Query stored policies to determine a policy
`corresponding to the Downloadable
`access request
`
`
`
`
`1213
`
`FIG. 12b
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 15 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 15 of 337
`
`US 7,647,633 B2
`
`1
`MALICIOUS MOBILE CODE RUNTIME
`MONITORING SYSTEM AND METHODS
`
`PRIORITY REFERENCE TO RELATED
`APPLICATIONS
`
`This application is a continuation of and incorporates by
`reference patent application Ser. No. 09/861,229, filed May
`17, 2001 now U.S. Pat. No. 7,058,822, which claims benefit
`of reference provisional application Ser. No. 60/205,591
`entitled “Computer Network Malicious Code Runtime Moni-
`toring,”filed on May 17, 2000 by inventors Nimrod Itzhak
`Vered, et al. This application also incorporates by reference
`the provisional application Ser. No. 60/205,591. This appli-
`cation is also a Continuation-In-Part of and hereby incorpo-
`rates by reference patent application Ser. No. 09/539,667,
`now USS. Pat. No. 6,804,780, entitled “System and Method
`for Protecting a Computer and a Network from Hostile
`Downloadables”filed on Mar. 30, 2000 by inventor Shlomo
`Touboul. This application is also a Continuation-In-Part of
`and hereby incorporates by reference patent application Ser.
`No. 09/551,302, now U.S. Pat. No. 6,480,962, entitled “Sys-
`tem and Method for Protecting a Client During Runtime
`From Hostile Downloadables”, filed on Apr. 18, 2000 by
`inventor Shlomo Touboul.
`
`BACKGROUND OF THE INVENTION
`
`1. Field of the Invention
`This invention relates generally to computer networks, and
`moreparticularly provides a system and methodsfor protect-
`ing network-connectable devices from undesirable down-
`loadable operation.
`2. Description of the Background Art
`Advancesin networking technology continue to impact an
`increasing number and diversity of users. The Internet, for
`example, already provides to expert, intermediate and even
`novice users the informational, product and service resources
`of over 100,000 interconnected networks owned by govern-
`ments, universities, nonprofit groups, companies, etc. Unfor-
`tunately, particularly the Internet and other public networks
`have also become a major source of potentially system-fatal
`or otherwise damaging computer code commonlyreferred to
`as “viruses.”
`
`Efforts to forestall viruses from attacking networked com-
`puters have thus far met with only limited success at best.
`Typically, a virus protection program designedto identify and
`removeor protect against the initiating of known viruses is
`installed on a network firewall or individually networked
`computer. The program is then inevitably surmounted by
`some new virus that often causes damage to one or more
`computers. The damageis then assessed and,if isolated, the
`new virus is analyzed. A corresponding newvirus protection
`program (or update thereof) is then developed andinstalled to
`combatthe newvirus, and the new program operates success-
`fully until yet another new virus appears—and so on. Of
`course, damagehasalready typically been incurred.
`To make matters worse, certain classes of viruses are not
`well recognized or understood,let alone protected against. It
`is observedbythis inventor, for example, that Downloadable
`information comprising program code can include distribut-
`able components (e.g. Java™ applets and JavaScript scripts,
`ActiveX™controls, Visual Basic, add-ins and/or others). It
`can also include, for example, application programs, Trojan
`horses, multiple compressed programs such as zip or meta
`files, among others. U.S. Pat. No. 5,983,348 to Shuang, how-
`ever, teaches a protection system for protecting against only
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`distributable components including “Java applets or ActiveX
`controls”, and further does so using resource intensive and
`high bandwidth static Downloadable content and operational
`analysis, and modification of the Downloadable component;
`Shuang further fails to detect or protect against additional
`program code included within a tested Downloadable. U.S.
`Pat. No. 5,974,549 to Golan teaches a protection system that
`further focuses only on protecting against ActiveX controls
`and not other distributable components,
`let alone other
`Downloadable types. U.S. Pat. No. 6,167,520 to Touboul
`enables more accurate protection than Shuang or Golan, but
`lacks the greater flexibility and efficiency taught herein, as do
`Shuang and Golan.
`Accordingly, there remains a need for efficient, accurate
`and flexible protection of computers and other network con-
`nectable devices from malicious Downloadables.
`
`SUMMARY OF THE INVENTION
`
`The present invention provides protection systems and
`methods capable of protecting a personal computer (“PC”) or
`other persistently or even intermittently network accessible
`devices or processes from harmful, undesirable, suspicious or
`other “malicious” operations that might otherwise be effec-
`tuated by remotely operable code. While enabling the capa-
`bilities ofprior systems, the present invention is not nearly so
`limited, resource intensive orinflexible, and yet enables more
`reliable protection. For example, remotely operable code that
`is protectable against can include downloadable application
`programs, Trojan horses and program code groupings, as well
`as
`software
`“components”,
`such as
`Java™ applets,
`ActiveX™controls, JavaScript™/Visual Basic scripts, add-
`ins, etc., among others. Protection can also be provided in a
`distributed interactively, automatically or mixed configurable
`manner using protected client, server or other parameters,
`redirection, local/remote logging,etc., and other server/client
`based protection measures can also be separately and/or
`interoperably utilized, among other examples.
`In one aspect, embodiments of the invention provide for
`determining, within one or more network “servers”(e.g. fire-
`walls, resources, gateways, email relays or other devices/
`processes that are capable of receiving-and-transferring a
`Downloadable) whether
`received information includes
`executable code (and is a “Downloadable”). Embodiments
`also provide for delivering static, configurable and/or exten-
`sible remotely operable protection policies to a Download-
`able-destination, more typically as a sandboxed package
`including the mobile protection code, downloadable policies
`and one or more received Downloadables. Further client-
`
`based or remote protection code/policies can also be utilized
`in a distributed manner. Embodiments also provide for caus-
`ing the mobile protection codeto be executed within a Down-
`loadable-destination in a mannerthat enables various Down-
`loadable operations to be detected, intercepted or further
`responded to via protection operations. Additional server/
`information-destination device security or other protection is
`also enabled, amongstill further aspects.
`A protection engine according to an embodimentof the
`invention is operable within one or more network servers,
`firewalls or other network connectable information re-com-
`municating devices (as are referred to herein summarily one
`or more “servers” or “re-communicators”’). The protection
`engine includes an information monitor for monitoring infor-
`mation receivedby the server, and a code detection engine for
`determining whether the received information includes
`executable code. The protection engine also includes a pack-
`aging engine for causing a sandboxed package, typically
`
`
`
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 16 of 337
`Case 3:17-cv-05659-WHA Document 176-2 Filed 08/06/18 Page 16 of 337
`
`US 7,647,633 B2
`
`3
`including mobile protection code and downloadable protec-
`tion policies to be sent to a Downloadable-destination in
`conjunction with the received information, if the received
`information is determined to be a Downloadable.
`A sandboxed package according to an embodimentof the
`invention is receivable by and operable with a remote Down-
`loadable-destination. The
`sandboxed package includes
`mobile protection code (“MPC”) for causing one or more
`predetermined malicious operations or operation combina-
`tions of a Downloadable to be monitored or otherwise inter-
`
`cepted. The sandboxed packagealso includesprotection poli-
`cies
`(operable alone or
`in conjunction with further
`Downloadable-destination stored or received policies/MPCs)
`for causing one or more predetermined operationsto be per-
`formed if one or more undesirable operations of the Down-
`loadable is/are intercepted. The sandboxed package can also
`include a corresponding Downloadable and can provide for
`initiating the Downloadable in a protective “sandbox”. The
`MPC/policies can further
`include a communicator
`for
`enabling further MPC/policy information or “modules”to be
`utilized and/or for event logging or other purposes.
`A sandboxprotection system according to an embodiment
`ofthe invention comprises an installer for enabling a received
`MPCto be executed within a Downloadable-destination (de-
`vice/process) and further causing a Downloadable applica-
`tion program, distributable component or other received
`downloadable code to be received and installed within the
`Downloadable-destination. The protection system also
`includes a diverter for monitoring one or more operation
`attempts of the Downloadable, an operation analyzer for
`determining one or more responses to the attempts, and a
`security enforcer for effectuating responses to the monitored
`operations. The protection system can further include one or
`more security policies according to which one or more pro-
`tection system elements are operable automatically (e.g. pro-
`grammatically) or in conjunction with user intervention(e.g.
`as enabled by the security enforcer). The security policies can
`also be configurable/extensible in accordance with further
`downloadable and/or Downloadable-destination informa-
`tion.
`
`A method according to an embodiment of the invention
`includes receiving downloadable information, determining
`whether the downloadable information includes executable
`
`code, and causing a mobile protection code and security
`policies to be communicated to a network client in conjunc-
`tion with security policies and the downloadable information
`if the downloadable information is determined to include
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`executable code. The determining can further provide mul-
`tiple tests for detecting, alone or together, whether the down-
`loadable information includes executable code.
`
`50
`
`A further method according to an embodiment of the
`invention includes
`forming a sandboxed package that
`includes mobile protection code (“MPC”), protection poli-
`cies, anda received, detected-Downloadable, and causing the
`sandboxed package to be communicatedto and installed by a
`receiving device or process (“user device’’) for responding to
`one or more malicious operation attempts by the detected-
`Downloadable from within the user device. The MPC/poli-
`cies can further include a base “module”and a “communica-
`
`tor” for enabling further up/downloading of one or more
`further “modules”or other information(e.g. events, user/user
`device information, etc.).
`Another method according to an embodimentofthe inven-
`tion includesinstalling, within a user device, received mobile
`protection code (“MPC”) and protection policies in conjunc-
`tion with the user device receiving a downloadable applica-
`tion program, component or other Downloadable(s). The
`
`55
`
`60
`
`65
`
`4
`method also includes determining, by the MPC, a resource
`access attempt by the Downloadable, and initiating, by the
`MPC,one or more predetermined operations corresponding
`to the attempt. (Predetermined operations can, for example,
`comprise initiating user, administrator, client, networkor pro-
`tection system determinable operations, including but not
`limited to modifying the Downloadable operation,extricating
`the Downloadable, notifying a user/another, maintaining a
`local/remote log, causing one or more MPCs/policies to be
`downloaded, etc.)
`systems and methods according to
`Advantageously,
`embodiments of the invention enable potentially damaging,
`undesirable or otherwise malicious operations by even
`unknown mobile code to be detected, prevented, modified
`and/or otherwise protected against without modifying the
`mobile code. Such protection is further enabled in a manner
`that is capable of minimizing server and client resource
`requirements, does not require pre-installation of security
`code within a Downloadable-destination, and provides for
`client specific or generic and readily updateable security mea-
`sures to be flexibly and efficiently implemented. Embodi-
`ments further provide for thwarting efforts to bypass security
`measures (e.g. by “hiding” undesirable operation causing
`information within apparently inert or otherwise “friendly”
`downloadable information) and/or dividing or combining
`security measures for even greater flexibility and/or effi-
`ciency.
`Embodiments also provide for determining protection
`policies that can be downloaded and/or ascertained from
`other security information(e.g. browsersettings, administra-
`tive policies, user input, uploaded information,etc.). Differ-
`ent actions in responseto different Downloadable operations,
`clients, users and/or other criteria are also enabled, and
`embodiments provide for implementing other security mea-
`sures, such as verifying a downloadable source, certification,
`authentication, etc. Appropriate action can also be accom-
`plished automatically (e.g. programmatically) and/or in con-
`junction with alerting one or more users/administrators, uti-
`lizing user input, etc. Embodiments further enable desirable
`Downloadable operations to remain substantially unaffected,
`amongother aspects.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG.1a is a block diagramillustrating a network system in
`accordance with an embodimentof the present invention;
`FIG. 16 is a block diagram illustrating a network sub-
`system example in accordance with an embodiment of the
`invention;
`FIG. 1c is a block diagram illustrating a further network
`subsystem example in accordance with an embodimentofthe
`invention;
`FIG.2 is a block diagram illustrating a computer system in
`accordance with an embodimentof the invention;
`FIG.3 is a flow diagram broadly illustrating a protection
`system host according to an embodimentof the invention;
`FIG.4 is a block diagram illustrating a protection engine
`according to an embodimentofthe invention;
`FIG. 5 is a block diagram illustrating a content inspection
`engine according to an embodimentofthe invention;
`FIG.6a is a block diagram illustrating protection engine
`parameters according to an embodimentof the invention;
`FIG. 66 is a flow diagram illustrating a linking engine use
`in conjunction with ordinary, compressed and distributable
`sandbox package utilization, accordin