UNITED STATES DISTRICT COURT
`FOR THE DISTRICT OF DELAWARE
`
`Civil Action No. 10-389-LPS
`
`CONSOLIDATED
`
`SOFTVIEW LLC,
`
`Plaintiff,
`
`v.
`
`APPLE INC; AT&T MOBILITY LLC;
`DELL INC; HTC CORR; HTC AMERICA,
`INC; HUAWEI TECHNOLOGIES CO.,
`LTD.; FUTUREWEI TECHNOLOGIES,
`INC; KYOCERA CORR; KYOCERA
`WIRELESS CORR; LG ELECTRONICS,
`INC; LG ELECTRONICS USA, INC;
`LG ELECTRONICS MOBILECOMM
`
`USA, INC; MOTOROLA MOBILITY
`INC; SAMSUNG ELECTRONICS CO,
`LTD; SAMSIINO ELECTRONICS
`AMERICA, INC; SAMSUNG
`TELECOMMUNICATIONS AMERICA,
`LLC; and SONY ERICSSON MOBILE
`COMMUNICATIONS (USA) INC,
`
`Defendants.
`
`vvyvvvyvvvvyvvyvvvvvv
`
`\.._/~._/\_/
`
`DECLARATION OF CRAIG JOHNSON IN SUPPORT OF
`PLAINTIFF SOFTVIEW LLC'S OPENING CLAIM CONSTRUCTION BRIEF
`
`OF COUNSEL:
`
`Morgan Chu
`Samuel K. Lu
`Erin MeCI'acken
`Craig Johnson
`IRBLL 8: MANELLA LLP
`
`1800 Avenue of the Stars, Suite 900
`Los Angeles, CA 90067
`(310) 277-1010
`
`270I04l2
`
`Steven L Caponi (#3483)
`BLANK ROME LLC
`
`1201 Market Street, Suite 800
`
`Wilmington, DE 19801
`(301) 425-6400
`eaponi@blankrome.com
`Attorneys for Plaintiff SoftView LLC
`
`Dated: September 21, 2012
`
`EXHIBIT
`Petitioner - Motorola
`
`PX 1023
`
`Motorola PX 1023_1
`
`Motorola PX 1023_1
`
`

`

`I, Craig Johnson, declare as follows:
`
`1.
`
`I am an attorney with the law firm Irell & Manella LLP, counsel for plaintiff
`
`SoftView LLC in the above-captioned matter. I am a member of the State Bar of California and
`
`have been admitted to practice pro hac vice before this Court. I have personal knowledge of the
`
`facts set forth in this Declaration and, if called as a witness, could and would testify competently
`
`to such facts under oath.
`
`2.
`
`3.
`
`4.
`
`Attached hereto as Exhibit 1 is a copy of U.S. Patent No. 7,461,353.
`
`Attached hereto as Exhibit 2 is a copy of U.S. Patent No. 7,831,926.
`
`Attached hereto as Exhibit 3 are excerpts from the prosecution history of U.S.
`
`Patent No. 7,461,353.
`
`5.
`
`Attached hereto as Exhibit 4 are excerpts from the prosecution history of U.S.
`
`Patent No. 7,831,926.
`
`6.
`
`Attached hereto as Exhibit 5 are excerpts from Merriam-Webster's Collegiate
`
`Dictionary, Tenth Edition (Merriam-Webster, Inc. 2001).
`
`7.
`
`Attached hereto as Exhibit 6 are excerpts from the Microsoft Computer
`
`Dictionary, Fifth Edition (Microsoft Press, 2002).
`
`8.
`
`Attached hereto as Exhibit 7 is a copy of United States Patent and Trademark
`
`Office Order Granting Request for Inter Partes Reexamination of U.S. Patent No. 7,461,353,
`
`Application/Control Number: 95/000,634, dated August 8, 2011.
`
`9.
`
`Attached hereto as Exhibit 8 is a copy of Apple's Statement Identifying The
`
`Claims It Will Assert At Trial, filed on May 7, 2012 in Apple Inc. v. Samsung Electronics Co.,
`
`Ltd., No. C-11-01846 (N.D. Cal.).
`
`10. Attached hereto as Exhibit 9 is a copy of Accessibility-iPad-Vision, APPLE.COM ,
`
`http://wwvv.apple.com/accessibility/ipad/vision.html (last visited Sept. 20, 2012).
`
`11. Attached hereto as Exhibit 10 is an excerpt of the August 3, 2012 testimony of
`
`Scott Forstall in Apple Inc. v. Samsung Electronics Co., Ltd. et al. No. C-11-01846 (N.D. Cal.).
`
`2701041
`
`Motorola PX 1023_2
`
`

`

`12. Attached hereto as Exhibit 11 are excerpts from Newton's Telecom Dictionary,
`
`Thirteenth Edition (Telecom Books and FlatIron Pubilshing, 1998).
`
`13. Attached hereto as Exhibit 12 are Figures 4C and 4D from the specifications of
`
`the patents-in-suit, with color highlighting added.
`
`14. Attached hereto as Exhibit 13 is Figure 7A from the specifications of the patents-
`
`in-suit, with color highlighting added.
`
`15. Attached hereto as Exhibit 14 are Figures 1A and 1B from the specification of the
`
`patents-in-suit, with color highlighting added.
`
`I declare under penalty of perjury under the laws of the United States of America that the
`
`foregoing is true and correct.
`
`Executed this 21st day of September 2012 in Los Angeles, California.
`
`2701041
`
`2
`
`Motorola PX 1023_3
`
`(cid:9)
`

`

`
`
`
`Exhibit 1
`
`Exhibit 1
`
`Motorola PX 1023_4
`
`Motorola PX 1023_4
`
`

`

`111111
`
`1111111111111111111111111111111111111111111111111111111111111
`US007461353B2
`
`c12) United States Patent
`Rohrabaugh et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 7,461,353 B2
`*Dec. 2, 2008
`
`(54) SCALABLE DISPLAY OF INTERNET
`CONTENT ON MOBILE DEVICES
`
`(75)
`
`Inventors: Gary B. Rohrabaugh, Bellingham, WA
`(US); Scott A. Sherman, Bellingham,
`WA (US)
`
`(73) Assignee: Gary Rohrabaugh, Bellingham, WA
`(US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 376 days.
`
`This patent is subject to a terminal dis(cid:173)
`claimer.
`
`(21) Appl. No.: 11/045,757
`
`(22) Filed:
`
`Jan.28,2005
`
`(65)
`
`Prior Publication Data
`
`US 2005/0131887 Al
`
`Jun. 16,2005
`
`Related U.S. Application Data
`
`( 60) Division of application No. 09/878,097, filed on Jun. 8,
`2001,nowPat. No. 7,210,099, which is a continuation(cid:173)
`in-part of application No. 09/828,511, filed on Apr. 7,
`2001, now abandoned.
`
`(60) Provisional application No. 60/217,345, filed on Jul.
`11, 2000, provisional application No. 60/211,019,
`filed on Jun. 12, 2000.
`
`(51)
`
`Int. Cl.
`G06F 17100
`(2006.01)
`(52) U.S. Cl. ....................... 715/815; 715/760; 715/234;
`715/239; 715/249
`(58) Field of Classification Search ................. 715/517,
`715/700--864
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,966,135 A
`
`10/1999 Roy et al.
`
`(Continued)
`
`FOREIGN PATENT DOCUMENTS
`
`wo
`
`PCT/USO 1140920
`
`12/2001
`
`(Continued)
`
`OTHER PUBLICATIONS
`
`http://www.w3.org/TR/1999/WD-SVG-199902111-Pub Feb. 11,
`1999 by W3C pp. 1-7 (A complet details can be down load at by the
`provides URL above).*
`
`(Continued)
`
`Primary Examiner-Doug Hutton
`Assistant Examiner--Quae A Tran
`(74) Attorney, Agent, or Firm-Law Office of R. Alan
`Burnett; R. Alan Burnett
`
`(57)
`
`ABSTRACT
`
`Mobile devices enabled to support resolution-independent
`scalable display oflntemet (Web) content to allow Web pages
`to be scaled (zoomed) and panned for better viewing on
`smaller screen sizes. The mobile devices employ software(cid:173)
`based processing of original Web content, including HTML(cid:173)
`based content, XML, cascade style sheets, etc. to generate
`scalable content. The scalable content and/or data derived
`therefrom are then employed to enable the Web content to be
`rapidly rendered, zoomed, and panned. Moreover, the ren(cid:173)
`dered displays provide substantially the same or identical
`layout as the original Web page, enabling users to easily
`navigate to selected content and features on familiar Web
`pages. Display lists may also be employed to provide further
`enhancements in rendering speed. Additionally, hardware(cid:173)
`based programmed logic may be employed to facilitate vari(cid:173)
`ous operations.
`
`319 Claims, 22 Drawing Sheets
`
`Motorola PX 1023_5
`
`

`

`US 7,461,353 B2
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`6,011,905 A
`6,057,854 A
`6,185,625 B1
`6,300,947 B1
`6,421,733 B1
`6,466,203 B2
`6,546,397 B1
`6,615,212 B1
`6,642,925 B2 *
`6,674,445 B1 *
`6,857,102 B1
`6,886,034 B2 *
`7,219,309 B2
`200110047428 A1
`2002/0112237 A1
`2004/0049598 A1
`2005/0144256 A1
`
`112000 Huttenlocher eta!.
`5/2000 Davis, Jr. et a!.
`212001 Tso et al.
`10/2001 Kanevsky
`7/2002 Tso et al.
`10/2002 Van Ee
`4/2003 Rempell
`9/2003 Dutta et al.
`1112003 Roy eta!. ................... 345/427
`112004 Chithambaram eta!. .... 345/619
`2/2005 Bickmore eta!.
`4/2005 Blumberg ................... 709/217
`5/2007 Kaasila eta!.
`1112001 Hunter
`8/2002 Ketts
`3/2004 Tucker eta!.
`6/2005 Blumberg
`
`FOREIGN PATENT DOCUMENTS
`
`wo
`
`PCT/USO 1140920
`
`6/2002
`
`OTHER PUBLICATIONS
`
`Combined Printout of HTML Help Files for Opera 3.60 (HTML
`pages printed to PDF docs and combined), Available on May 12,
`1999.
`Screenshots compilations ofWeb pages using Opera 3 .60, including:
`www.Altavista.com-May 1, 1999 www.cnet.com-May 8, 1999
`www.excite.com-May 8, 1999 www.nytimes.com-Apr. 22, 1999
`www.softsource.com-Apr. 17, 1999 www.utexas.edu-Apr. 27,
`1999 www.uspto.gov-May 5, 1999 www.yahoo.com-May 8,
`1999.
`Benjamin B. Bederson et a!., Pad++: A Zoomable Graphical
`Sketchpad For Exploring Alternate Interface Physics, Sep. 19, 1995,
`http://www.cs.unm.edu/pad++.
`Benjamin B. Bederson et al., A Zooming Web Browser, SPIE 1996,
`http://www. c s. umd.edu/hcil/ j azz/1 earn/papers/ spie-96-webbrowser.
`pdf.
`Specification for Simple Vector Format (SVF) vl.1 Jan. 16, 1995.
`Specification for Simple Vector Format (SVF) v2.0 Dec. 6, 2000,
`http://www.svf.org/spec.html.
`Changes to SVF, (Date unknown).
`Scalable Vector Graphics (SVG) Specification, W3C Working Draft
`Feb. 11, 1999 WD-SVG-19990211, http://www.w3.org/TR/1999/
`WD-SVG-199902111 (HTML format-initial page).
`Scalable Vector Graphics (SVG) Specification, W3C Working Draft
`Apr. 12, 1999 WD-SVG-19990412, http://www.w3.org/TR/1999/
`WD-SVG-19990412/ (HTML format-initial page).
`Scalable Vector Graphics (SVG) 1.0 Specification, W3C Candidate
`Recommendation Nov. 2, 2000.
`
`Introduction to SVG, part ofWD-SVG-19990211, http://www.w3.
`org/TR/1999/ WD-SVG-199902111intro. html#Document.
`Steve Mulder, Sneak Peak at SVG, Mar. 4, 1999, http://www.
`webmonkey.corn/99/ 1 O/index3a.html?tw~eg19991 02.
`Janus Boye, SVG Brings Fast Vector Graphics to Web, Jul. 29, 1999
`http:/ /www.irt.org/articles/js176/.
`Vector Markup Language (VML), World Wide Web Consortium
`Note May 13, 1998, NOTE-VML-19980513, http://www.w3.org/
`TR/1998/NOTE-VML 19980513
`Precision Graphics Markup Language (PGML), World Wide Web
`Consortium NOTE Apr. 10, 1998, NOTE-PGML-19980410, http://
`www.w3.org/TR/1998/NOTE-PGML-19980410.
`Rick Graham, Mobile SVG at BitFlash Inc., May 2001, http://www.
`w3 .org/Talks/2002/ 1007-DI-Helsinki/bitflash/index.html.
`U.S. Appl. No. 60/296,327 Available on PAIR.
`U.S. Appl. No. 60/288,287, filed May 2, 2001. Available on
`PAIR--electronic copy previously filed via IDS submission of Sep.
`18, 2007.
`U.S. Appl. No. 60/296,275, filed Jun. 5, 2001. Available on
`PAIR--electronic copy previously filed via IDS submission of Sep.
`18, 2007.
`U.S. Appl. No. 60/296,237, filed Jun. 5, 2001. Available on
`PAIR--electronic copy previously filed via IDS submission of Sep.
`18, 2007.
`U.S. Appl. No. 60/296,274, filed Jun. 5, 2001. Available on
`PAIR--electronic copy previously filed via IDS submission of Sep.
`18, 2007.
`U.S. Appl. No. 60/296,284, filed Jun. 5, 2001. Available on
`PAIR--electronic copy previously filed via IDS submission of Sep.
`18, 2007.
`U.S. Appl. No. 60/296,231, filed Jun. 5, 2001. Available on
`PAIR--electronic copy previously filed via IDS submission of Sep.
`18, 2007.
`U.S. Appl. No. 60/296,224, filed Jun. 5, 2001. Available on
`PAIR--electronic copy previously filed via IDS submission of Sep.
`18, 2007.
`U.S. Appl. No. 60/296,426, filed Jun. 5, 2001. Available on
`PAIR--electronic copy previously filed via IDS submission of Sep.
`18, 2007.
`U.S. Appl. No. 60/296,273, filed Jun. 5, 2001. Available on
`PAIR--electronic copy previously filed via IDS submission of Sep.
`18, 2007.
`U.S. Appl. No. 60/296,283, filed Jun. 5, 2001. Available on
`PAIR--electronic copy previously filed via IDS submission of Sep.
`18, 2007.
`U.S. Appl. No. 60/296,281, filed Jun. 5, 2001. Available on
`PAIR--electronic copy previously filed via IDS submission of Sep.
`18, 2007.
`U.S. Appl. No. 60/296,327, filed Jun. 5, 2001. Available on
`PAIR--electronic copy previously filed via IDS submission of Sep.
`18, 2007.
`* cited by examiner
`
`Motorola PX 1023_6
`
`

`

`WIRELESS
`CLIENTS
`
`FIG. JA
`
`LAND-LINE
`
`CLIENTS 20~,
`
`22
`
`FTP SITE
`
`I I HTML
`I I Ill I'·--_,._, lr
`.,...., 32 n
`
`TRANSLATOR
`
`IMAGE
`TRANSLATOR
`
`58
`
`60
`
`~
`00
`•
`~
`~
`~
`
`~ = ~
`
`c ('D
`
`~
`N
`
`~
`
`N
`0
`0
`QO
`
`('D
`('D
`
`rFJ =(cid:173)
`.....
`....
`0 .....
`N
`N
`
`d
`rJl
`-....l
`~
`0'1
`
`""""' w u. w = N
`
`Motorola PX 1023_7
`
`

`

`WIRELESS
`CLIENTS
`I.
`
`HTML
`-- I I TRANSLATOR
`
`IMAGE
`TRANSLATOR
`
`I L__j
`
`I
`
`I r-
`
`(
`41
`
`72~ '":y .. ': · .. ·.:..~~ :_:-_:-.:_' I
`
`24
`
`67
`
`58
`
`20
`
`LAND-LINE
`CLIENTS
`
`22
`
`30
`
`FTP SITE
`
`FIG.JB
`
`~
`00
`•
`~
`~
`~
`
`~ = ~
`
`c ('D
`
`~
`N
`
`~
`
`N
`0
`0
`QO
`
`('D
`('D
`
`rFJ =(cid:173)
`.....
`N
`0 .....
`N
`N
`
`d
`rJl
`-....l
`~
`0'1
`
`""""' w u. w = N
`
`Motorola PX 1023_8
`
`

`

`IMAGE
`TRANSLATOR
`
`69
`
`41
`
`~--
`
`1
`I
`I
`I
`I
`I
`I
`I
`_ __ _j
`
`30
`
`SCALABLE RENDERED
`CONTENT AND USER J--'71
`INTERFACE
`
`58
`
`7
`
`FTP SITE
`
`FIG.JC
`
`~
`00
`•
`~
`~
`~
`
`~ = ~
`
`c ('D
`
`~
`N
`
`~
`
`N
`0
`0
`QO
`
`rFJ =(cid:173)
`.....
`
`('D
`('D
`
`(.H
`
`0 .....
`N
`N
`
`d
`rJl
`-....l
`~
`0'1
`
`""""' w u. w = N
`
`Motorola PX 1023_9
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 4 of22
`
`US 7,461,353 B2
`
`Fl G. 2A
`
`CLIENT SENDS CONTENT REQUEST
`INCLUDING LOCATION INDICIA (E.G., URL)
`TO PROXY SERVER
`~
`PROXY SERVER RECEIVES REQUEST, CHECKS
`CACHE, AND SENDS REQUEST TO WEB SERVER
`CORRESPONDING TO URL ADDRESS
`~
`WEB SERVER TRANSMITS PARENT HTML
`DOCUMENT BACK TO PROXY SERVER
`~
`
`FOR REFERENCES TO EXTERNAL OBJECTS
`
`1--' 100
`
`f.-' 102
`
`1--' 104
`
`'--' 106
`
`r PROXY SERVER PARSES HTML SEARCHING
`-.. r
`
`REFERENCED ~44, 46, 48, 50
`OBJECT: HTML
`DOC OR
`IMAGE FILE
`.......
`
`..........
`
`-
`
`ANY
`EFS?
`
`YES
`
`..
`
`108
`
`-
`
`PROXY SERVER REQUESTS REFERENCED
`OBJECT FROM APPROPRIATE SERVER
`
`'-"'110 N 0
`
`HTML, XML, CSS CONTENT IS TRANSLATED
`INTO SCALABLE VECTOR REPRESENTATION
`
`114
`
`IMAGE CONTENT TRANSLATED INTO
`COMPRESSED BITMAP FORMAT
`
`VECTORIZED CONTENT AND COMPRESSED
`BITMAPS ARE STREAMED FROM PROXY
`SERVER TO CLIENT
`
`VECTORIZED CONTENT AND BITMAP CONTENT
`PROCESSED AND SCALED USING THIN CLIENT
`TO RENDER CONTENT ON CLIENT DEVICE
`
`116
`
`118
`
`120
`
`Motorola PX 1023_10
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 5 of22
`
`US 7,461,353 B2
`
`Fl G.2B
`
`CLIENT SENDS CONTENT REQUEST
`TO NETWORK SITE (E.G., WEB URL)
`~
`HTTP NEGOTIATION PERFORMED TO
`DETERMINE FORMAT CONTENT IS TO BE
`DELIVERED IN; SERVER CACHE CHECKED
`
`+
`
`WEB SERVER RETRIEVES
`PARENT HTML DOCUMENT
`
`+
`____.. WEB SERVER PARSES HTML SEARCHING FOR
`REFERENCES TO EXTERNAL OBJECTS
`
`REFERENCED
`OBJECT: HTML
`DOC OR
`IMAGE FILE
`.........
`
`........
`
`-
`
`-
`
`~,r
`
`-
`
`v 101
`
`v 103
`
`v105
`
`v 107
`
`v111 N 0
`
`f-.' 44, 46, 48, 50
`
`ANY
`EFS?
`
`109
`
`YES
`'t
`WEB SERVER RETRIEVES REFERENCED
`OBJECT LOCALLY OR RETRIEVES REFERENCED
`OBJECT FROM
`AN APPROPRIATE SERVER
`
`HTML, XML, CSS CONTENT IS TRANSLATED
`INTO SCALABLE VECTOR REPRESENTATION
`
`114
`
`IMAGE CONTENT TRANSLATED INTO
`COMPRESSED BITMAP FORMAT
`
`VECTORIZED CONTENT AND COMPRESSED
`BITMAPS ARE STREAMED FROM
`WEB SERVER TO CLIENT
`
`VECTORIZED CONTENT AND BITMAP CONTENT
`PROCESSED AND SCALED USING THIN CLIENT
`TO RENDER CONTENT ON CLIENT DEVICE
`
`116
`
`119
`
`120
`
`Motorola PX 1023_11
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 6 of22
`
`US 7,461,353 B2
`
`FJ G.2C
`
`CLIENT SENDS CONTENT REQUEST
`TO NETWORK SITE (E.G., WEB URL) TO
`RETRIEVE CONTENT
`
`f-..'113
`
`NETWORK SITE SENDS
`PARENT HTML DOCUMENT
`
`f.-' 115
`
`-----.
`
`CLIENT PARSES HTML SEARCHING FOR
`REFERENCES TO EXTERNAL OBJECTS
`
`'-/117
`
`REFERENCED
`OBJECT: HTML
`DOC OR
`IMAGE FILE
`
`-
`
`~
`~
`
`......
`
`-........
`
`-
`
`f.-' 44, 46, 48, 50
`
`ANY
`EFS?
`
`119
`
`YES
`
`•
`
`-
`
`CLIENT RETRIEVES REFERENCED OBJECT
`FROM AN APPROPRIATE SERVER
`
`v121 N 0
`
`HTML, XML, CSS CONTENT IS TRANSLATED
`INTO SCALABLE VECTOR REPRESENTATION
`
`114
`
`IMAGE CONTENT TRANSLATED INTO
`COMPRESSED BITMAP FORMAT
`
`116
`
`VECTORIZED CONTENT AND BITMAP CONTENT
`PROCESSED AND SCALED USING THIN CLIENT
`TO RENDER CONTENT ON CLIENT DEVICE
`
`120
`
`Motorola PX 1023_12
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 7 of22
`
`US 7,461,353 B2
`
`i
`
`I
`I
`:
`
`FIG. 3
`
`r---------------------------
`I
`1
`:
`HTML
`I
`TRANSLATOR ~
`: ~32
`581
`L------------~
`I
`I
`I
`74:
`I
`I
`I
`
`75
`
`CLIENT
`MANAGER
`
`REQUEST
`MANAGER
`
`73
`
`I
`I
`I
`~-......J:_---1.---,--,_ I
`IMAGE
`:
`TRANS LA TOR
`I
`:
`I
`
`I
`I
`I
`
`60
`~--------------------------~
`
`DISPLAY
`
`[-----------------------------------
`MASS
`STORAGE
`DEVICE
`
`READ ONLY
`MEMORY
`
`501
`
`PROCESSOR 502
`
`FIG.JO
`
`Motorola PX 1023_13
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 8 of22
`
`US 7,461,353 B2
`
`NEWS SPARKS MARKET--v24BA
`
`254A
`
`NASDAQ
`224A
`
`OPTIONS
`226A
`
`CHARTS
`
`MUTUAL
`FUNDS
`
`IRA, 401K
`OPTIONS
`
`.....
`
`= /tJ
`
`_,
`
`·-10831
`
`-
`
`107<}9
`
`-t!J767
`
`,-4170
`'-'- 4154
`:-·4138
`-4122
`-4106
`-4098
`-4074
`-40SS
`
`NetVest's Mutual Fund Mart gives you'"'-' 258A
`access to over 250 fund companies and
`funds, including 1,265 no load funds.
`32A
`
`TAX
`INFORMATION
`
`Our no-fee IRA* combined with Fund --v 260A
`Mart is the vehicle that will get you
`where you want to go. Learn more ...
`
`210A
`
`FIG. 4A
`
`214
`
`Motorola PX 1023_14
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 9 of22
`
`US 7,461,353 B2
`
`GO FAVORITES
`
`.!:!.ELP
`
`D!Ol!ZI
`111m
`
`MARKET HOME
`FILE EDIT VIEW
`0 ~ a cf GJ
`¢:::l q
`@
`BACK FORWARD STOP REFRESH HOME SEARCH FAVORITES HISTORY
`ADDRESS I HTTP://<ADDRESS PATH> ..-238B "240B
`I•ILINKS
`LINK#9 -11 LINK #1 0 -w. LI~K #11 I ~
`'\_: ~~ '--244B
`236B 242B
`\__246B
`
`LOGO GRAPHIC
`OBJECT#1
`\
`218'8-216B
`\'
`TEXT HEADER #1
`I
`GRAPHIC #2; l
`GRAPHIC #3; l
`GRAPHIC #4; l
`
`LINK #1222B
`
`LINK#2224B
`
`LINK#3226B
`
`LINK#8
`
`ADD BANNER
`GRAPHIC OBJECT #9
`
`HEADLINE OBJECT
`
`}248B
`
`/254B
`
`GRAPHIC OBJECT #1 0
`
`GRAPHIC
`QBJECI~jj
`!INPUT 1 255B I
`!INPUT 2 256B I
`I LOGIN I
`250B
`
`l257B
`
`\
`
`GRAPHIC#5;
`LINK#4
`
`~220B '-2288
`TEXT HEADER #21
`
`GRAPHIC OBJECT #12
`
`~2528
`
`GRAPHIC #6; j
`LINK#5230A
`
`GRAPHIC #7; 1
`GRAPHIC# 8; l
`
`LINK#62328
`
`LINK#7234B
`
`TEXT OBJECT #1
`
`TEXT OBJECT #2
`
`t2588
`
`tOOB
`
`I
`
`I
`
`I
`
`/
`
`I
`
`/
`212
`
`/
`210B
`
`I I I
`
`"i
`
`::--...
`\
`
`"'-·
`214
`
`FIG.4B
`
`Motorola PX 1023_15
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 10 of 22
`
`US 7,461,353 B2
`
`MARKET HOME
`
`1'-254C
`J255C
`IT
`rr
`
`2558
`
`2578.1
`
`\ \ "~---------2-50_8-.,
`I'-226C
`'-----~-=F2=F-J8
`1'-228C
`
`r\.252C
`
`lk-----Wi~'''\ 11"2580
`22 ~ r\
`"'-220C
`1\ ~lfL_ ________ ______,
`''-258C
`
`'-230C
`230A
`L-----===..;
`'1\232C
`l'r---260C
`~~ =====23=2~8
`I
`'1\234C
`-
`2348
`
`I'-260C
`
`~--~/--~~------------~"-----~ ~
`I
`I
`I I I
`\
`
`-4
`
`/
`212
`
`j
`
`21bc
`
`FIG. 4C
`
`"-214
`
`Motorola PX 1023_16
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 11 of 22
`
`US 7,461,353 B2
`
`MARKET HOME
`
`266
`
`1130, of
`\
`(214C
`/2140
`
`/262
`
`0, 0
`
`266
`
`~
`
`266'
`
`II
`II
`II
`11-.....-2500'
`\\
`
`2 00
`
`2520
`
`D[D]IZJ
`
`264
`
`...
`
`H1 = 180
`
`2508
`
`I
`_j
`I
`~ _j
`~I
`
`H2 = 200
`
`:: ~ 20.-225 {
`25~ ri rt; 150, 225 J
`~·
`
`268'
`
`268
`
`270
`
`I
`I
`
`~~~
`
`2Cc
`
`250C
`\ ~20,-4-25-{ 2701
`v ~ 150,4251
`
`l.---w=350
`
`/
`
`I
`
`/
`212
`
`I
`
`/
`
`2100
`
`FIG.4D
`
`......._
`
`\
`
`\...
`214
`
`~
`A
`
`Motorola PX 1023_17
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 12 of 22
`
`US 7,461,353 B2
`
`NEWS SPARKS MARKET
`
`=)\I
`-·
`
`-4170
`-4154
`-4138
`-4122
`. -4106
`-4890
`-4074
`-4ess
`
`lpm
`
`NetVest's Mutual Fund Mart gives you access
`to over 250 fund companies and funds,
`including 1,265 no load funds.
`
`Our no-fee IRA* combined with Fund Mart is
`the vehicle that will get you where you want to
`
`/
`
`210E
`
`FIG.4E
`
`Motorola PX 1023_18
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 13 of 22
`
`US 7,461,353 B2
`
`r-262' MARKET HOME
`DliliZI
`"'-238C 2388 I T'-240C 2408.1 f242C 2428.11 '"244c 2448 I
`264
`\.246C
`2468
`--------------
`2488 J
`
`ty r'-21sc
`l
`
`{262 2168
`~I
`
`2188
`
`Tk18C I
`-~22C:
`I
`
`I
`
`.T.
`
`1--
`
`r\.248c
`
`11-4!
`I
`I
`I
`
`r'-254c
`I 2548
`l~255C _l
`IT
`I 2558
`./256C
`I
`1 2568
`IT
`I
`_(T25781
`
`2s1c
`
`2508
`
`2528
`
`2588
`
`I
`
`2228
`
`r\.25oc
`
`2248
`
`2268
`
`r\.252c
`
`2288
`
`2208
`
`230A
`
`2328
`
`r58C
`
`'-260C
`
`·1'24cl
`~
`f
`~~6c 1
`I
`:
`1~8cl
`I
`I
`II:
`.t20CI
`Ill
`
`II'
`
`.~
`
`Ill
`
`•T•
`
`.T.
`
`·1~ocl
`r
`I
`Ill
`1)2c 1
`I
`:
`II,
`'f\.1
`2348
`234C I
`I ----
`
`2608
`I--------------""'
`\
`\ 266
`
`...
`
`~
`210F
`
`FIG.4F
`
`Motorola PX 1023_19
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 14 of 22
`
`US 7,461,353 B2
`
`-!1Y'-.,
`x262
`__L
`-1x
`
`DID!~
`
`264
`
`~
`
`ff' MARKET HOME
`~
`2520" ~ 150. SF -8)(' 225. SF -"Y I
`
`I
`H1' = 180 *SF _j
`I\
`I
`v ~ 150 *SF- !1X I 425 *SF- !1Y I
`2528' _l
`~I
`
`~.
`
`250C'
`
`/
`252C'
`
`'-268"
`
`2508'
`
`\_270"
`
`H2' = 300 *SF
`
`1.--W = 350 • SF
`
`_/__
`I
`!.,
`212
`
`/
`
`210G
`
`I
`
`FIG.4G
`
`-~
`\
`
`"'-214'
`
`'T
`
`'
`~ 266
`
`Motorola PX 1023_20
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 15 of 22
`
`US 7,461,353 B2
`
`PARSE HTML CONTENT TO IDENTIFY LAYOUT
`INFORMATION TAGS
`
`f.-.' 150
`
`~
`
`SEPARATE CONTENT INTO OBJECTS AND
`DEFINE BOUNDING BOX FOR EACH OBJECT
`
`..._,
`
`152
`
`~
`
`DEFINE PAGE LAYOUT
`BASED ON BOUNDING BOXES
`
`..._, 154
`
`~
`
`DEFINE DATUM POINT FOR PAGE AND FOR
`EACH OBJECT BOUNDING BOX
`
`156
`~
`
`,
`GENERATE VECTOR FROM PRIMARY DATUM TO ..._,
`BOUNDING BOX DATUM FOR EACH OBJECT
`
`158
`
`,
`CREATING A REFERENCE THAT LINKS EACH
`OBJECT TO ITS VECTOR AND BOUNDING BOX ~ 160
`
`FIG. 5
`
`Motorola PX 1023_21
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 16 of 22
`
`US 7,461,353 B2
`
`GATHER VECTOR REPRESENTATION DATA
`CORRESPONDING TO WEB PAGE
`
`160
`~
`
`,
`BUILD DISPLAY LIST OF VECTORS
`
`,
`DETERMINE USER-SELECTABLE
`ZOOM SCALE AND OFFSET
`
`,
`PROCESS VECTORS AND BOUNDARY BOXES
`TO DETERMINE VIRTUAL LAYOUT OF DISPLAY;
`DETERMINE DISPLAY LIMIT BOUNDING BOX
`
`,
`RETRIEVE CONTENT CORRESPONDING TO
`OBJECTS HAVING AT LEAST A PORTION OF
`THEIR BOUNDING BOXES FALL WITHIN
`THE DISPLAY LIMIT BOUNDING BOX
`
`f.-; 162
`
`f.....'
`
`164
`
`f.....' 166
`
`1--' 168
`
`r
`SCALE CONTENT; SCALE BITMAPS, RETRIEVE/
`BUILD APPROPRIATE FONTS; SCALE
`SEPARATOR LINES AND BORDERS
`
`~ 170
`
`RENDER THOSE PORTIONS OF SCALED
`CONTENT FALLING WITHIN
`THE DISPLAY LIMIT BOUNDING BOX
`
`1--' 172
`
`FIG. 6
`
`Motorola PX 1023_22
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 17 of 22
`
`US 7,461,353 B2
`
`Palm lllc
`
`~··· .... -...... -.........
`. .. ..
`........
`
`..... ~····"
`.
`.,
`. _ ....... i. .
`.w_l~._ ..... u...t- ~._t:~u.w., ... ,.._.
`
`FIG. 7A
`
`Motorola PX 1023_23
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 18 of 22
`
`US 7,461,353 B2
`
`Palm lllc
`
`~ Yahoo! PoyDirect - s~od on<f
`receiVe money online
`· Get your own Web domain
`. Y! Travel -buy tickets, check
`arriVal times
`
`®®
`
`FIG. 7B
`
`Motorola PX 1023_24
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 19 of 22
`
`US 7,461,353 B2
`
`Palm lllc
`
`....... -••. ~ -:=:~~-.....
`.... ,. ·~·--···~
`·.~··
`·ft.~~ .........
`- .~:~::~:~.~ ...
`.. ·~!_._,_...;,;..,.:..-......-.... ~ ...... ;.,
`
`• .,._,, .. ,.
`
`..... I ....
`
`...
`·
`·
`.
`_
`............
`~ ~~·•·'iMti.-l·
`... _.:"! ..... ~ .... ~~.·~.., .......................... ~, .....
`
`FIG. 8A
`
`Motorola PX 1023_25
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 20 of 22
`
`US 7,461,353 B2
`
`Palm lllc
`
`FIG. 8B
`
`Motorola PX 1023_26
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 21 of 22
`
`US 7,461,353 B2
`
`Palm lllc
`
`"""'•"'";...,, ..
`. ,,., ..... ,;, .. --...... s~~;:~=i=':~
`. ..., .... .
`...................
`.............
`. .....,.
`
`.
`
`-~~-~··
`·-.......:~-••
`•oertJ••"tt.u •
`....
`••••.i·•·· .. ••
`""' ............... .
`~·._~ ..................... ~ .. ······
`. .... ···'"'""•7
`'
`. .
`....... ~......
`"-· ........ .. -1 ............... HIIWio'a .......... _
`.....
`
`............ u ..
`
`FIG. 9A
`
`Motorola PX 1023_27
`
`

`

`U.S. Patent
`
`Dec. 2, 2008
`
`Sheet 22 of 22
`
`US 7,461,353 B2
`
`Palm lllc
`
`.. President oseph
`May
`Estrada's hold on power fell ap·artos
`military ond political allies ~abon.:toned
`him and hundreds ofthou:s:ands o:r
`Filipinos threatened to march on the
`presidential palace-at down Saturday
`to force him~ou1. The former mo'iie
`star,. beleaguered for months by
`n allegations .. was
`reportedly negotiating over terms
`for his resignation. More ~··
`* <hronology of Philippine
`corruption scandal (AFP}
`
`FIG. 9B
`
`Motorola PX 1023_28
`
`

`

`US 7,461,353 B2
`
`1
`SCALABLE DISPLAY OF INTERNET
`CONTENT ON MOBILE DEVICES
`
`RELATED APPLICATIONS
`
`2
`Internet content in existing browsers. The majority oflnternet
`content displays as a flat single resolution with no browser
`support for zoom.
`Much of the Internet content has been designed for display
`5 on desktop computers with a single target resolution. Even
`though HTML has the ability to adapt to changes in screen
`resolution, major Internet content providers have chosen to
`create their Web pages using fixed resolution structures, such
`as tables. This gives them the ability to control the look and
`10 feel of their Web sites. This fixed resolution approach has
`evolved to the point that the fixed resolution layout of Web
`pages has become the most common method to brand or
`uniquely identify Web sites. While this fixed resolution
`approach is good for site branding and product differentiation
`15 it does present a daunting technical problem for display of
`Internet content (designed for desktop computers) on small
`screen, low resolution, or different aspect ratio devices, such
`as cell phones and hand held computers.
`
`BRIEF SUMMARY OF THE INVENTION
`
`The present application is a Divisional Application ofU.S.
`application Ser. No. 09/878,097, filed Jun. 8, 2001, now U.S.
`Pat. No. 7,210,099, which is a Continuation-in-Part of U.S.
`Non-Provisional application Ser. No. 09/828,511, filed Apr.
`7, 2001, now abandoned, entitled "RESOLUTION INDE(cid:173)
`PENDENT VECTOR DISPLAY OF INTERNET CON(cid:173)
`TENT," the benefit of the filing date of which is claimed under
`35 U.S.C. § 120. This application further claims the benefit of
`the filing dates of U.S. Provisional Application No. 60/211,
`019, filedJun.12, 2000, entitled "METHOD AND SYSTEM
`FOR RESOLUTION INDEPENDENT DISPLAY OF
`HTMLAND XML CONTENT' and U.S. Provisional Appli(cid:173)
`cation No. 60/217,345, filed Jul. 11, 2000, entitled
`"METHOD AND
`SYSTEM
`FOR
`SELECTION,
`RETRIEVAL, AND CONVERSION OF COMPUTER 20
`CONTENT TO VECTOR FORMAT FOR RESOLUTION
`INDEPENDENT DISPLAY," under 35 U.S.C. § 119( e).
`The present application is also related to U.S. application
`Ser. No. 11/735,477 filed on Apr. 15, 2007, U.S. application
`Ser. No. 11/735,482 filed on Apr. 15, 2007, U.S. application 25
`Ser. No. 11/738,486 filed on Apr. 21, 2007, and U.S. applica(cid:173)
`tion Ser. No. 11/738,932 filed on Apr. 23,2007, each of which
`are continuations of U.S. application Ser. No. 09/878,097,
`now U.S. Pat. No. 7,210,099.
`
`In accordance with aspects of the invention, mobile devices
`enabled to support resolution-independent scalable display of
`Internet (Web) content to allow Web pages to be scaled
`(zoomed) and panned for better viewing on smaller screen
`sizes are disclosed. The mobile devices employ novel pro(cid:173)
`cessing of original Web content, including HTML-based con(cid:173)
`tent, XML, cascade style sheets, etc. to generate scalable
`content. The scalable content and/or data derived therefrom
`30 are then employed to enable the Web content to be rapidly
`rendered, zoomed, and panned. Moreover, the rendered dis(cid:173)
`plays provide substantially the same or identical layout as the
`original Web page, enabling users to easily navigate to
`selected content and features on familiar Web pages. Display
`35 lists may also be employed to provide further enhancements
`in rendering speed. Additionally, hardware-based pro(cid:173)
`grammed logic may also be employed to facilitate various
`operations.
`According to further aspects, some mobile devices may
`employ touch-sensitive display screens that enable users to
`provide various inputs to control display of content within
`Web pages. Exemplary user inputs include tap-based inputs
`to selectively zoom in on colunms, images, and paragraphs.
`Users can also define a window to zoom in on via the touch-
`45 sensitive display.
`According to additional aspects of the invention, methods
`and software for enabling support for resolution-independent
`scalable display of Web content are provided. The methods
`50 and software enable users of various devices, from handheld
`devices with small screens, to desktop PC's and laptops, to
`very large screen devices, to view and interact with Web pages
`in a manner independent of the screen resolution of such
`device's built-in or associated display, while maintaining the
`look and feel of browsing such pages with a conventional
`desktop browser. Thus, users of various devices having dif(cid:173)
`ferent screen resolutions are enabled to browse Web pages
`from among literally billions ofWeb pages while providing a
`full Web browsing experience.
`Other features of the present invention will be apparent
`from the accompanying drawings and from the detailed
`description that follows.
`
`COPYRIGHT NOTICE
`
`Contained herein is material that is subject to copyright
`protection. The copyright owner has no objection to the fac(cid:173)
`simile reproduction of the patent disclosure by any person as
`it appears in the Patent and Trademark Office patent files or
`records, but otherwise reserves all rights to the copyright
`whatsoever.
`
`BACKGROUND OF THE INVENTION
`
`40
`
`1. Field of the Invention
`The invention relates generally to translation of Internet
`and World Wide Web content to scalable vector representa(cid:173)
`tion. More particularly, the invention relates to apparatus and
`methods for zoom enabling the display of content in an Inter(cid:173)
`net information browser by retrieving and translating Hyper(cid:173)
`Text Markup Language (HTML), extensible Markup Lan(cid:173)
`guage (XML), and other Internet content
`to vector
`representations of that content.
`2. Description of the Related Art
`Text only Internet information browsers began as a project
`at the CERN, European Organization for Nuclear Research,
`facility in Geneva Switzerland. From its inception the intent
`was to provide a mesh or web of access to data with a common 55
`user interface. Browsers moved from the academic environ(cid:173)
`ment when NCSA, the National Center for Supercomputing
`Applications at the University of Illinois in Urbana-Cham(cid:173)
`paign developed Mosaic, an Internet information browser and
`World Wide Web client.
`Internet content is stored in multiple file formats. These
`formats include HTML (Hyper Text Markup Language) and
`XML (extended Markup Language) as well as graphic file
`format GIF (Graphics Interchange Format) and JPEG (Joint
`Photographic Experts Group). These four file formats consti- 65
`tute the majority of Internet content. Font size and resizing
`display area for content can alter the size of the display of
`
`60
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The appended claims set forth the features of the invention
`with particularity. The invention, together with its advan-
`
`Motorola PX 1023_29
`
`

`

`US 7,461,353 B2
`
`4
`DETAILED DESCRIPTION OF THE INVENTION
`
`3
`tages, may be best understood from the following detailed
`description taken in conjunction with the accompanying
`drawings of which:
`FIG. lA is a block schematic diagram illustrating a first
`exemplary system infrastructure in accordance with the
`present invention in which content translation services are
`performed by a third-party proxy service that translates con(cid:173)
`tent requested from a client that is retrieved from one or more
`network resources into a scalable vector representation and
`delivers the translated content to the client;
`FIG. lB is a block schematic diagram illustrating a second
`exemplary system infrastructure in which the translation of
`content is performed at a content provider's web site and
`delivered directly to the requesting client;
`FIG. lC is a block schematic diagram illustrating a third 15
`exemplary system infrastructure in which content received
`from one or more network sources is translated into a scalable
`vector representation at the client;
`FIG. 2A is a flowchart illustrating how data is retrieved,
`processed and transferred in accordance with the system
`infrastructure of FIG. lA;
`FIG. 2B is a flowchart illustrating how data is retrieved,
`processed and transferred in accordance with the system
`infrastructure of FIG. lB;
`FIG. 2C is a flowchart illustrating how data is retrieved,
`processed and transferred in accordance with the system
`infrastructure of FIG. lC;
`FIG. 3 is a block schematic diagram illustrating an exem(cid:173)
`plary architecture corresponding to the proxy server of FIG.
`lA;
`FIG. 4A is a representation of an exemplary web page has
`displayed on a conventional browser;
`FIG. 4B is a schematic diagram illustrates various objects
`that are generated based on the HTML code of the web page
`of FIG. 4A;
`FIG. 4C is a schematic diagram illustrating a set of vectors
`and bounding boxes corresponding to the objects generated in
`FIG. 4B;
`FIG. 4D is a schematic diagram illustrating how various
`vectors and bounding boxes may be defined in accordance
`with the invention;
`FIG. 4E is a representation of the web page ofFIG. 4A after
`it has been offset and scaled in accordance with the invention;
`FIG. 4F is a sche