ZW 7607514
`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and Trademark OfBee
`
`October 29,2016
`
`THIS IS TO CERTIFY THAT ANNEXED IS A TRUE COPY FROM THE
`RECORDS OF THIS OFFICE OF THE FILE WRAPPER AND CONTENTS
`OF:
`
`'
`
`12480,454
`NUMBER:
`APPLICATION
`FILING DATE: December29, 2010
`PATENT NUMBER: RE43,564
`ISSUE DATE: August07,2012
`
`By Authority of the
`Under Secretary of Commerce for I
`Ilectual Property
`and Director of the United States P te t and Trademark OfBce
`
`P.SWAIN
`Certifying
`
`fficer
`
`GOOGLE EX. 1013 - 00001
`
`Google v. Philips
`
`

`
`Under
`
`PTO/SB/50 (09-07)
`Approved for use through08/31/2010.OMB 0651-0033
`U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMMERCE
`the PaperworkReduction Act of 1995.no personsare required in respondto a collection of information unless it displays a valid OMB control number.
`REISSUE PATENT APPLICATION TRANSMITTAL
`
`Address to:
`
`Attomey Docket No-
`First Named inventor
`
`PHS000173US2
`JAN VAN EE
`
`Mail Stop Reissue
`
`Original Patent Number
`
`6,466,203
`
`Com ssio er for Patents
`Alexandria, VA 22313-1450
`APPLICATION FOR REISSUEOF:
`(Check appHcaNe box)
`APPLICATION ELEMENTS (37 CFR 1.173)
`
`(eMngaiDaaten ssue Date OCTOBER 15, 2002
`Express Mail Label No.
`
`Utility Patent
`
`0 Plant Patent
`Design Patent
`ACCOMPANYlNG APPLICATION PARTS
`
`Fee Transmittal Form (PTO/SB/56)
`
`(Submit a duplicate copy)
`
`Statement of status and support
`
`for all
`
`10.
`
`11.
`
`12.
`
`13.
`
`14.
`
`15.
`
`16.
`
`changes to the claims.See 37 CFR 1.173(c).
`
`Foreign Priority Claim (35 U.S.C. 119)
`(if applicable)
`
`Information Disclosure Statement (IDS)
`PTO/SBlo8 or PTO-1449
`y Copies of citations attached
`
`EnglishTranslation of Reissue Oath/Declaration
`(if applicable)
`
`Preliminary Amendment
`Retum Receipt Postcard (MPEP 503)
`(Should be specifically itemized)
`
`Other:
`
`D
`
`1.
`
`2.
`
`3.
`
`4.
`5.
`
`6.
`
`7.
`
`Applicant claims small entity
`
`status. See 37 CFR 1.27.
`
`Specificationand Claimsin double column copy of patent format
`(amended,
`if appropriate)
`
`Drawing(s) (proposed amendments,if appropáste)
`
`Reissue Oath/Declaration (original or copy)
`(37 C.F.R. 1.175) (PTO/SB/51 or 52)
`
`Power of Attomey
`
`Original U.S. Patent currently assigned?
`(if Yes,check applicable box(es))
`
`Yes Ü No
`
`Written Consent of all Assignees (PTO/SB/53)
`
`V
`
`37 CFR 3.73(b) Statement
`
`(PTO/SB/96)
`
`8. ]
`
`CD-ROM or CD-R in duplicate, Computer Program (Appendix)
`or large table
`Landscape Table on CD
`9. Nucleotide and/or Amino Acid Sequence Submission
`c. are required))
`(if applicable,
`items e.-
`a.
`Computer Readable Form (CRF)
`b. Speciti
`' n Sequence Listing on:
`CD-ROM (2 copies) or CD-R (2 copies); or
`paper
`
`i
`ii ()
`
`c.
`
`Statements verifying identity of above copies
`17. CORRESPONDENCE ADDRESS
`
`The address associated withCustomer Number:
`
`24737
`
`OR
`
`Correspondence addressbelow
`
`Name
`
`Address
`
`City
`
`Country
`
`State
`
`Telephone
`
`Zip Code
`
`Email
`
`Signature
`
`December 22, 2010
`/Edward W. Goodman/
`Date
`EDWARD W.GOODMAN
`Registration No. (Attorney/Agent)
`28,613
`Name (Print/Type)
`This collectionof informationis required by 37 CFR 1.173.The informationis required to obtain or retain a benefit by the public which is to file (and by the USPTO
`is govemed by 35 U.S.C. 122 and 37 CFR 1.11 and 1.14. This collection is estimated to take 12 minutes to complete,
`to process) an application. Confidentiality
`including gathering, preparing, and submitting the completed application form to the USPTO. Time will vary depending upon the individual case.Any commentson
`the amount of time you require to complete this form and/or suggestionsfor reducingthis burden, should be sent to the Chief informationOfficer.U.S.Patentand
`Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria, VA 22313-1450. DO NOT SEND FEES OR COMPLETED FORMS TO THIS
`for Patents, P.O.Box 1450, Alexandria, VA 22313-1450.
`ADDRESS. SEND To: Mail Stop Reissue, Commissioner
`If you need assistance in completing the form, call 1-800-PT O-9199 and select option 2.
`
`GOOGLE EX. 1013 - 00002
`
`Google v. Philips
`
`

`
`Privacy Act Statement
`
`The Privacy Act of 1974 (P.L.93-579)
`requires that you be given certain information in connection
`with your submission of the attached form related to a patent application or patent. Accordingly,
`pursuant to the requirements of the Act, please be advised that: (1) the general authority for the
`collection of this information is 35 U.S.C.2(b)(2); (2) fumishing of the information solicited is voluntary;
`and (3) the principal purpose for which the information is used by the U.S.Patent and Trademark
`Office is to process and/or examine your submission related to a patent application or patent. If you do
`not fumish the requested information, the U.S.Patent and Trademark Office may not be able to
`process and/or examine your submission, which may result in termination of proceedings or
`abandonment of the application or expiration of the patent.
`
`The information provided by you in this form will be subject
`
`to the following routine uses:
`
`1. The information on this form will be treated confidentially to the extent allowed under
`the
`Freedom of information Act (5 U.S.C. 552) and the Privacy Act (5 U.S.C 552a). Records from
`this system of records may be disclosed to the Department of Justice to determine whether
`disclosure of these records is required by the Freedom of Information Act.
`2. A record from this system of records may be disciosed, as a routine use, in the course of
`presenting evidence to a court, magistrate, or administrative tribunal,
`including disclosures to
`opposing counsel in the course of settlement negotiations.
`3. A record in this system of records may be disclosed, as a routine use, to a Member of
`Congress submitting a request involving an individual,
`to whom the record pertains, when the
`individual has requested assistance from the Member with respect to the subject matter of the
`record.
`4. A record in this system of records may be disclosed, as a routine use, to a contractor of the
`Agency having need for the information in order to perform a contract. Recipients of
`information shall be required to comply with the requirements of the Privacy Act of 1974, as
`to 5 U.S.C.552a(m).
`amended, pursuant
`5. A record related to an lntemational Application filed under
`the Patent Cooperation Treaty in
`this system of records may be disclosed, as a routine use, to the international Bureau of the
`World intellectual Property Organization,
`pursuant
`to the Patent Cooperation Treaty.
`6. A record in this system of records may be disclosed, as a routine use, to another
`federal
`agency for purposes of National Security review (35 U.S.C. 181) and for review pursuant
`the Atomic Energy Act (42 U.S.C.218(c)).
`7. A record from this system of records may be disclosed, as a routine use, to the Administrator,
`General Services, or his/her designee, during an inspection of records conducted by GSA as
`part of that agency's responsibility
`to recommend improvements in records management
`practices and programs, under authority of 44 U.S.C.2904 and 2906. Such disclosure shall
`be made in accordance with the GSA regulations goveming inspection of records for this
`relevant (i.e., GSA or Commerce) directive. Such disclosure shall not
`purpose, and any other
`be used to make determinations
`individuals.
`about
`8. A record from this system of records may be disclosed, as a routine use, to the public after
`to 35 U.S.C.122(b) or issuance of a patent
`either publication of the application pursuant
`to 35 U.S.C.151. Further, a record may be disclosed,
`to the limitations of 37
`pursuant
`subject
`CFR 1.14, as a routine use, to the public if the record was filed in an application which
`became abandoned or in which the proceedings were terminated and which appiication is
`referenced by either a published application, an application open to public inspection or an
`issued patent.
`9. A record from this system of records may be disclosed, as a routine use, to a Federal, State,
`or local law enforcement agency, if the USPTO becomes aware of a violation or potential
`violation of law or regulation.
`
`to
`
`GOOGLE EX. 1013 - 00003
`
`Google v. Philips
`
`

`
`IN THE UNITED
`
`STATES
`
`PATENT
`
`AND TRADEMARK
`
`OFFICE
`
`In
`
`re Application
`
`of
`
`JAN VAN EE
`
`SERIAL
`
`NO.:
`
`Atty.
`
`Docket
`
`PHUS000173US2
`
`GROUP ART UNIT:
`
`F ILED:
`
`CONCURRENTLY
`
`EXAMINER:
`
`CONFIRMATION
`
`NO.:
`
`HAND-HELD
`
`WITH
`
`AUTO-ZOOM
`
`FOR GRAPHICAL
`
`DISPLAY
`
`OF WEB PAGE
`
`Commissioner
`P.O. Box
`1450
`Alexandria,
`VA
`
`for
`
`Patents
`
`22313-1450
`
`Sir:
`
`PRELIMINARY
`
`AMENDMENT
`
`Prior
`
`to Calculating
`
`the
`
`filing
`
`fee
`
`and
`
`examination,
`
`please
`
`amend
`
`the
`
`above-identified
`
`application
`
`as
`
`follows:
`
`PHUS000173US2-AMT-082510.doc
`
`1
`
`GOOGLE EX. 1013 - 00004
`
`Google v. Philips
`
`

`
`IN THE
`
`CLAIMS
`
`Please
`
`amend
`
`the
`
`claims
`
`as
`
`follows:
`
`1.
`
`(Amended)
`
`A handheld
`
`communication
`
`device
`
`comprising:
`
`a wireless
`
`modem for
`
`receiving
`
`data;
`
`a display
`
`that
`
`has
`
`a substantially
`
`small
`
`size
`
`suitable
`
`for
`
`in
`
`the
`
`handheld
`
`communication
`
`device;
`
`a data
`
`processing
`
`system
`
`connected
`
`to
`
`the modem and
`
`to
`
`the
`
`display
`
`for
`
`processing
`
`the
`
`received
`
`data
`
`and
`
`for
`
`rendering
`
`an image
`
`corresponding
`
`to
`
`the
`
`data
`
`received;
`
`a touch
`
`screen
`
`for
`
`enabling
`
`a user
`
`to
`
`interact
`
`with
`
`the
`
`device;
`
`wherein:
`
`the
`
`system
`
`is
`
`operative
`
`to
`
`enable
`
`the
`
`user
`
`to
`
`select
`
`through
`
`a touch
`
`location
`
`on the
`
`touch
`
`screen
`
`a portion
`
`of
`
`the
`
`rendering
`
`the
`
`selected
`
`image,
`
`when
`
`displayed
`
`at
`
`a first
`
`scale,
`
`for
`
`portion
`
`on
`
`the
`
`display
`
`at
`
`a second
`
`scale
`
`larger
`
`than
`
`the
`
`first
`
`scale
`
`thereby
`
`facilitating
`
`a selection
`
`of
`
`a feature;
`
`and
`
`the
`
`selected
`
`portion
`
`when
`
`rendered
`
`at
`
`the
`
`first
`
`scale
`
`is
`
`a
`
`zoomed-in
`
`version
`
`of
`
`part
`
`of
`
`the
`
`image
`
`at
`
`the
`
`first
`
`scale
`
`substantially
`
`centered
`
`around
`
`the
`
`touch
`
`[screen]
`
`location.
`
`2.
`
`(Pending)
`
`The
`
`device
`
`of
`
`claim
`
`1, wherein
`
`a position
`
`of
`
`the
`
`touch
`
`location
`
`is
`
`arbitrary
`
`with
`
`respect
`
`to
`
`the
`
`touch
`
`screen.
`
`3.
`
`(Pending)
`
`The
`
`device
`
`of
`
`claim
`
`1,
`
`comprising
`
`a browser.
`
`PHUS000173US2-AMT-082510
`
`.doc
`
`2
`
`GOOGLE EX. 1013 - 00005
`
`Google v. Philips
`
`

`
`4.
`
`(Pending)
`
`access.
`
`The
`
`device
`
`of
`
`claim
`
`1,
`
`having
`
`wireless
`
`Internet
`
`5.
`
`(Pending)
`
`The
`
`device
`
`of
`
`claim
`
`1, wherein
`
`the
`
`data
`
`comprises
`
`streaming
`
`video.
`
`6.
`
`(Amended)
`
`communication
`
`device
`
`comprising:
`
`Software
`
`for
`
`being
`
`installed
`
`on a handheld
`
`a wireless
`
`modem for
`
`receiving
`
`data;
`
`a display
`
`that
`
`has
`
`a substantially
`
`small
`
`size
`
`suitable
`
`for
`
`in
`
`the
`
`handheld
`
`communication
`
`device;
`
`a data
`
`processing
`
`system
`
`connected
`
`to
`
`the
`
`input
`
`and
`
`to
`
`the
`
`processing
`
`the
`
`received
`
`data
`
`and
`
`for
`
`rendering
`
`an
`
`image
`
`display
`
`for
`
`corresponding
`
`to
`
`the
`
`data
`
`received;
`
`a touch
`
`screen
`
`for
`
`enabling
`
`a user
`
`to
`
`interact
`
`with
`
`the
`
`device;
`
`wherein:
`
`the
`
`software
`
`is
`
`operative
`
`to
`
`enable
`
`the
`
`user
`
`to
`
`select
`
`through
`
`a touch
`
`location
`
`on
`
`the
`
`touch
`
`screen
`
`a portion
`
`of
`
`the
`
`image,
`
`when
`
`displayed
`
`at
`
`a first
`
`scale,
`
`for
`
`rendering
`
`the
`
`selected
`
`portion
`
`on the
`
`display
`
`at
`
`a second
`
`scale
`
`larger
`
`than
`
`the
`
`"first
`
`scale;
`
`" and,
`
`thereby
`
`facilitating
`
`a selection
`
`of
`
`a feature,
`
`PHUS000173US2-AMT-082510
`
`.doc
`
`3
`
`GOOGLE EX. 1013 - 00006
`
`Google v. Philips
`
`

`
`the
`
`selected
`
`portion
`
`when
`
`rendered
`
`at
`
`the
`
`first
`
`scale
`
`is
`
`a
`
`zoomed-in
`
`version
`
`of
`
`part
`
`of
`
`the
`
`image
`
`at
`
`the
`
`first
`
`scale
`
`substantially
`
`centered
`
`around
`
`the
`
`touch
`
`[screen]
`
`location.
`
`7 .
`
`(New)
`
`The
`
`handheld
`
`communication
`
`device
`
`as
`
`claimed
`
`in
`
`claim
`
`1,
`
`wherein
`
`the
`
`data
`
`processing
`
`system
`
`is
`
`further
`
`operative
`
`to
`
`cause
`
`a
`
`window
`
`containing
`
`the
`
`selected
`
`portion
`
`displayed
`
`at
`
`the
`
`second
`
`scale
`
`to
`
`scroll
`
`across
`
`the
`
`image
`
`such
`
`that
`
`a new selected
`
`portion
`
`of
`
`the
`
`image
`
`is
`
`displayed
`
`at
`
`the
`
`second
`
`scale.
`
`PHUS000173US2-AMT-082510
`
`.doc
`
`4
`
`GOOGLE EX. 1013 - 00007
`
`Google v. Philips
`
`

`
`REMARKS
`
`The
`
`claims
`
`have
`
`been
`
`amended
`
`to more
`
`clearly
`
`define
`
`the
`
`subject
`
`invention
`
`as disclosed
`
`in
`
`the
`
`written
`
`description.
`
`In
`
`particular,
`
`claims
`
`1 and
`
`6 have
`
`been
`
`amended
`
`to
`
`correct
`
`a same
`
`typographical
`
`error
`
`in
`
`each
`
`claim.
`
`These
`
`typographical
`
`errors
`
`arose
`
`during
`
`a transcribing
`
`of
`
`the
`
`claims
`
`in
`
`an Amendment
`
`filed
`
`on May
`
`13,
`
`2002.
`
`In
`
`addition,
`
`new claim
`
`7, depending
`
`from claim
`
`1, has
`
`been
`
`added
`
`and claims
`
`additional
`
`features
`
`of
`
`the
`
`invention.
`
`Applicant
`
`submits
`
`that
`
`the
`
`changes
`
`to claims
`
`1 and 6 find
`
`the
`
`at
`
`lines
`
`4-15,
`
`which,
`
`in
`
`part,
`
`support
`
`in
`
`specification
`
`col.
`
`states
`
`"...a
`
`zooming-in
`
`on
`
`that
`
`part
`
`4,
`
`of
`
`centered
`
`around
`
`the
`
`touch
`
`location."
`
`the
`
`page
`
`image
`
`that
`
`is
`
`Applicant
`
`further
`
`submits
`
`that
`
`claim
`
`7 is
`
`supported
`
`by
`
`the
`
`specification,
`
`i.e.,
`
`U.S.
`
`Patent
`
`Application
`
`Serial
`
`No.
`
`09/062,364,
`
`filed
`
`April
`
`17,
`
`1998,
`
`on page
`
`6,
`
`lines
`
`1-4
`
`(now U.S.
`
`Patent
`
`6,211,856,
`
`col.
`
`3,
`
`lines
`
`16-19),
`
`which
`
`was
`
`incorporated
`
`by
`
`reference
`
`into
`
`the
`
`subject
`
`application.
`
`Attached
`
`hereto
`
`is
`
`a Statement
`
`of
`
`the
`
`Status
`
`of Claims.
`
`PHUS000173US2-AMT-082510
`
`.doc
`
`5
`
`GOOGLE EX. 1013 - 00008
`
`Google v. Philips
`
`

`
`Applicant
`
`believes
`
`that
`
`this
`
`application,
`
`containing
`
`claims
`
`1-7,
`
`is
`
`now in
`
`condition
`
`for
`
`allowance
`
`and
`
`such
`
`action
`
`is
`
`respectfully
`
`requested.
`
`Respectfully
`
`submitted,
`
`/Edward W. Goodman/
`by
`Edward W. Goodman,
`Reg.
`Attorney
`Tel.:
`
`914-333-9611
`
`28, 613
`
`PHUS000173US2-AMT-082510
`
`.doc
`
`6
`
`GOOGLE EX. 1013 - 00009
`
`Google v. Philips
`
`

`
`STATUS OF CLAIMS
`
`Amended
`
`Col.
`
`4,
`
`lines
`
`4-15
`
`Pending
`
`Pending
`
`Pending
`
`Pending
`
`Amended
`
`New
`
`Col.
`
`Col.
`
`4,
`
`1,
`
`lines
`
`4-15
`
`lines
`
`4-8
`
`and
`
`66-67
`
`(referencing
`
`U.S.
`
`Patent
`
`6,211,856,
`
`col.
`
`3,
`
`lines
`
`16-19)
`
`1.
`
`2 .
`3 .
`4 .
`5.
`6.
`
`7.
`
`PHUS000173US2-AMT-0
`
`82510
`
`.doc
`
`7
`
`GOOGLE EX. 1013 - 00010
`
`Google v. Philips
`
`

`
`(12) United
`Van Ee
`
`States Patent
`
`(54)
`
`HAND-HELD
`GRAPHICAL
`
`FOR
`WITH AUTO-ZOOM
`DISPLAY
`OF WEB PAGE
`
`(75)
`
`Inventor:
`
`(73)
`
`Assignee:
`
`( * )
`
`Notice:
`
`Jan Van Ee, San Jose, CA (US)
`Electronics N.V.,
`
`Koninklyke
`Eindhoven
`
`Philips
`(NL)
`
`on a continued
`This
`pros-
`issued
`patent
`37 CFR
`filed
`under
`ecution
`application
`1.53(d), and is subject
`to the twenty
`year
`35 U.S.C·
`patent
`provisions
`of
`term
`154(a)(2).
`
`to any disclaimer,
`the term of
`Subject
`is extended
`or adjusted
`under
`patent
`U.S.C. 154(b) by 0 days.
`.
`.
`is subject
`patent
`This
`claimer.
`
`to a terminal
`
`this
`35
`
`.
`dis-
`
`Appl. No.: 09/619,426
`Jul. 19, 2000
`
`Filed:
`
`Prior
`
`US 2002/0030699
`
`Data
`Publication
`Al Mar. 14, 2002
`
`Related U.S.Application
`
`Data
`
`(21)
`
`(22)
`
`(65)
`
`(63)
`
`(51)
`
`IHillHilllllllilllllillljliglgllllillllillllilllll
`US 6,466,203 B2
`*Oct. 15, 2002
`
`(10) Patent No.:
`(45) Date of Patent:
`
`(52) U.S.Cl.
`........................................345/173;
`345/835
`.................................
`(58)
`345/169, 172,
`Field
`of Search
`345/173,
`179, 348, 666, 864, 698, 783,
`784, 670, 671, 156, 157, 835
`
`(56)
`
`Cited
`References
`U.S. PATENT DOCUMENTS
`
`*
`4/1995
`A
`5,406,307
`*
`5,596,346 A
`1/1997
`5,854,624 A * 12/1998
`* 10/1999
`5,969,706 A
`6,104,334
`A
`4/2000
`6,211,856 B1 *
`4/2001
`
`•
`
`..........345/120
`et al.
`Huayama
`Leone et al. ................ 345/127
`.........................345/169
`Grant
`et al. ...........345/130
`Tanimoto
`.......................341/175
`Allport
`Choi et al. ..................345/666
`
`* cited
`
`by examiner
`
`Shalwala
`Examiner-Bipin
`Primary
`M. Said
`Examiner--Mansour
`Assistant
`(74) Attorney,
`Agent,
`or Firm-Jeroen
`
`Heuvelman
`
`(57)
`
`ABSTRACT
`
`screen. The
`A mobile
`a touch
`with
`has a display
`phone
`a Web page
`of
`and is capable
`has a browser
`retrieving
`device
`in its entirety.
`is first displayed
`from the Internet.
`The page
`and
`The
`user
`the page's
`lay-out
`can
`recognize
`general
`a particular
`presence of hyperlinks. When the user touches
`location
`on the touch screen that corresponds
`to a portion of
`the page's
`image,
`gets displayed
`so as to fill
`the
`the portion
`display's
`area. Thus,
`the user can browse
`the Web with
`a
`display
`limited
`size.
`
`of
`
`Continuation-in-part
`Apr. 17, 1998.
`Int. Cl.7 .....................
`
`of application
`
`No.09/062,364,
`
`filed on
`
`........................G09G 5/00
`
`6 Claims,
`
`1 Drawing
`
`Sheet
`
`1.00
`
`1.02
`
`LCD
`104
`TOUCH
`SCREEN
`
`HANDHELD
`
`1_06 RAM
`112
`FRAME
`BUFFER
`
`1
`
`(
`
`PROCESSOR
`
`WIRELESS
`MODEM
`
`13
`ROM
`PROGRAMS
`BROWSER
`FONTS
`SETTINGS
`AUTO-200M
`SOFTWARE
`
`1L6
`
`INTERNET
`
`GOOGLE EX. 1013 - 00011
`
`Google v. Philips
`
`

`
`U.S.Patent
`
`oct.15,2oo2
`
`US 6,466,203 B2
`
`100
`
`12
`
`HANDHELD
`
`LCD
`104
`TOUCH
`SCREEN
`
`1_06 RAM
`112
`FRAME
`BUFFER
`
`<
`108
`PROCESSOR
`
`WIRELESS
`MODEM
`
`>
`
`110
`ROM
`PROGRAMS
`BROWSER
`FONTS
`SETTINGS
`AUTO-ZOOM
`SOFTWARE
`
`M
`
`116
`
`INTERNET
`
`RG.1
`
`GOOGLE EX. 1013 - 00012
`
`Google v. Philips
`
`

`
`US 6,466,203 B2
`
`1
`
`FOR
`AUTO-ZOOM
`WITH
`HAND-HELD
`DISPLAY OF WEB PAGE
`GRAPHICAL
`RELATED
`APPLICATION
`
`.
`
`2
`Application
`International
`to published
`sponds
`This document
`relates to a graphical
`user
`for displaying
`screen
`device. The function
`
`controllable
`is displayed
`
`WO9954807.
`interface
`touch
`
`of an electronic
`functions
`as an icon and at a scale
`
`a p c
`
`co
`
`nua
`
`n-
`
`a t
`
`n
`
`5
`
`ssize in which
`
`the function
`
`is rSeco nizable by a omrabuntin
`
`INTERFACE
`USER
`ZOOM FEATURE
`
`TOUCH
`
`SCREEN WITH AUTO
`
`FIELD OF THE INVENTION
`(GUI),
`interfaces
`The invention
`relates
`to graphical
`user
`in particular
`to GUI's for devices with
`small
`a relatively
`screen real estate, such as handheld
`information
`appliances
`(palmtops, mobile
`phones, Web pads, PDA's
`or notebook
`etc.)
`computers,
`
`BACKGROUND
`
`ART
`
`be 1B
`that by 2002 there will
`Current
`indicate
`trends
`By 2004
`worldwide
`to mobile
`phones.
`there will
`subscribers
`in use than PC's. Mobile
`be more Mobile phones
`phones
`personal,
`phones,
`have
`become
`trusted
`devices.
`Mobile
`such
`by Philips Electronics,
`a the Genie manufactured
`typically
`have an LCD as part of
`the user interface
`and there is a trend
`provide
`an ever
`larger
`number
`of
`onboard
`software
`to
`services.
`digital
`such as personal
`devices,
`computing
`Hand-held
`(PDA), e.g., the PalmIIIx
`by 3COM
`manufactured
`assistants
`can be connected
`to the
`or a Windows
`CE-based
`handbeld,
`As
`a result,
`ubiquitous
`Internet
`via
`a wireless
`modem.
`has started to become
`information
`access via the Internet
`reality. Examples
`of a wireless
`modems are,
`for example,
`the
`by Novatel Wireless,
`Minstrel marketed
`and the Ricochet
`from Metricom.
`The Minstrel
`is a two-way
`wireless modem
`for a PDA that
`lets the user browse
`the Web and receive
`
`15
`
`20
`
`upon the
`the icon is provided
`least an area of
`of at
`version
`the icon. For example,
`the device
`the area of
`user touching
`alphanumeric
`keyboard.
`The softkeys
`dis-
`a Virtual
`has
`20 played
`are too small
`for
`the user
`to select an individual
`one
`them. Now, when
`in a
`of
`the user
`touches
`the keyboard
`the
`specific
`section
`that
`accommodates
`the desired
`key,
`the
`GUI magnifies
`that
`specific
`so that
`device's
`section
`key re-appears
`at a larger
`scale and can be selected.
`intended
`The inventor
`has realized
`that
`this feature,
`referred to as
`"auto-zoom",
`is not only
`useful within
`context
`of
`the
`a
`user-interface
`for control
`functionalities
`represented
`graphi-
`by
`icons.
`The
`cally
`auto-zoom
`is
`also
`relevant
`to
`the
`rendering
`of any kind of graphical
`information
`on a display
`too small
`for
`the total
`information
`content,
`given
`the dis-
`and size. For example,
`handheld
`informa-
`play's
`resolution
`tion processing
`devices with Internet
`access (browsers)
`and
`as PDA's,
`pads, mobile
`displays,
`such
`palmtops,
`web
`phones using, e.g., the WAP (wireless
`application
`protocol)
`etc., can be given
`25 technology,
`browsers
`for
`retrieving
`and
`web pages from the Internet,
`but
`they cannot
`navigating
`a page in its entirety without
`losing information.
`The
`render
`the page,
`lay-out
`and general
`appearance
`of
`the image of
`however,
`indicate whether
`may or may not be of
`portions
`to the user, e.g., as containing
`hyperlinks.
`interest
`handheld
`provided
`with
`the auto-zoom
`Such
`devices
`e.g., a
`retrieve
`let
`the user
`graphical
`information,
`feature
`is stored, e.g.,as a bitmap,
`web page or streamed video that
`in the display's
`framebuffer
`cache.
`or another
`
`30
`
`ew rael s mondem lhi
`It elaormR ocheentuparlovide tba 35
`tthhee
`handheld
`device with an IP address
`that can be used by any
`type of application
`that uses the Internet
`for communication
`(within
`limitations
`of
`throughput,
`latency
`and coverage).
`The Minstrel
`uses a technology
`referred
`to as Cellular
`Packet Data (CDPD)
`that
`by the cellular
`Digital
`is supported
`
`relates to an information
`the invention
`Accordingly,
`pro-
`cessing apparatus
`that has an input
`for
`data from
`receivmg
`e.g. the Intemet,
`a display,
`an external
`resource,
`and
`a data
`system. The system is connected
`to the input
`and
`processing
`o to the display. The system processes
`the data upon receipt
`on the display
`an image corresponding
`to the
`and
`renders
`
`e 2 8K-bp
`
`n e
`
`u 4tLiFsor
`
`n
`
`t
`
`r
`
`o e a e
`
`e
`
`te ec
`
`o
`
`e
`
`ron o
`
`medtroposlitan
`
`centers
`
`(the San Francisco
`
`Bay
`
`area, Seattle
`
`45
`
`ingm eec
`
`e
`
`taer
`
`reatdae
`
`e s lect d
`
`rtt n o
`
`the
`
`of PDA's
`the functionalities
`indicate
`further
`that
`Studies
`a
`and that
`phones
`have started
`to converge,
`and mobile
`mobile
`is developing.
`There will
`be an
`information
`society
`
`d scale
`dThe payrat a se
`screen. The
`invention
`graphical
`information
`
`larger
`scale (zoom-inc
`tdbanothelfirst
`the user
`the
`to perceive
`thus
`allows
`of
`the image regardless of
`the display
`
`emergmgIn
`
`hededicated
`
`devices
`
`PD
`
`are pnow whork-
`
`50
`
`the time. PDA's will get
`that stay with the user
`all
`computers
`more power
`and smaller
`size and accommodate
`more,
`and
`more versatile,
`functionalities.
`to be the factors
`Bandwidth
`and display
`size are believed
`of
`the handheld
`that
`limit
`the usability
`and practicality
`or a hybrid.
`In
`be it a mobile
`phone,
`a palmtop
`device,
`particular,
`the GUI
`to such
`and
`the
`services
`accessible
`handhelds
`are critical
`factors
`for
`the consumers'
`acceptabil-
`In particular,
`ity of such services.
`e-commerce
`or electromc
`
`etc., because the size of
`capabilities),
`clients with browsing
`small due to the required
`is necessarily
`a handheld's
`display
`form factor and weight
`The ubiquitous
`informa-
`limitation.
`for
`55 tion access
`via a browser
`is a great
`asset
`Internet-enabled
`handhelds
`(comprising
`a wireless modem),
`as not only
`text
`but also, e.g., still
`(e.g.,
`pictures
`jpeg),
`streaming
`pages
`(e.g., HTML)
`video,
`page with
`hyperlinks
`and java
`web
`are now within
`of
`devices whose
`animation
`reach
`these
`so screen real
`needs not be the limiting
`factor anymore.
`estate
`
`s
`terms
`
`gn naytbenefit
`of user-friendliness
`
`froymdtdhe ubis uhity of handhelds
`of
`the handheld
`devices.
`
`OF THE INVENTION
`SUMMARY
`Co-pending U.S.Ser.No.09/062,364
`(PHA23,387)men-
`tioned
`above
`and incorporated
`herein
`by reference,
`corre-
`
`in the invention
`
`The apparatus
`levels.
`The term "texting"
`is currently
`of short
`65 sending
`and receiving
`phones. Many service
`providers
`send short
`text messages
`(SMS:
`
`can have
`
`one or more
`
`zoom
`
`to the
`being used to refer
`text messages using mobile
`allow users to key in and
`short messaging
`service).
`
`GOOGLE EX. 1013 - 00013
`
`Google v. Philips
`
`

`
`US 6,466,203 B2
`
`5
`
`4
`the Web, and
`to navigate
`the user
`for enabling
`for processing
`the graphical
`data as explained
`
`3
`in Europe
`application
`and East Asia seem to have embraced
`Teenagers
`just as young people in the U.S. have gone
`the software
`this technology,
`herein.
`for
`live chat
`instant messaging
`the Internet.
`and
`on
`The
`in U.S, Ser. No. 09/062,364
`(PHA 23,387)
`114
`via modem
`has retrieved
`When the user
`invention
`page
`a web
`on LCD 102 in its entirety. Due to
`phone's GUI.
`the page gets displayed
`improves
`the user-friendliness
`of
`the mobile
`the scale size of LCD 102 individual
`hyperlinks
`or
`text
`The
`invention
`of
`the auto-zoom
`extended
`to cover
`the
`fragments may not be well discernible,
`although
`the lay-out
`rendering
`of arbitrary
`graphical
`information
`further
`broad-
`to
`of
`the page conveys
`sufficient
`information
`to the user
`ens the scope of applicability
`of data processing
`handhelds,
`determine what portion of the page may be relevant. Assume
`in the field of consumer
`especially
`electronics
`(CE)-
`right hand corner of the page.
`10 that
`the portion
`is the upper
`inven-
`Screenphones may also benefit
`from the current
`tion. A screenphone
`When
`now touches
`104 in the associated
`is typically
`a wired
`terminal
`that has a
`the user
`screen
`this action gets translated by processor 108
`and a keyboard. The Internet
`location
`or area,
`small display monitor
`screen-
`of program memory 110 into a zooming-in
`rapidly. Analysts
`and under control
`phone market
`is expanding
`predict
`rev-
`as over $2 B by 2002. The
`on that part of
`the page image that
`is centered
`around
`the
`enues in this market
`segment
`e.g., by a pre-
`success of
`the Minitel
`system in France has triggered
`the 15 touch
`location.
`This
`can be implemented,
`area into, say,
`introduction
`of screenphones
`elsewhere by banks to promote
`determined
`segmentation
`of
`the display
`four
`home banking
`and shopping.
`can
`selected
`for
`the
`zooming-in.
`be
`areas
`that
`each
`Alternatively,
`part of
`the original
`that
`image
`gets magnified
`that has a center
`the touch
`location.
`coinciding
`with
`
`BRIEF
`
`DESCRIPTION
`
`OF THE DRAWING
`
`by way
`in further
`detail,
`below
`is explained
`The invention
`drawing
`of example and with reference to the accompanying
`with a block diagram of a handheld
`device in the invention.
`
`DETAILED
`
`EMBODIMENTS
`
`20
`
`to, among
`above,
`As specified
`other
`relates
`the invention
`idea in U.S. Ser.
`things,
`extending
`the autozoom keyboard
`No. 09/062,364
`or displayable
`to any kind
`of graphical
`in its
`displayed
`information,
`when the information
`cannotbe
`For example,
`displaying
`a web
`page with
`entirety.
`hyper-
`links on a mobile
`phone,which
`has a small LCD with touch
`screen functionality,
`render
`the user-interaction
`with the
`may
`links
`if possible
`at all, due to their
`size. The
`cumbersome
`LCD can nevertheless
`display
`the web page in its entirety
`by
`scaling
`it down. This initial
`rendering
`upon retrieval
`of
`the 35
`page
`from the Internet may
`very well
`cause
`the page
`illegible.
`However,
`filtering
`of
`down image
`proper
`the scaled
`ensures
`that
`the user
`can still
`recognize
`screen
`areas of
`potential
`interest
`and the hyperlinks
`therein. When the user
`the e
`the screen,
`the portion
`of
`the image underneath
`touches
`touched location
`is enlarged and displayed
`so that hyperlinks
`a next, similar
`can be individually
`be selected,
`possibly
`after
`process.
`zoom-in
`FIG. 1 is a block
`of an
`diagram with main components
`100 in the invention.
`100 is,
`for
`Apparatus
`apparatus
`example,
`a mobile
`phone or a palmtop
`PC with
`Internet
`access.Apparatus
`100 comprises
`a display 102 for display
`of
`screen 104 for user-
`a graphical
`information,
`and a touch
`102 comprises,
`e.g.,
`interaction
`with the apparatus. Display
`an LCD. Touch screen 104 is, for example,
`a resistive
`tablet.
`For more
`background
`on
`such
`input
`devices,
`see,
`for
`example, U.S. Pat. Nos. 5,402,151;
`5,231,381;
`5,777,607
`and 5,767,458
`of Philips Electronics,
`all
`incorporated
`herein
`by reference. LCD 102 and touch screen
`104 are physically
`integrated.
`Apparatus
`100
`comprises
`a random-access
`108, and a program
`memory
`106, a microprocessor
`memory
`110 (e., an EEPROM). A portion of memory
`106 comprises
`a frame buffer 112. Frame buffer 112 is coupled
`to display
`102 and stores
`the information
`content
`shown on display
`102. Memory
`106 stores
`are mapped
`bitmaps
`that
`onto
`display 102 via frame buffer 106 under control of a software
`108. Microprocessor
`108
`bit-blitter
`run on microprocessor
`via touch screen 104 and translates
`receives
`the
`user-input
`into associated GUI actions via frame buffer 112 under
`input
`the program memory 110. Handheld
`100 com-
`control
`of
`to Internet 116.
`prises a wireless modem 114 for connecting
`Program memory 110 stores, among other
`things, a browser
`
`45
`
`102
`104 causes
`display
`screen
`touch
`with
`User-interaction
`to undergo a change in appearance. The change is preferably
`effected
`through
`animation.
`Animation
`is the simulation
`of
`by displaying
`a series
`of pictures,
`or
`movement
`created
`frames, e.g., bitmaps. For example,
`an image of
`the original
`in the zoomed in version of
`the area
`develops
`25 page gradually
`selected.
`Through
`the animation,
`the user perceives
`the
`from one
`to the other
`as a continuous
`development
`unage
`is created of a gradually
`transition.
`The impression
`changing
`Thus,
`30 lay-out.
`the animation
`avoids
`impression
`of
`the
`an
`confrontation
`with
`that
`requires
`abrupt
`a new
`lay-out
`the
`him/herself.
`The animation
`is effected
`user
`to re-orientate
`in memory
`106
`through
`proper
`processing
`of
`the bitmaps
`and frame buffer 112.
`herein are the following:
`by reference
`Incorporated
`U.S.Ser. No. 09/062,364 (attorney
`docket PHA 23,387)
`17, 1998
`filed Apr.
`for Sung Choi
`Jan van Ee for
`and
`GRAPHICAL
`USER
`INTERFACE
`TOUCH
`SCREEN
`WITH AUTO ZOOM FEATURE. This document
`relates to
`a graphical
`user
`interface
`screen for displaying
`touch
`con-
`trollable
`functions
`of an electronic
`device. The function
`is
`as an icon and at a scale size in which
`displayed
`the function
`is recognizable
`by a user but
`small
`to easily
`too
`access
`the function. A magnified
`of
`version
`features
`of at
`least
`an
`area of
`the icon is provided
`upon the user
`touching
`the area
`of
`the icon.
`U.S.Ser. No. 09/128,839 (attorney
`docket PHA 23,469)
`filed Aug. 4, 1998 for Jan van Ee for REMOTE
`CONTROL
`HAS ANIMATED
`GUI. This document
`to a remote
`relates
`for
`of equipment
`50 control
`device
`remote
`control
`such
`as a
`home theater. The remote has a display
`for display
`of a GUI
`that
`enables
`a user
`interact with
`device.
`to
`the
`User-
`the device
`the GUI
`to undergo
`interaction
`with
`causes
`change in appearance. The change is effected
`through
`ani-
`ss mation. Animation
`is the simulation
`of movement
`by
`created
`frames, e.g., bitmaps.
`displaying
`a series
`of pictures,
`or
`For
`example,
`a panel with clustered
`control
`options
`slides out of
`view and a next one slides into view, or displayed
`icons slide
`to new positions
`while
`new icons appear, etc. Through
`the
`60 animation,
`the user
`perceives
`the development
`from one
`panel
`to the other as a continuous
`transition.
`The impression
`is created
`of a gradually
`changing
`lay-out,
`of scrolling
`panels, of sliding,
`rotating,
`expanding
`or contracting
`icons,
`etc. Thus,
`the animation
`avoids the impression
`of an abrupt
`65 confrontation
`with a new lay-out.
`U.S.Ser. No. 09/427,821 (attorney
`filed Oct. 27, 1999 for Joost Kemink
`
`a
`
`docket PHA 23,786)
`and Richard Sagar
`for
`
`GOOGLE EX. 1013 - 00014
`
`Google v. Philips
`
`

`
`US 6,466,203 B2
`
`5
`FOR REMOTE
`MODEM
`PDA HAS WIRELESS
`CON-
`TROL VIA THE INTERNET.
`This document
`relates
`to a
`PDA combined
`with a wireless modem to enable remote
`control
`of CE equipment
`via the Internet
`and a local home
`server. More specifically,
`The wireless modem enables com-
`munication
`with
`a server
`via a data network
`such as the
`Internet. A control
`network
`is coupled
`between
`the server
`and controllable
`equipment.
`The handheld
`is now capable of
`functioning
`as a wireless
`remote
`control
`for
`device
`the
`equipment
`via the Internet
`and the server. The system may
`comprise
`a video camera together with hardware
`and soft-
`ware
`to create
`a formatted
`image
`for being
`still
`suitable
`displayed
`on the handheld
`device. The user can now instruct
`retrieval
`of a still
`image from the server via the Internet. This
`serves as, e.g.,a security
`application
`system that enables the
`to monitor
`his/her
`front porch, or
`to monitor
`remote
`user
`a
`by way
`child
`of
`a remote
`(or
`fall-back)
`baby-stt.
`The
`
`sfe
`b
`capabilities
`and monitoring
`is:
`What
`is claimed
`1. A handheld
`communication
`for
`a wireless
`modem
`receiving
`
`ent
`a
`a dntth
`e
`for a mobile user.
`
`e
`
`device comprising:
`data;
`
`in 25
`
`for
`
`small size suitable
`that has a substantially
`a display
`device;
`the handheld
`commumcation
`a data processing
`system connected
`to the modem and to
`the display
`for processing
`the received
`data and for
`rendering
`an image corresponding
`to the data received;
`a touch screen
`for enabling
`a user
`to interact with the
`device;
`wherein:
`is operative
`through
`to select
`the user
`to enable
`the system
`of
`the
`screen a portion
`on the touch
`a touch location
`image, when displayed
`at a first scale,
`rendering
`for
`the
`
`5
`
`10
`
`is
`
`20
`
`30
`
`6
`at a second scale larger
`on the display
`portion
`selected
`than the first scale thereby
`facilitating
`a selection
`of a
`feature;
`and
`the first scale is a
`at
`the selected
`portion when rendered
`zoomed-in
`version of part of
`the image at the first scale
`centered around the touch
`screen.
`substantially
`2.The device of claim 1, wherein
`a position
`of
`the touch
`location
`is arbitrary
`with respect
`to the touch screen.
`3. The device of claim 1, comprising
`a browser.
`4.The device of claim 1, having wireless
`access.
`Internet
`5. The
`of claim 1, wherein
`comprises
`device
`the data
`video.
`streaming
`6. Software
`for being installed
`cation
`device comprising:
`receiving
`a wireless modem
`for
`a display
`that has a substantially
`the handheld
`communication
`
`on a handheld
`
`communi-
`
`data;
`small size suitable
`device;
`
`for
`
`in
`
`and to the
`to the input
`connected
`system
`a data processing
`data and for ren-
`for processing
`the received
`dis