United States Patent [191
`Hube et al.
`
`I llll I llll llll Ill Ill II Ill II Ill II 1111111111111111111111111111111111111111111
`US005 I 19079A
`[1 I] Patent Number:
`[45] Date of Patent:
`
`5,119,079
`Jun.2, 1992
`
`[54] TOUCH SCREEN USER ll\'TERFACE WITH
`EXPANDING TOUCH LOCATIONS FOR A
`REPROGRAPHIC MACHINE
`
`[75]
`
`Inventors: Randall R. Hube, Rochester; Craig
`W. Jacobs, Fairport; William J.
`Moon, Marion, all of N.Y.
`
`[73] Assignee: Xerox Corporation, Stamford, Conn.
`
`[21] Appl. No.: 583,923
`[22] Filed:
`Sep. 17, 1990
`Int. a.s ............................................... G09G 3/02
`[51]
`[52] U.S. Cl ...................................... 340/712; 340/731
`[58] Field of Search ............... 340/712, 706, 731, 721,
`340/723; 178/18, 19; 382/47
`
`[56]
`
`References Cited
`U.S. PATENT DOCUMENTS
`4,267,443 5/1981 Carroll et al. ....................... 250/221
`4,299,041 11/1981 Wilson ............................... 40/124.1
`4,310,839 1/1982 Schwerdt ............................ 340/712
`4,332.464 6/1982 Bartuus et al. .................... 355/i4 C
`4,587,520 5/1986 Astle ................................... 340/712
`4.587.630 5/1986 Straton et al. ...................... 364/900
`4.686.332 8/1987 Greanias et al. ...................... 178/19
`4,755,811 7/1988 Slavin et al. ........................ 340/731
`
`4,821,030 4/1989 Batson et al. ....................... 340/712
`Primary Examiner-Alvin E. Oberley
`Assistant Examiner-Xiao Min Wu
`Attorney, Agent, or Firm-Mark Costello
`
`.ABSTRACT
`[57]
`A touch sensitive user interface of the type having a
`display screen for displaying an image; control logic
`responsive to the touch sensitive user interface for de(cid:173)
`termining the contact position of a probe, such as a
`finger, thereon; a display menu of operating features,
`represented by a plurality of images on the display
`screen, so that a user may make touch selections on the
`images corresponding to operating features desired; a
`system controller for identifying a contact zone of a
`predetermined size with respect to the display screen,
`the control logic actuating the feature within the system
`represented by a displayed image in response to user
`touch within a corresponding contact zone, the system
`controller enlarging the contact zone of a selected fea(cid:173)
`ture upon selection thereof, to a size accommodating a
`probe tip, without overlapping on adjacent areas and
`upon completion of option selection, returning the ex(cid:173)
`panded contact areas to said predetermined size.
`
`6 Claims, 13 Drawing Sheets
`
`I
`I
`\
`
`I
`
`' ... _
`' ' ... ... _
`,,
`,,
`"
`"
`"
`"
`"
`,,"-...
`,, '"''
`,,,. ,,
`,,
`,,"
`,,"
`, ... ,,"
`
`/
`
`"
`
`x
`
`301
`
`302
`
`303
`
`304
`
`'
`'
`
`\
`
`'
`
`\
`
`'
`
`'
`'
`'
`',
`'
`MENU ITEM4
`',
`'
`'
`~--------. '-----------)
`,1
`\
`"
`310' ' 1 TOUCH ZONE 1 1
`',
`,, ,, ,
`/
`~\
`,,
`'
`\
`J,.
`'
`.,
`'
`i,_...;.,
`"-
`\
`-t - ~~~~~~~ ... - \ ' ,, .... -
`\
`-~ - ~~,,~~.,. ..
`x+e ~!~\I.CH ZONE!
`',
`1 "
`',
`I 311'
`,--.J
`\
`, _______ ..., __ _
`', 312' 1 TOUCH Z~NE 3 1
`'
`I
`'
`I
`I
`I
`.
`'
`' , 1 TOUCH ZONE'~ v-----.313•
`'I
`'I
`------------~
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`U.S. Patent
`
`June 2, 1992
`
`Sheet 1of13
`
`S,119,019
`
`ID
`
`~ f')
`
`~ ~
`-
`
`"° "°
`
`... •
`-u..
`
`\!)
`
`NI
`
`COi
`
`~ ~
`
`c
`0
`N
`
`~\
`~
`c
`N
`
`N '
`
`N "°
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`52
`
`USER
`INTERFACE
`
`25
`
`50
`
`72,____,__~
`
`74
`
`PLATEN
`
`20
`
`CCD
`
`AGC
`PWB
`
`PROCESSOR
`
`24
`
`11
`I.
`
`'
`t 1
`:1
`
`I
`I
`I
`I
`t
`I
`I
`
`:
`
`rz
`r~
`r~
`r---------------------,r---------------------------,r---------------,
`'I
`SCANNER
`CONTROLLER
`:
`PRINTER
`I
`I
`I
`I
`I
`I
`I
`I
`I
`60 I
`I
`I
`11
`IMAGE
`t I
`OUTPUT ...._...-t•I
`CONTROL
`11
`II
`I
`I
`I
`I
`I
`:
`t
`
`~ •
`rJJ.
`•
`""d
`~
`
`~ n> = ~
`
`c:... s ('D
`
`~
`
`"'"" '° '° N
`
`('D
`
`r:J'1 =(cid:173)
`('D -N
`
`0 .....
`"'"" <,,.)
`
`...
`U1
`~
`~
`...
`\0
`0
`.....J
`\0
`
`107
`
`87
`
`PAPER
`SUPPLY
`
`120
`
`FINISHER
`
`95
`
`I
`
`,, I PRINT
`
`IMAGE
`INPUT
`CONTROL
`_ _ _ _ _
`COMP.
`I
`51 __,
`
`IMAGE
`MANIPU-
`LATION
`
`SYSTEM
`CONTROL
`
`54
`
`DISK
`
`56
`-
`
`58
`
`90-1,-2,-3
`
`FIG. 2
`
`II MODULE
`1
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I I
`: ;
`I
`I
`ti
`I
`I
`I
`__ _____________ ____ ___ J __________________ __ __ __ ___ _ ___ _ ___ _ __ _ ___ _ _ J
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`U.S. Patent
`
`June 2, 1992
`
`Sheet 3 of 13
`
`5,119,079
`
`"ill \
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`U.S. Patent
`
`June 2, 1992
`
`Sheet 4 of 13
`
`5,119,079
`
`q
`
`'\ \ \
`' \
`\
`
`\
`
`\ \
`
`,
`I
`\ \i
`J
`\ ~,
`----P
`--!---------,-~~
`~-J
`~
`\ !
`I
`\ I
`
`I
`
`I
`
`I
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`SYSTEM
`MEMORY
`
`MEMORY
`CONTROLLER
`
`.(54
`
`FIG. SA
`
`MEMORY BUSA
`
`..c_71
`
`- 70-9
`
`- 70-1
`
`- 70-10
`
`To
`FIG
`SB
`
`f'C61
`--
`______ I_L ___ 1 ______ -'--·~-----------------------L ___________ ---------~
`~
`c 88 i !
`!
`.~ / 78 i !
`!
`I
`'I
`I
`J__
`I .
`'
`j I MEMORY BUS
`I
`'j ARBITRATION
`! ·
`LOGIC
`1 I
`
`BOOT
`DOWNLOAD
`CONTROL
`LOGIC
`
`CHANNEL
`LOADER/
`SCHEDULER
`PROCESSOR
`
`ETHERNET
`PROCESSOR
`
`.I
`I j
`j •
`SYSTEM
`· I PROCESSORS
`! j
`I'
`L------------
`ff!_
`
`I
`
`I
`
`DISPATCHER
`PROCESSOR
`BUSA
`
`89
`
`DISPATCHER
`PROCESSOR
`BUSB
`
`I
`I
`I
`I
`
`I
`·---
`
`---' _____ J
`I-
`
`PRINTER J
`
`BOOT BUS
`PROCESSOR
`
`-----------------
`
`-----------~----------------
`
`MEMORY BUS
`ARBITRATION
`CONTROL
`LINES
`TO EACH
`CHANNEL
`PROCESSOR
`. '---------'
`I
`86
`I
`I
`I
`IMAGE
`•
`I GENERATOR
`!~'
`I PROCESSORS
`'-----~ 170-8
`
`MEMORY BUSB L14
`. - -- --f---. I
`·----- ----,
`~ . I
`I
`·
`IMAGE
`J. GENERATOR
`1°
`I PROCESSORS
`70-7;
`
`86
`
`I
`·
`!
`I
`
`BOOT
`CONTROL
`DATA LINES
`TO EACH
`CHANNEL
`PROCESSOR
`
`BOOT BUS
`
`To
`FIG,.
`SB
`
`~ •
`rJ'J.
`•
`~
`~
`f"+(cid:173)
`
`('D = f"+-
`
`~ = = ('D
`~
`.....
`'° ~
`
`('D
`
`Cl'l =(cid:173)
`('D -(IJ
`0 ...
`.....
`
`CH
`
`...
`01
`1-l
`1-l
`...
`\0
`0
`......,J
`\C
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`FIG. 58
`
`From
`,, FIG
`SA
`
`MEMORY BUSA
`
`_e72
`
`~ 70-2
`
`I
`
`I
`
`t
`
`1
`
`~
`u•
`I COMMUN!
`CATIONS
`CONTROLLER
`
`.
`
`J
`1 1
`... 1
`I I __ ...... _ ... I I
`I ,..; .. -.-~~--;~.... I
`I
`l't
`~.ilVE
`'--··-ani 1 ~a
`CATIONS
`--··-"'ivi.i.cn
`'.I l'KU{.t~~UK I ~
`I
`.
`.
`~------------- ·-------·-- ----·--------------- --
`BOOT BUS
`* 1
`
`From
`FIG
`SA
`
`,
`
`MAINTENANCE
`PANEL
`
`STREAMING
`TAPE DRIVE
`
`USER
`I INTERFACE
`
`1. PORTABLE
`PRINTER
`PORT
`2. RS232 PORTS
`(RIC MODEM,
`TERMINAL,
`PERIPHERAL)
`
`.
`I
`
`80
`
`52
`
`~ 70-3
`
`_f __
`
`'
`
`!
`I COMPRESSION
`PROCESSOR
`! I
`!
`' - -
`
`SCANNER
`
`To
`FIG
`SC
`
`I
`
`1 I
`I
`
`Ii
`
`.
`I
`II
`
`I
`- ·
`
`H
`
`H
`
`I
`
`!
`
`PROCESSORS
`
`CONTROLLER
`PROCESSOR
`
`II
`
`II
`
`- ·---·-·t·-·--------
`t
`H un t
`-- - -
`IMAGE I SYSTEM I DISK DRIVE
`·-- s;- -·- 82-:--i- -·
`;J t
`c
`
`\_
`6
`
`TOP
`DISK
`
`1
`
`90-1
`
`~ •
`00.
`•
`~
`~
`""""
`
`('D = """"
`
`c. = = tD
`
`N
`
`~
`\0
`\0
`N
`
`tD ..
`00 =(cid:173)to
`°' 0 .....
`
`~ w
`
`U1
`-..
`~
`~
`\0
`-..
`0
`-:t
`\0
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`U.S. Patent
`
`June 2, 1992
`
`Sheet 7 of 13
`
`5,119,079
`
`FIG. SC
`
`72
`From
`MEMORY BUS A
`FIGt--~~~~--~~...;.;.,,;~~---~-.-~~~"'--~---
`58
`.-----·-·---
`' 1.-----'----.
`
`.- 70-5
`______ .1_ ___ ~
`
`I
`
`.-----'----.I
`
`DISK DRIVE
`CONTROLLER
`PROCESSOR
`
`PARAMETER
`BLOCK
`GENERATOR
`PROCESSOR
`
`82
`
`.- 70-4
`----------~ .----------- -·------L-~
`.-----'-~--.! !.------'----. .------------'
`
`I
`
`I
`
`_; ________ _
`.- 70-6
`
`1
`
`I
`
`IMAGE
`MANIPULATION
`PROCESSOR
`MASTER
`
`IMAGE
`MANIPULATION
`PROCESSOR
`SLAVE
`
`DISK DRIVE
`CONTROLLER
`PROCESSOR
`
`PARAMETER
`BLOCK
`GENERATOR
`PROCESSOR
`
`I
`
`·- . - -- -- . /- -- . - -- . - -- . - --·
`58_/
`
`I
`
`I
`-----
`
`DISK
`
`82
`
`90-2
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`EON CORE
`
`I '\
`130
`
`140
`
`- 140
`
`142 I
`
`142
`
`~ ~ FBNCORE
`142 r1 PHN CORE I 114
`I MIN CORE 11~2
`I ~ - -' h
`'--
`I
`
`I - 147
`
`Ff ADA #1 I'
`
`L: •
`00
`•
`=
`""d
`t'D = f"'1'.
`
`f"'1'.
`
`136
`
`('!)
`
`§
`.!"
`~
`
`1oo&
`
`N
`
`00 =-
`~
`-oc
`0 .....
`~
`
`...
`U1
`~
`~
`...
`\0
`0
`-l
`\0
`
`TO/FROM
`
`CONTROLLER I
`
`FIG. 6
`
`\
`138
`
`010#1
`
`138
`
`-o,o #2
`
`I
`
`010#2
`
`I
`
`jL_
`010 #6 I
`
`rT
`
`I
`
`f- - J
`010#3
`
`I
`
`I
`
`138
`
`-n 010#1
`I
`
`•
`
`::5 - 010 #3
`
`I
`
`AOA:l
`
`138
`
`010 #1
`
`I
`
`SLB ROR
`
`REG. SERVO
`
`FBIOP
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`tm JOB PROGRAM ~] m
`
`rr !s!rll!ll]
`
`[ID
`
`240
`
`240
`
`240
`
`PAGE LEVEL
`
`COVERS
`
`Job Typn & Tickets
`
`JOB: Sblnd•rd
`1
`DUAULI
`
`152
`
`JOB Scoreaird
`
`Job Identification
`
`1
`
`~ {[]IDlfAuu
`
`62
`
`D.-tination
`
`Iii] Prlnl -~"
`
`Qu•ntity
`
`(olBIPd
`
`Output fjl !>teckPr
`DJ""
`
`Page Numbering
`
`FIG. 7
`
`llmB Job Ticket for:
`
`J ... lypP: StMldMd
`Pa"' lpvrl:
`JolilPttl - - -
`Basic
`Job ldentificmtion-: - - - D~nt Dl'HJption:
`............
`
`ll.!>x11.0
`
`P•puStock:
`
`DlfAUl 1
`Destin•tion:
`
`Print• Deleu
`
`Quantity:
`
`Output:
`
`........ .,,
`<...,.rd
`
`l.5xH.0
`Stand"rd
`Whllr
`Rl'ducl' I Enl•rge-: -
`
`100,
`Sides Imaged:
`
`, + ,
`
`Page Numbering:
`
`Image Quality:
`
`Off
`
`Restore
`Defaults
`
`Q
`
`stenderd
`Sh"'P""" On
`
`Printer
`Options
`
`Interrupt
`
`(El fD
`
`150
`
`Account: DEFAULT
`
`P"9f'lPvPI;
`Sp~~------
`
`(;-op:--------
`on
`
`Clo1e
`
`D
`
`lov•rs: Off
`
`240
`
`240
`
`Off
`
`Mugl':
`Off
`
`Rotate:
`Off
`
`'
`
`Start Sain
`
`Stop
`Scan
`
`Stop
`Print
`
`[!] [!]
`
`Job
`
`162
`
`160~TI
`
`~ •
`rJJ.
`•
`""d
`~
`""'"'
`(D = ""'"'
`
`~ = = fl)
`
`~
`.....
`\0
`\0
`N
`
`fl)
`fl)
`
`rJJ =(cid:173)
`.....
`\0
`0 .....
`.....
`
`(JJ
`
`...
`tll
`~
`~
`...
`\0
`0
`-l
`\0
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`U.S. Patent
`
`June 2, 1992
`
`Sheet 10 of 13
`
`5,119,079
`
`Q) ...
`Q~"'
`~
`>~::~ Il~r-
`~- 1: 4 ~-i: -
`m _d_=r_ 'd -
`j.... -4 ~ -
`
`I- -4
`
`( ~ r-, }1 -
`
`I
`
`I
`
`I
`
`I
`
`Q) ...
`""
`
`Q "" ""
`
`'IO
`
`1'),
`
`w....J
`
`-<D
`
`-<D
`
`l
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`U.S. Patent
`
`June 2, 1992
`
`Sheet 11 of 13
`
`5,119,079
`
`FIG. 9
`
`301
`
`302
`
`303
`
`304
`
`I
`I
`\
`
`I
`\
`
`\
`_,-'
`
`'
`',
`'
`'
`'
`'
`'
`'
`'
`'
`'
`'
`
`' .... _
`' .... .... _
`.,
`"' "
`" "
`\ ,, '
`"
`,." -.....
`,,
`"'
`,."
`.,
`,,,1
`"
`"
`.,
`,....
`"
`.,
`"
`"
`,."
`.,.,.....
`"
`"'
`'
`"'
`\
`' '
`~- \
`.,
`~
`\
`I
`' ., "
`'' •,
`'''
`' .... -"'
`'
`' -~
`' '
`I TQUCH ZONE 1 i 310
`),---------~
`1---~------·
`I TOU(:t:i,ZONE 2 i
`317
`1-----~----·
`I TOUCH ZONE 3 v- 312
`' ,
`'' 1--------~-~
`' , I TOUCH ZONE ~, v- 313
`J __________ ~
`
`MENU ITEM 1
`
`MENU ITEM 2
`
`MENU ITEM 3
`
`MENU ITEM 4
`'
`'
`'
`'
`' ,
`
`',
`
`' ,
`
`'
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`U.S. Patent
`
`June 2, 1992
`
`Sheet 12 of 13
`
`5,119,079
`
`FIG. 10
`
`I
`I
`\
`
`' .... _
`' ... .... _
`,
`"
`
`x
`
`'
`
`'
`
`'
`
`'
`
`'
`
`301
`
`302
`
`303
`
`304
`
`',
`'
`
`'
`
`'
`
`I
`\
`
`/
`
`/
`
`/
`
`/
`
`/
`,"-...
`,,,, ,
`/
`"
`"/
`"
`\ \,'
`........ ,'
`/
`,,,"
`
`/"
`
`',
`'
`',
`MENU ITEM 4
`'
`'
`~-----........ '-----------)
`/
`'
`'
`I
`310' ' 1 TOUCH ZONE 1 1
`'
`, ' ,
`~'
`"
`j..
`\
`\
`b_~:
`"
`"
`\
`\
`-f - ~~~~~~"-,, .... , , '
`x+e ~!~\l.CHZONEi
`',
`1,/
`', _i_~~~~~~;
`I 311'
`'
`,.-...J
`'
`, _______ .., __ _
`', 312' 1 TOUCH Z~NE 3 1
`'
`'
`I
`'
`I
`I
`I
`'
`..._ __________ ~
`', t TOUCH ZONE'4 ~13•
`'I
`'I
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`U.S. Patent
`
`June 2, 1992
`
`Sheet 13 of 13
`
`5,119,079
`
`410
`
`PROBE
`DETECTED
`?
`
`GET PROBE
`COORDINATES
`
`DETERMINE
`SCREEN CELL(S)
`TOUCHED
`
`DETERMINE
`FUNCTIONS OF
`SCREEN CELL(S)
`TOUCHED
`
`HIGHLIGHT
`FUNCTION
`TOUCHED
`
`EXPAND NUMBER
`OF SCREEN CELLS
`CORRESPONDING TO
`FUNCTION TOUCHED
`
`412
`
`414
`
`416
`
`418
`
`420
`
`Yes
`
`430
`
`USER
`ADJUSTS TOUCH
`(IF REQUIRED)
`
`/'"" 432
`
`PROBE
`REMOVED FOR
`SELECTION OF
`FEATURE
`?
`
`PROCESS
`USER SELECTION
`
`RETURN SCREEN
`CELL NUMBER
`TO DEFAULT
`
`No
`
`434
`
`436
`
`--------------1
`EXPAND NUMBER
`I
`OF SCREEN CELLS
`I
`~ 425
`1 CORRESPONDING TO
`: ADJACENT FUNCTION
`1
`- - - - - - - _ _ _ _ _ _ .J
`
`1
`
`_
`
`FIG. 11
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`1
`
`5,119,079
`
`2
`This system makes use of a joystick, which is tracked by
`a cursor. U.S. Pat. No. 4,310,839 to Schwerdt discloses
`an interactive display system with touch data entry
`which uses touch switches and cursors to highlight a
`5 selection by inverting the entire selection. U.S. Pat. No.
`4,686,332 to Greanias et al. discloses a finger touch
`detection system which calculates a screen position
`from a finger position. A touch cursor tracks the move(cid:173)
`ment of the finger. U.S. Pat. No. 4,299,041 to Wilson
`10 shows a touch sensitive greeting card in which activa(cid:173)
`tion commences operation of an effects generator caus(cid:173)
`ing a change of appearance in a display. U.S. Pat. No.
`4, 755,811 to Slavin et al. shows an arrangement for
`touch controlled zoom of an image on a waveform
`15 display. Statutory Invention Registration H716 by Mac(cid:173)
`Donald et al. shows a touch sensitive screen in which
`selection problems associated with parallax are reme(cid:173)
`died by placing a guard band around each touch sensi-
`tive area corresponding in size to an amount of parallax
`error. The patents and publications cited herein are
`incorporated by reference for their teachings.
`
`TOUCH SCREEN USER IJ\'TERF ACE WITH
`EXPANDING TOUCH LOCATIONS FOR A
`REPROGRAPHIC MACHINE
`
`This invention relates generally to the use of a touch
`screen user interface on a reprographic machine, and in
`particular, to a method of expanding the area for selec(cid:173)
`tion on the touch screen to improve accuracy of selec(cid:173)
`tion thereof.
`
`INCORPORATION BY REFERENCE
`U.S. Pat. No. 4,267,443 to Carroll et al. in specifically
`incorporated by reference herein by for the purpose of
`background information of the type of touch sensitive
`screen contemplated by the present invention.
`
`BACKGROUND OF THE INVENTION
`Touch sensitive screen user interfaces facilitate the
`selection of copying parameters on a reprographic sys- 20
`tern. Such systems allow users to visually determine the
`copying feature set that has been selected prior to start(cid:173)
`SUMMARY OF THE INVENTION
`ing the job, as well as, the status of the job during execu(cid:173)
`In accordance with the invention, there is provided a
`tion. Touch sensitive screen user interface systems,
`currently available on the market, employ a series of 25 touch sensitive user interface which provides an in-
`crease in the size of the touch sensitive zone upon selec-
`programming menus, whereby the copy features are
`selected by touching the desired feature icons contained
`tion thereof, which allows certain selection of only a
`on the display screen.
`single touch sensitive zone and therefore, a single fea-
`The most commonly used pointing device used for
`ture selection.
`selection of features on a touch sensitive screen is a 30
`In accordance with one aspect of the invention, in a
`finger. Due to the size of the average finger, and errors
`device such as an electrophotographic imaging system,
`in positioning the finger, it has been found necessary to
`including a touch sensitive user interface of the type
`construct menus of selectable features using relatively
`having a display screen for displaying an image; control
`large touch sensitive zones for each selectable item on
`logic responsive to the touch sensitive user interface for
`the menu. Typically these areas have minimum dimen- 35 determining the contact position of a probe, such as a
`sions on the order or ~ to ~inches ("finger resolution").
`finger, thereon; a display menu of operating features,
`represented by a plurality of images on the display
`When combined with a rather limited display area,
`tpere is only a limited number of items that can be simul-
`screen, so that a user may make touch selections on the
`taneously displayed for possible selection on a specific
`images corresponding to operating features desired; a
`display frame. It would be desirable to provide a greater 40 system controller for identifying a contact zone of a
`number of items for selection, but reducing the sensitive
`predetermined size with respect to the display screen,
`zones to less than finger resolution results in difficulty in
`the system controller actuating the feature within the
`making selections due to the relative inaccuracy of
`system represented by a displayed image in response to
`positioning a large finger on a small area, including
`user touch within a corresponding contact zone, ac-
`uncontrollable finger movement and inaccurate hand 45 knowledging selection of one of the image-represented
`placement. Placement of the probe centered near the
`features by displaying it in a highlighted fashion the
`edge of the selection area may result in a toggling action
`system controller enlarging the contact zone of a se-
`as the finger is inadvertently and unconsciously moved
`lected feature upon selection thereof, to a size accom-
`between selections. Of course, the smaller the selection
`modating a probe tip, without overlapping on adjacent
`area, the nearer to an edge the probe must be placed. It 50 areas.
`would be desirable to avoid accidental selection of a
`In accordance with another aspect of the invention,
`feature due to relatively small, inadvertent or uncon-
`contact positions in the region adjacent to the one or
`scious movement of the finger or probe.
`more activated selections are also increased in area, so
`U.S. Pat. No. 4,332,464 to Bartulis et al. discloses a
`that a user, in moving the probe within the region of
`user interface for a copying machine, comprising a 55 contact, is able to select a single image, represented by
`video display and a touch sensitive device capable of
`a highlighted image, without overlapping contact.
`detecting user requests via touching of the display sur-
`These and other aspects of the invention will become
`face. Moreover, the user interface is used to display
`apparent from the following description used to illus-
`visual elements representative of the feature set cur-
`trate a preferred embodiment of the invention in con-
`rently selected, including, optional feature selections 60 junction with the accompanying drawings in which:
`that are available. U.S. Pat. N9. 4,587,630 to Straton et
`FIG. 1 is an isometric view of an illustrative xero-
`al. discloses an intelligent programmable touch screen
`graphic reproduction machine incorporating the pres-
`system which uses a cursor to provide feedback to a
`ent invention;
`user. A means is provided for the system to correctly
`FIG. 2 is a block diagram depicting the major ele-
`interpret a finger position and change it into a screen 65 ments of the printing system shown in FIG. 1;
`position. U.S. Pat. No. 4,587,520 to Astle discloses a
`FIG. 3 is a plan view illustrating the principal me-
`chanical components of the printing system shown in
`cursor controlled page selection system using a cursor
`which can have a variety of physical characteristics.
`FIG. 1;
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`5,119,079
`
`25
`
`3
`FIG. 4 is a schematic view showing certain construc(cid:173)
`tion details of the document scanner for the printing
`system shown in FIG. 1;
`FIGS. SA, SB, and SC comprise a schematic block
`diagram showing the major parts of the control section
`for the printing system shown in FIG. 1;
`FIG. 6 is a block diagram of the Operating System,
`together with Printed Wiring Boards and shared line
`connections for the printing system shown in FIG. 1;
`FIG. 7 is a view depicting an exemplary job program- 10
`ming ticket and job scorecard displayed on the User
`Interface (Ul) touchscreen of the printing system
`shown in FIG. 1;
`FIG. 8 is an illustration of the touch screen sensing
`grid and image display cells of the user interface of 15
`FIG. 2;
`FIG. 9 is a simplified view of the menu and corre(cid:173)
`sponding touch sensitive areas in normal condition;
`FIG. 10 is a simplified view of the menu and corre(cid:173)
`sponding touch sensitive areas in expanded condition; 20
`FIG. 11 is a flow chart of the inventive process.
`With reference to the drawings, where the showings
`are for the purpose of illustrating an embodiment of the
`invention and not for the purpose of limiting same, at
`FIGS. 1 and 2, there is shown an exemplary laser based
`printing system 2 for processing print jobs in accor(cid:173)
`dance with the teachings of the present invention. Print(cid:173)
`ing system 2 for purposes of explanation is divided into
`a scanner section 6, controller section 7, and printer 30
`section 8. While a specific printing system is shown and
`described, the present invention may be used with other
`types of printing systems such as ink jet, ionographic,
`etc.
`Referring particularly to FIGS. 2-4, scanner section 35
`6 incorporates a transparent platen 20 on which the
`document 22 to be scanned is located. One or more
`linear arrays 24 are supported for reciprocating scan(cid:173)
`ning movement below platen 20. Lens 27 and mirrors
`28, 29, 30 cooperate to focus array 24 on a line-like 40
`segment of platen 20 and the document being scanned
`thereon. Array 24 provides image signals or pixels rep(cid:173)
`resentative of the image scanned which after suitable
`processing by processor 2S, are output to controller
`section 7.
`Processor 2S converts the analog image signals out(cid:173)
`put by array 24 to digital, and processes the image sig(cid:173)
`nals as required to enable system 2 to store and handle
`the image data in the form required to carry out the job
`programmed. Processor 2S also provides enhancements 50
`and changes to the image signals such as filtering, thre(cid:173)
`sholding, screening, cropping, reduction/enlarging, etc.
`Following any changes and adjustments in the job pro(cid:173)
`gram, the document must be rescanned.
`Documents 22 to be scanned may be located on 55
`platen 20 for scanning by automatic document handler
`(ADH) 35 operable in either a Recirculating Document
`Handling (RDH) mode or a Semi-Automatic Docu(cid:173)
`ment Handling (SADR) mode. A manual mode includ(cid:173)
`ing a Book mode and a Computer Forms Feeder (CFF) 60
`mode are also provided, the latter to accommodate
`documents in the form of computer fanfold. For RDH
`mode operation, document handler 3S has a document
`tray 37 in which documents 22 are arranged in stacks or
`batches. The documents 22 in tray 37 are advanced by 65
`vacuum feed belt 40 and document feed rolls 41 and
`document feed belt 42 onto platen 20 where the docu(cid:173)
`ment is scanned by array 24. Following scanning, the
`
`4
`document is removed from platen 20 by belt 42 and
`returned to tray 37 by document feed rolls 44.
`For operation in the SADR mode, a document entry
`slot 46 provides access to the document feed belt 42
`between tray 37 and platen 20 through which individual
`documents may be inserted manua!Jy for transport to
`platen 20. Feed rolls 49 behind slot 46 form a nip for
`engaging and feeding the document to feed belt 42 and
`onto platen 20. Following scanning, the document is
`removed from platen 20 and discharged into catch tray
`48.
`For operation in the CFF mode, computer forms
`material is fed through slot 46 and advanced by feed
`rolls 49 to document feed belt 42 which in turn ad(cid:173)
`vances a page of the fanfold material into position on
`platen 20.
`Referring to FIGS. 2 and 3, printer section 8 com(cid:173)
`prises a laser type printer, and for purposes of explana(cid:173)
`tion, is separated into a Raster Output Scanner (ROS)
`section 87, Print Module Section 9S, Paper Supply sec(cid:173)
`tion 107, and Finisher 120. ROS 9S has a laser 91, the
`beam of which is split into two imaging beams 94. Each
`beam 94 is modulated in accordance with the content of
`an image signal input by acousto-optic modulator 92 to
`provide dual imaging beams 94. Beams 94 are scanned
`across a moving photoreceptor 98 of Print Module 95
`by the mirrored facets of a rotating polygon 100 to
`expose two image lines on photoreceptor 98 with each
`scan and create the latent electrostatic images repre(cid:173)
`sented by the image signal input to modulator 92. Pho(cid:173)
`toreceptor 98 is uniformly charged by charging devices
`102 at a charging station preparatory to exposure by
`imaging beams 94. The latent electrostatic images are
`developed by developer 104 and transferred at transfer
`station 106 to a print media 108 delivered by Paper
`Supply section 107. Media 108 may comprise any of a
`variety of sheet sizes, types, and colors. For transfer, the
`print media is brought forward in timed registration
`with the developed image on photoreceptor 98 from
`either a main paper tray 110 or from auxiliary paper
`trays 112, or 114. The developed image transferred to
`the print media 108 is permanently fixed or fused by
`fuser 116 and the resulting prints discharged to either
`output tray 118, or to finisher 120. Finisher 120 includes
`a stitcher 122 for stitching or stapling the prints to(cid:173)
`gether to form books and a thermal binder 124 for adhe(cid:173)
`sively binding the prints into books.
`Referring to FIGS. 1, 2 and 5, controller section 7 is,
`for explanation purposes, divided into an image input
`controller 50, User Interface (Ul) 52, system controller
`54, main memory 56, image manipulation section 58,
`and image output controller 60.
`The scanned image data input from processor 25 of
`scanner section 6 to controller section 7 is compressed
`by image compressor/processor 51 of image input con(cid:173)
`troller 50 on PWB 70-3. As the image data passes
`through compressor/processor 51, it is segmented into
`slices N scanlines wide, each slice having a slice pointer.
`The compressed image data together with slice pointers
`and any related image descriptors providing image spe(cid:173)
`cific information (such as height and width of the docu(cid:173)
`ment in pixels, the compression method used, pointers
`to the compressed image data, and pointers to the image
`slice pointers) are placed in an image file. The image
`files, which represent different print jobs, are temporar(cid:173)
`ily stored in system memory 61 which comprises a Ran(cid:173)
`dom Access Memory or RAM pending transfer to main
`memory 56 where the data is held pending use.
`
`45
`
`GOOGLE Ex. 1039
`Google v. Philips
`
`

`
`25
`
`5
`As best seen in FIG. 1, UI S2 includes a combined
`operator controller/CRT display consisting of an inter(cid:173)
`active touch sensitive screen 62, keyboard 64, and
`mouse 66. UI S2 interfaces the operator with printing
`system 2, enabling the operator to program print jobs
`and other instructions, to obtain system operating infor(cid:173)
`mation, instructions, programming information, diag(cid:173)
`nostic information, etc. Items displayed on touchscreen
`62 such as files and icons are actuated by either touch(cid:173)
`ing the displayed item on screen 62 with a finger or by 10
`using mouse 66 to point cursor 67 to the item selected
`and keying the mouse. A similar user interface is de(cid:173)
`scribed in U.S. Pat. No. 4,267,443, issued May 12, 1981
`to Carroll et al., the relevant portions thereof being
`hereby incorporated by reference into the present appli- 15
`cation. Generally, operation and control information is
`stored in system memory and accessed by the system
`controller when necessary. The system controller regu(cid:173)
`lates the operation of the machine based on user pro(cid:173)
`gramming of desired features, and the system status, as 20
`determined by conventional switches and sensors. The
`features within the machine are then regulated through
`the control of individual electrical and electromechani-
`cal devices, such as conventional servomotors, sole-
`noids, etc.
`Main memory S6 has plural hard disks 90-1, 90-2, 90-3
`for storing machine Operating System software, ma(cid:173)
`chine operating data, and the scanned image data cur(cid:173)
`rently being processed.
`When the compressed image data in main memory S6 30
`requires further processing, or is required for display on
`touchscreen 62 of UI S2, or is required by printer sec(cid:173)
`tion 8, the data is accessed in main memory S6. Where
`further processing other than that provided by proces(cid:173)
`sor 2S is required, the data is transferred to image ma- 35
`nipulation section S8 on PWB 70-6 where the additional
`processing steps such as collation, make ready, decom(cid:173)
`position, etc. are carried out. Following processing, the
`data may be returned to main memory S6, sent to UI S2
`for display on touchscreen 62, or sent to image output 40
`controller 60.
`Image data output to image output controller 60 is
`decompressed and readied for printing by image gener(cid:173)
`ating processors 86 of PWBs 70-7, 70-8 (seen in FIG.
`SA). Following this, the data is output by dispatch pro- 45
`cessors 88, 89 on PWB 70-9 to printer section 8. Image
`data sent to printer section 8 for printing is normally
`purged from memory S6 to make room for new image
`data.
`Referring particularly to FIGS. SA-SC, control sec- 50
`tion 7 includes a plurality of Printed Wiring Boards
`(PWBs) 70, PWBs 70 being coupled with one another
`and with System Memory 61 by a pair of memory buses
`72, 74. Memory controller 76 couples System Memory
`61 with buses 72, 74. PWBs 70 include system processor SS
`PWB 70-1 having plural system processors 78; low
`speed 1/0 processor PWB 70-2 having UI communica(cid:173)
`tion controller 80 for transmitting data to and from UI
`52; PWBs 70-3, 70-4, 70-S having disk drive controller/(cid:173)
`processors 82 for transmitting data to and from disks 60
`90-1, 90-2, 90-3 respectively of main memory S6 (image
`compressor/processor 51 for compressing the image
`data is on PWB 70-3); image manipulation PWB 70-6
`with image manipulation processors of image manipula(cid:173)
`tion section S8; image generation processor PWBs 70-7, 65
`70-8 with image generation processors 86 for processing
`the image data for printing by printer section 8; dispatch
`processor PWB 70-9 having dispatch processors 88, 89
`
`5,119,079
`
`6
`for controlling transmission of data to and from printer
`section 8; and boot control-arbitration-scheduler PWB
`70-10.
`Referring particularly to FIG. 6, system control sig(cid:173)
`nals are distributed via a plurality of printed wiring
`boards (PWBs). These include EDN core PWB 130,
`Marking Imaging core PWB 132, Paper Handling core
`PWB 134, and Finisher Binder core PWB 136 together
`with various Input/Output (I!O) PWBs 138. A system
`bus 140 couples the core PWBs 130;132, 134, 136 with
`each other and with controller section 7 while local
`buses 142 serve to couple the 1/0 PWBs 138 with each
`other and with their associated core PWB.
`On machine power up, the Operating System soft(cid:173)
`ware is loaded from memory S6 to EDN core PWB 130
`and from there to the remaining core PWBs 132, 134,
`136 via bus 140, each core PWB 130, 132, 134, 136
`having a boot ROM 147 for controlling downloading of
`Operating System software to the PWB, fault detection,
`etc. Boot ROMs 147 also enable transmission of Operat(cid:173)
`ing System software and control data to and from
`PWBs 130, 132, 134, 136 via bus 140 and control data to
`and from 1/0 PWBs 138 via local buses 142. Additional
`ROM, RAM, and NVM memory types are resident at
`various locations within system 2.
`Referring to FIG. 7, jobs are programmed in a Job
`Program mode in which there is displayed on display 62
`with menus lSO, 1S2, which display the basic instruc(cid:173)
`tions to the system for printing the job.
`Referring again to FIGS. l, 2, and 7, user interface S2
`is comprised ofU/I housing 200, touch sensitive display
`62, touch sensor 202, and keyboard 64. User program(cid:173)
`ming of the machine via the U/I is facilitated through
`display of programming screens lSO, such as shown in
`FIG. 7, which represent programming features of the
`machine. Signals from touch sensor 202 are fed to the
`machine controller S4 where they are interpreted with
`respect to the current programming screen. Subse(cid:173)
`quently user selections are displayed on CRT display 62
`and the appropriate machine subsystems are enabled,
`disabled or adjusted accordingly.
`Programming screen menus ISO, IS2, as displayed on
`CRT display 62, are used by the user to select a feature
`set appropriate for the completion of a printing job.
`Specifically, the programming screens consist of a series
`of screens, arranged in a file folder or tab format, as
`illustrated in FIG. 7. The currently programmed fea(cid:173)
`ture set is displayed with selected features indicated as
`highlighted or white icons and disabled or deselected
`feature icons are indicated with a neutral or grey back(cid:173)
`ground.
`Referring now to FIG. 8, which illustrates the rela(cid:173)
`tionship between the touch sensitive display 62 and
`touch sensor 202, a regular rectangular grid 210 is
`formed by the intersection of horizontal light beams 212
`and vertical light beams 214. Light, in the visible or
`infrared spectrum, emanatin