Samsung USP 7,973,773
`
`Exhibit 1011 Page 1
`
`Samsung USP 7,973,773
` Exhibit 1011 Page 1
`
`

`
`’85 PROCEMETLWDINGS
`
`APRIL 1985
`
`4. HARDWARE DESCRIPTION
`
`the fast multlple-tou:h-
`the hardware of
`A brief description of
`sensitive input device (FMTSID) is Introduced here. The design of
`the hardware is based on the reqtlrements of the fast scanning
`algorithm and on tradeoffs between software and hardware. Many
`sensors have been examined for our particular application, however
`(Hurst, 1974; Hlills, 1982; TSD, 1982; TASA, 1980; JSRC, 1981;
`Mama, 1982) none seemed to have the properties that satisfy the
`requirements of a FMTSID. The hardware basically consists of a
`sensor matrix board,
`row and colunn selection registers, A/D
`converting circuts and a controlling CPU.
`The design of the sensor matrix is based on the technique of capa-
`citance measuement between a finger
`tip and a metal plate. To
`minimize hardware. the sensors are accessed by row and column
`selection. How selection registers select one or more rows by set-
`ting the corresponding bits to a high state In order to charge up the
`sensors while the coiurnn selection registers select one or more
`coiunns by turning on corresponding analog switches to discharge
`the sensors through timing resistors. The intersecting region of the
`selected rows and the selected columns represents the selected
`sensors as a group. A/D convening
`circuits measure the
`discharging time lmerval of the selected sensors.
`A University of
`Toronto 6809 board is used as a controlling CPU. The touch str-
`face oi the sensor board consists ot ntmber of small metal-coated
`rectanguar-shaped areas sewing as sensor plate capacitors. The
`design of the metal plate area of a unit sensor depends on the
`measuable capacitance change that results when the area is
`covered by a finger tip, and on the resolution that can be imple-
`mented.
`
`charging diode
`
`Discharging diode
`
`a row lino
`
`SEN SOR
`
`H-Li: a column selection
`__ switch
`
`Fig. 1 A model of a selected sensor in the sensor matrix.
`
`In order to select a sensor by row and column access, two diodes
`are tsed with each sensor. One diode, connected to the row line, is
`used to charge up the sensors in the row. It is referred to as the
`Charging Diode (CD) as shown In Flgtre 1. The CD also serves to
`block the charge flowing back to the row line when the row line voi-
`tage ls dropped to zero. The other diode called the Discharging
`Dlode(DD). connected to the colunn line, enables discharging of the
`selected row sensors to a virtual ground. Also the DD blocks
`charge flow from the sensors in the selected row to the sensors in
`the unselected rows dulng the discharging period. The selection of
`rows, by the row selection procedure, causes the sensors to be
`charged. The sensors in the column are then discharged through
`associated tinting resistors connected to the column selection
`switches.
`
`The charges stored In the selected row(s) flow down through the
`selected switches to the vlrttai grotnd of a fast operational
`amplifier. All the discharging currents are correspondingly added to
`produce a signal from which the discharging time of all the selected
`sensors is found by comparison with a threshold voltage.
`Preesue sensitivity is incorporated by two measures: First there is
`the effect, here minor. of compression of the overlaying insulator.
`Second there is the effect of intrinsic spreading of the compressible
`finger tip as pressure is Increased.
`
`The software In the controlling CPU utilizes communication with the
`host computer to accommodate the interpolation scheme. The
`clock rate (10 MHz) allows about
`'0 counts to correspond to the
`sensor capacitance change due to a touch. But, oi course. the caps-
`citance of all the circtitry attached to the column line during the
`discharging period is much larger than the sensor capacitance.
`Thus before scanning the tablet for a touch.
`It
`is scanned corn-
`pletely in all possible resolution modes when not touched. The
`values so obtained are stored as references. Touches are
`identified by the differences between the reference values and the
`values measured during use.
`The capacitance change corresponding to the touch by more than
`one finger (or by the whole hand) is very large. Thus the number of
`bits in the comter should be enough to measure the maadmum
`capacitance. However it
`is unnecessary either to have sufficient
`bits to measure the entire capacitance including the suroundlng
`capacltances. or to store the corresponding "complete" counter
`values as references.
`it Is necessary only to have one more bit
`than the nunber of bits reqtlred to count the value of change In
`the capacitance rather than the complete value In order to measure
`the differences of capacitance due to touch. Thus only an 8 bit
`counter is implemented. The counter enables the measurement of a
`7 bit capacitance change regardless of the degree of overflow In
`the counter.
`
`A facility is also provided for identifying templates applied to the
`surface of the tablet.
`
`5. SCANNING ALGORITHI
`
`One idea of scrne significance that can be introduced is to avoid
`scanning of all the pixels In the tablet which contain no Information.
`For example, scanning all 2048 points of a tablet having a resolu-
`tion 64 by 32 for fewer than '0 points is really quite a ridiculous
`idea.
`In fact. if the number of points to be searched is comparably
`small. then an improved algorithm. here called recursive area subdi-
`vision. can be used. A particular
`implementation example is
`described as follows.
`
`Consider a tablet with resolution 8 by 8 to be searched for a touch
`point as shown in Figtre 2. First, check the tablet for touch as a
`whole region as shown by the area ABCD In the figure. it touch is
`detected, divide the tablet into two equal regions shown by the line
`EF and check each of
`the two regions ABEF and EFCD for
`touchedness. Select the touched region, region EFCD in this case,
`and divide this into two equal regions as shown by the division line
`GH. Continue this process on the tomhed region until no ftsther
`division is possible, that is, until a unit sensor, designated as the
`region PKMO In Figue 2, is reached. The figure also shows the
`sequence of subdivision in the recursive subdivision scheme.
`
`D
`
`(n)-Sequence of subdivision in binary operation.
`
`Fig. 2 Rectrslve subdivision operation for 8 by 8 tablet.
`
` Exhibit 1011 Page 2
`
`

`
`CHI
`
`'85 PROCEEDINGS
`
`APRIL 1985
`
`Using this algorithm, a search for one poim on a tablet having a
`resolution 64 by 32, requires 22 scanning times, that is
`
`2'(logsub 2}(64'32)=22
`
`If there is no overhead in the rewraive subdivision process and
`scanning begins at the ‘top oi the tree’ (that is, with a region in
`which all pixels are grouped together), then using this scheme, the
`number of touched points that can be identified in the time that it
`would take to detect one touch directly (that is,
`if all pixels are
`scanned one by one sequentially) is
`
`N = {(64 ' 32) over 22} = 186.
`
`This shows Immediately that the rectrsive subdivision scheme is
`much superior to sequential scanning ii the nunber of points to be
`scanned ls fewer than 188.
`
`G.
`
`IITEHPOLATION
`
`it may seem that the relution of the hardware is too low for use in
`graphics applications. However touch intensity and mtlti—touci1 sen-
`sitivity can be used to enhance resolution. This is possible because
`the center of a touch can be most accurately estimated by an inter-
`polation utilizing the values of the adjacent sensor Intensities.
`Direct
`interpolation schemes for a few cases has been imple-
`mented. One of interest is to interpolate an array of 3 by 3 sensors
`using it touched point
`in the center. Another is to interpolate all
`points on the tablet. The later one obviously provides the highest
`resolution but as a result it simply ernuiates a single touch tablet
`with very high resolution.
`1. PERFORMANCE
`
`7.1 senor
`An ideal sensor matrix for a FMTSID wcud be one that has uniform
`and small reference values over a growing level, a large variation
`of Intensity due to a touch, and fast measurement time. The sensor
`matrix of the prototype, however, has a relatively wide range of
`reference valtns. However these values do not change very much
`over extended periods of time. The resllts show that doubling the
`nunter of sensors in a group in the column direction Increases the
`reference value by a factor of about 1.5. This corresponds well to
`theoretical estimates. As well the results show that increasing the
`nutter oi sensors in a group in the row direction. in contrast. does
`not Increase the reference value In general, even ii the number of
`the sensors is donated In a group. The reference value ranges
`from 40 (for a single sensor in a group) to 580 (for the entire array
`of 64 by 32 sensors considered as a group).
`it order to account for time and other variations of the reference
`values. a threshold is included which must be overcome in order for
`e touch to be detected. The threshold used ranges from 2 to 7
`courts depending on grain size. Using these threshold values the
`CPU does not report untomhed points wrongly over lmervais of at
`least 3 hours In either sequential or recursive etbdlvision modes.
`The rectrsive subdivision scheme uses 6 different thresholds, con-
`sequently it
`is very miikeiy to report a wrong point whereas the
`linear scanning mode using only a single threshold is likely to be
`more sensitive.
`
`The intensity of a single tomh for a single sensor grow varies over
`the tablet but usually ranges above the threshold value by as much
`as 15. For a single 64 by 32 sensor grow, the intensity varies from
`person to person but it ranges from the threshold to 124. This max-
`imun is obtained when a palm rather than a flnger touches the
`tablet. Another
`interesting laatire is
`that
`the response time
`becomes laster as the nunber of sensors in a group becomes
`larger. and llnherrnore that for the 64 by 32 sensor group. it is cos
`aible to detect of a hand merely placed In the vicinity of the tablet.
`
`7.2 Spltlal Resolution
`One possible and immediate Interpolation scheme is to interpolate it
`"touched" point with all adjacent values which may not be large
`enough to be reported as touched. A local array of 3 by 3 points
`can be used for this interpolation. Some examples drawn on a
`laser printer (consequently having no intensity scale) are shown In
`Figure 3. These pictures are produced without feedback, that is,
`drawn without the operator looking at the output screen. This does
`not allow the operator to compensate. that Is, to select points where
`data are sparse in comparison with the intended figure. but rather
`takes direct Input from the location of the figure drawn on the input
`device. The first picture (a) is drawn by moving a finger
`in a
`straight line (guded by a ruler) for varlota angles and the second
`one (b) is drawn by moving a finger in a line glide by a circle drawn
`on a template. These tests show that
`interpolation actually
`increases the spatial resolution as well as the locatabillty of a fine
`point on a screen.
`
`:.‘......-_...........
`to! scale
`
`..
`
`(8) Straight. lines drawn by the tablet using 5 by 3
`sensor ax-My interpolation.
`'l‘hs scales shown represent
`the boundaries or the
`actual sensors.
`
`row at: e la
`
`(b) It circle drawn by the tablet using 5 by 5
`sensor array interpolation.
`The scales shown represent
`the boundaries or the
`actual sensors.
`
`Fig 3 Poims drawn by the tablet using an interpolation method.
`
` Exhibit 1011 Page 3
`
`

`
`CHI
`
`'85 PROCEEDINGS
`
`APRIL 1985
`
`Since the spatial resolution In the local interpolation scheme is lim-
`ited by the number oi bits available from the intensities oi an array
`of 3 by 3 sensors, other scheme was considered.
`in this scheme,
`all the poims from a complete scan of a tablet are imerpolated
`allowing the potential resolution to be almost infinite. However this
`process
`simply emulates a protective device and accordingly
`reports only single point, which is interpolated from all the points on
`the tablet. However with this scheme, there are a great many ways
`of pointing to a specific location on a display screen, a ieature with
`some intriguing application possibilities.
`7.3 Rnnonee Tine Delay
`The response time delay is the time delay from the beginning of a
`touci1 to an output received either by local terminal or by an output
`device attached to the host computer. For mtliipie touches. this
`delay will increase with the number of toudtes. The prototype used
`with a 9600 baud-rate terminal
`to measure time delays. Actual
`response times were meastted several
`times and averaged for
`various cases and are tabulated in Table 1.
`
`(:1) pts/sec
`msec/pt
`
`(b) pts/sec
`msec /pt
`
`(c) pts/sec
`msec/pt
`
`17.6
`55.8
`
`19.2
`52.1
`
`24.0
`41.6
`
`WC“
`15.2
`65.8
`
`17.2
`58.1
`
`22.0
`45.5
`
`12.8
`78.1
`
`16.0
`62.5
`
`18.8
`53.2
`
`TABLE 1. Actual Response Time Delays
`
`The cases in Table one are to be Interpreted as follows:
`a one sensor touched contlnuotsiy
`b
`two sensors touched at the same time continuotsly
`c
`four sensors touched at the same time continmtsly
`
`l-iill, R. & Rowley, P. (1985). Issues and Techniques in
`Buxton, W.,
`Touch-Sensitive Tablet
`Input, Computer Systems Research
`Institute, University of Toronto.
`
`Hiilis, W.D. (1982), A High Resolution imaging Touch Sensor, Inter-
`national Journal of Robotics Research, 1 (2). 33 - 44.
`
`(1974). Eiectrographlc Sensor for Determining Planar
`Hurst, G.
`Coordinates, United State Patem 3,798,370, March 19, 1974,
`Eiographics, Incorporated.
`
`JSR (1981). Pressure-Sensitive Conductive Rubber Data Sheet,
`Japan symhetic Rubber Co., New Product Development
`Department, JSR Building, 2-11-24 Tfukiji. Chuo-Ku. Tokyo 104,
`Japan.
`
`(1984), A Fast Multiple-Touch-Sensitive Input Device,
`Lee, S.
`M.A.Sc. Thesis, Department of Electrical Engineering, Univer-
`sity ot Toronto.
`
`Metha, N. (1982), A Flexible Machine Interface, M.A.Sc. Thesis,
`Department of Electrical Engineering, University of Toronto.
`
`Sasaki, L., Fedorkow, G.. Buxton, W.. Retterath. C., A Smith, K.C.
`(1981). A Touch-Sensitive Input Device. Proceedings of the
`Fifth International Conference on Computer Music. North
`Texas state University. Demon. Texas. November. 1981.
`
`TASA (1980), Model: x-y 3600 and x-y controller. Model: FR—105
`Data Sheet, Touch Activated Switch Arrays hc.,
`1270
`Lawrence Station Road., Suite (3., Sunnyvale. CA 94089.
`
`TSD (1982), Touch Screen Digitizer Data Sheet, TSD Display Pro-
`ducts Inc.. 35 Orville Drive. Bohemia, NY 11716.
`'
`11. APPElD|X A: 'I'0UCi-i 'l'AILE'l' SOURCES
`
`Big Brlar: 3 by 3 inch continuous pressure sensing touch tablet
`
`Big Brier. Inc.
`Leicester, NC
`28748
`
`O. CONCLUSDNS
`
`Chalk Board inc.: “Power Pad",
`computers
`
`large touch table for micro-
`
`A prototype of a fast-scanning multiple-touch-sensitive inpu tablet
`having both the adaptability and ilexlblllty for a broad range of appli-
`cations has been designed and Implemented. Capacitance meas-
`uement oi individual sensor(s) which can be tniqueiy addressed
`using two diodes per sensor, makes it possible to sense both the
`positions and intensities of one or more simultaneous touches
`without amblgdty. The senr matrix is controlled by University oi
`Toronto 5809 board whose serial port is connected to one of the
`U0 ports oi a host computer. Soitware that utilizes the recursive
`subdivision algorithm for fast scanning an array of 64 by 32 sensors
`on the tablet, and that communicates with the host computer, has
`been implemented and tested.
`0. ACKNOWLEDGEMENTS
`
`The research described in this paper has been iutded by the
`Natural Sciences and Engineering Research Council at Canada.
`This elpport is gratefully acknowledged.
`I). REFEREPEES
`
`Brown, E., Buxton. W. at Mirtagh. K. (1985). Windows on Tablets as
`a Means oi Achieving Virtual
`Input Devices. Computer Sys-
`tems Research institute. University at Toronto.
`
`Burton, W. (1982). Lexical and Pragmatic considerations oi input
`structures, computer Graphics, 17 (1), 31- 37.
`
`Chalk Board inc.
`3772 Pieasantdaie Rd.,
`Atlanta, GA 30340
`
`Eiographics: various sizes of touch tablets, lnciuting presstre sens-
`ins
`
`Eiographics, inc.
`1976 Oak Ridge Tunpike
`Oak Ridge, Tennessee
`37830
`
`KoalaPad Technologies: Approx. 5 by 7 inch tomh tablet for micro-
`computers
`
`Koala Technologies
`3100 Patrick Henry Drive
`Santa Clara. California
`95050
`
`Spiral Systems: Trazor Touch Panel. 3 by 3 ind: touch tablet
`
`Spiral system instruments, inc.
`4853 Cordell Avenue, Suie A-10
`Bethesda, Maryland
`20814
`
` Exhibit 1011 Page 4
`
`

`
`l’85 PROCEEDINGS
`
`APRIL1985
`
`TASA: 4 by 4 Inch touch tablet (relatlve sensing only)
`
`Touch Activated Swltch Arrays Inc.
`1270 Lawrence Sm. Road, Sute G
`Smnyvale. California
`94089
`
` Exhibit 1011 Page 5