`
`«+ Disadvantages
`+ No multi-touch
`+ Finger-only (or tethered pen)
`+ Calibration drift & susceptible to EMI
`+ Moderate optical quality (85% - 90%)
`«+ Applications
`+ Regulated (casino) gaming
`+ Point-of-Sale (POS) terminals
`+ Point-of-Information (PO vinecle
`+ Medical equipment
`rT
`Matocrerperce
`|
`
`
`
`«* Suppliers
`
`— = + 3M is the only significant supplier left
`
`“+ Status
`
`Source: 3M
`
`+ It will be an irrelevant, obsolete technology in 5-7 years
`
` SID DISPLAY WEEK ‘14
`(intel)
`
`SAMSUNG EXHIBIT 1011 (Part 3 of 3)
`
`
`
`Wacom’s Improved RRFC
`Surface Capacitive Technology...1
`
`“* How it works
`
`+ Alinear voltage AND a ramp-shaped
`electrostatic field is created on the
`surface by applying AC on 2 corners &
`DC on the other two corners
`
`+ Controller switches signals around all
`4 corners, creating 4 rampfields vs.
`single flat field in standard capacitive,
`and measurescurrent in each case
`
`
`
`+ Resulting touch-eventsignalis
`independentof all capacitance effects
`except those dueto finger-touch
`+ Controller does additional digital signal
`(Trademark = CapPLUS)
`processing to compensate forfactors
`RRFC= Reversing Ramped
`that affect accuracy anddrift
`Ren Saas
`
`
`SID DISPLAY WEEK ‘14
`
`Source: Wacom
`
`
`
`
`
`Wacom’s Improved RRFC
`Surface Capacitive Technology...2
`
`«+ Advantages
`+ Solves all the problemsof traditional surface capacitive
`e Works in mobile & stationary devices (10” to 32” now; 46” capable)
`
`e Unaffected by grounding changes, EMI, variations in skin dryness
`& finger size, temperature, humidity, metal bezels, etc.
`e Works outdoorsin rain and snow
`
`e Works through latex or polypropylene gloves
`e Allows 4X thicker hardcoatfor improved durability
`+ Uses same ASIC as Wacom’s EMR pendigitizer, so dual-mode
`input is lower cost & moreefficient (e.g., in Tablet PC)
`«+ Disadvantages (2 very big ones!)
`+ No multi-touch
`
`+ Sole-source supplier
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Resistive Touch Technologies
`
`«+ Analog Resistive
`** Analog Multi-Touch Resistive (AMR)
`** Digital Multi-Touch Resistive (DMR)
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Resistive
`
`Analog
`
`Source: Engadget
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Analog Resistive...1
`
`Conductive coating
`
`(ITO)
`
`substrate
`
`
`
`Source: Bergquist
`
`4G
`
`lass
`
`4 F
`
`lexible
`hard-coated— [©
`outer membrane
`
`(PET)
`
`Source: Elo Touch Solutions
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Analog Resistive...2
`(4-Wire Construction)
`
`
`
`Equivalentcircuit
`
`Voltage
`measured
`on glass
`
`psaeeMueaeetniy
`
`$3:
`
`oom
`
`
`
`measured on
`coversheet
`
`:
`
`HHHHTTE
`
`333pets
`ei33
`erta
`prrititsassartrtrsassasaerertisa3¢
`piatatsarrrrets
`sitesissssstespeeesssasesese
`3isagstiesess
`sasasetteetass
`+3]
`+
`+
`
`X-Axis
`
`
`
`Voltage
`gradient
`applied
`across
`
`Voltage
`gradient
`applied
`across
`coversheet
`
`sree eee seersisiess
`heesag
`PsatECPENSHESSeaaseeeSteediene
`
`aasaeetees
`poasateees
`paaaerers
`eteeeees
`seaasrcess
`
`
` Voltage
`oOo =” Y-Axis
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Analog Resistive...3
`(5-Wire Construction)
`
`
`
`X-Axis
`
`eessatetisensesesessesees
`seaaaatenslsstsesesaaaeaaes
`errr)
`perrrett
`eeeheees:
`3
`eeeeriaastsrerrs
`prererts
`SPrShreeeieeees
`ee}
`REReesiteretetts
`prseet
`presessagastenes
`sar otereseer ceessesesesrers
`poeseesecoreses
`Rictehehibeseeemmesaeeereeeieerettseececerss
`
`Contact point
`on coversheetis
`a voltage probe
`
`Linearization
`attern
`
`peetanaaeaeeenees
` Sieasateritesreteeresseeste
`
`Oo
`Voltage
`gradient
`applied
`across
`glassin
`X-axis
`
`8
`Voltage
`gradient
`applied
`across
`glassin
`Y-axis
`
`hegrest
`;
`
`igs
`sesea
`Pebtaesaaliaassasnneeetssaeas
`eeeessass
`iittsssecesestsasaae
`simedirstteHaaaiass
`Seeetsag
`EEE HT
`
`ae
`:
`S
`
`Equivalentcircuit
`
`E
`
`Contact point
`on coversheet
`is a voltage
`probe
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Analog Resistive...4
`
`“* Types
`+ 4-wire (low cost, short life) is common in mobile devices
`+ 5-wire (higher cost, long life) is commonin stationary devices
`+ 6-wire & 7-wire = obsolete 5-wire; 8-wire = replacement only
`«+ Constructions
`
`+ Film (PET) + glass (previousillustration) is the most common
`+ Film + film (used in some cellphones) can be madeflexible
`+ Glass + glass is the most durable; automotive is the primary use
`+ Film + film + glass, others...
`«+ Options
`+ Surface treatments (AR, AG, AF, AC, AB),
`rugged substrate, dual-force touch,
`high-transmissivity, surface armoring,
`manyothers...
`
`
`SID DISPLAY WEEK ‘14
`
`rey
`
`
`
`(50-uM glass) Source: Schott
`
`
`
`
`
`Analog Resistive...5
`
`“* Size range
`+ 1° to ~24” (>20”is rare)
`** Controllers
`+ Many sources
`+ Single chip, embeddedin chipset/CPU,
`or “universal” controller board
`«* Advantages
`+ Workswith finger, stylus or any non-sharp object
`+ Lowest-cost touch technology
`+ Widely available (it’s a commodity)
`+ Easily sealable to IP65 or NEMA-4
`+ Resistant to screen contaminants
`+ Low power consumption
`
`
`yee
`
`Source:Liyitec
`
`SID DISPLAY WEEK ‘14
`
`ree
`
`
`
`Source: Microchip
`
`
`
`
`
`Analog Resistive...6
`
`«+ Disadvantages
`+ Not durable (PET top surface is easily damaged)
`+ Pooroptical quality (10%-20% light loss)
`+ No multi-touch
`
`“+ Applications
`
`+ Mobile devices (shrinking) a
`
`+ Automotive
`
`
`+ Point of sale (POS) terminals
`
`+ Industrial ——————> ]
`
`= «
`
`Source: Sinocan
`
`+ Wherevercostis #1
`
`Source: Renu
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Analog Resistive...7
`
`“* Suppliers
`+ Young Fast, Nissha, Nanjing Wally, Truly, EELY, Mutto, J-Touch...
`+ 60+ suppliers
`** Market trends
`
`+ Analog resistive is shrinking in units and revenue
`e P-cap dominates in most consumerapplications
`+ Analog resistive is still significant in commercial applications
`e Especially POS andindustrial-control terminals
`
`SID DISPLAY WEEK ‘14
`
`Ps
`
`
`
`
`
`Analog
`Multi-Touch
`Resistive
`
`g 3
`
`Source: TouchInternational
`
`SID DISPLAY WEEK ‘14
`
`226
`
`DUP? (23163
`B45 CGO) CLEAR VIEW AREA
`B34S3 (2120) ACTIVE AREA
`
`COS (42D
`(261 (66D
`
`gaizg==2+
`Sass!LLL=e
`i
`i
`t
`i
`;
`i
`i
`ee
`:
`.‘a1‘
`'
`'
`'
`{
`nahnnd wondnnnt- antes ombao ncton
`nat
`a oe eepie|
`PtCroesnub—-morimerer
`
`*“a”.aa
`
`+
`
`
`
`
`
`Analog Multi-Touch Resistive...1
`
`“4-wire analog touchscreen”
`
`"
`
`for consumerproduct a
`
`SID DISPLAY WEEK ‘14
`
`227
`
`Gee
`
`Source: The Author
`
`“+ Multiple names
`+ AMR (Analog Multi-
`Touch/Matrix Resistive)
`+ MARS(Multi-Touch
`Analog Resistive Sensor)
`+ “Hybrid analog-digital”
`«+ Primary limitation
`
`fingers on the same
`
`~
`
`eo
`
`ittchannel” 10-20 mm
`”faapancenties ——
`
`
`
`ttttt
` Typical AMR design e—
`
`
`
`
`
`Analog Multi-Touch Resistive...2
`
`X axis! 7.08)
`
`Out Ares 495.608),50
`
`(7.98)
`View Ares (479.64)
`(7.98)
`aven.0
`Active Area477.6410.50
`|.
`898¢0.50 Actua|
`
`21371oO|Product
`|
`247.8040.50
`=)4
`
`
`
`
`
`
`
`
`
`
`
`
`Ce
`CCCCLELCILIELLIxeeeCTLEMLLL
`|
`COPeer s
`| (ECeee 21.5” analog
`ICLTITTITITITITrTitTtittttyyertis multitouch
`gs
`§
`(EEEeeeeee ae
`le PEPer » resistive by
`fee ECEECCee P eTibeTotich
`q\=|2
`3
`aela a esee es /
`382
`mTTTTTeePr
`99x 17 lines
`POCCCCCCEeeeLEELEE
`PCCCCCCCEEEELEE
`=17 mmx
`COPeeereeTT
`CCOLOOCECEELEEEeEeELEEE
`rrPreretTrrrrfrereerereteeeeeeeetete 16 mm squares
`eT (90 pins)
`patPAe p
`
`i Mmrll|nsstom|C|10.54)
`11,$430.50
`y
`, 23” = 35 x 22 lines
`q7!) 18mmx 13mm
`—
`(114 pins)
`
`214.80+1,00
`Page228 of315 Ge
`
`
`SID DISPLAY WEEK ‘14
`
`a)
`
`
`
`
`
`Analog Multi-Touch Resistive...3
`
`“+ Gateway ZX6910 AiO with 23” AMR touchscreen from
`eTurboTouch
`
`+ Example of a failed consumer product with 15x13 mm AMR
`e Drawing parallel lines with two closely held fingers
`
`
`
`Source: Photos by Author
`
`
`
` SID DISPLAY WEEK ‘14 yd
`
`
`
`
`
`Analog Multi-Touch Resistive...4
`
`«* Controllers
`+ AD Semi & others; some home-grown(e.g., Touch International)
`«* Suppliers
`+ eTurboTouch, Touch International, Mildex, Mutto, EETI...
`«+ Advantages
`+ Multi-touch (but without two touches on the same square)
`+ Simple & familiar resistive technology
`+ Lowercost than p-cap
`«+ Disadvantages
`+ Poor durability (PET top surface)
`+ Pooroptical performance
`+ Non-zero touch force
`
`+ Industrial & other commercial
`
`«+ Applications
`
`
`
`SID DISPLAY WEEK ‘14
`
`Source: Apex
`
`
`
`
`
`
`
`Digital
`Multi-Touch
`Resistive
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Digital Multi-Touch Resistive...1
`
`«+ Stantum’s product (iVSM)
`+ “Interpolated Voltage-Sensing Matrix”
`+ Stantum’s strategy is to license
`controller IP to IC manufacturers,
`not to sell touchscreens
`
`+ Aimed at tablets
`
`“Mechanical contact switch” SID DISPLAY WEEK ‘14
`
`+ Fine pitch results in a
`much higher number
`of connections than
`AMR (400+ on a 10”
`tablet screen)
`e 250-290 |/O’s per controller
`
`
`
`
`
`Digital Multi-Touch Resistive...2
`
`«* Controllers
`+ ST Micro is currently the only one
`e Numberof touch points is controller-dependent(2-10)
`«+ Advantages
`+ Multi-touch
`+ Simple & familiar resistive technology
`+ Lowercost than p-cap
`«+ Disadvantages
`+ Poor durability (PET top surface)
`+ Poor optical performance
`+ Non-zero touch force
`
`“+ Applications
`+ Commercial mobile applications such as education
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Digital Multi-Touch Resistive...3
`
`«+ Stantum’s successes(against a BIG P-cap headwind)
`+ Co-developed a pen & finger solution with Nissha
`for 5.7 to 12-inch tablets
`+ Licensed IP to a US-based semiconductor vendor developing
`a controller optimized for 5.7” to 12” tablets
`+ Design win with a tier-1 OEM for a pen & finger A4 e-reader
`targeted at education and note-taking
`+ Two 7”tablets for military applications (one by Harris)
`+ 10.4” professional lighting-control application (Europe)
`+ Signed a licensing agreementwith a tier-1 OEM for a mobile
`enterprise tablet
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Digital Multi-Touch Resistive...4
`
`«+ One of Stantum’s shipping (military) OEM products
`
`*~
`
`Bs
`
`iil,
`
`
`
`%
`
`Source:
`Harris
`
`
`
`“A new 7-inch Android tablet that's so hard-as-nails it would
`make a Galaxy Tab go homeandcall its mother” (Engadget)
`
`SID DISPLAY WEEK ‘14
`
`PES
`
`
`
`
`
`Digital Multi-Touch Resistive...5
`
`«* The funny thing is, Stantum’s original products were
`the first commercial products to use multi-touch!
`+ In 2005, when the companywasselling music controllers
`under the name “Jazz Mutant”
`
`
`
`Source: Jazz Mutant
`
`SID DISPLAY WEEK ‘14
`
`PEM
`
`
`
`
`
`Acoustic Touch Technologies
`
`** Surface Acoustic Wave (SAW)
`** Acoustic Pulse Recognition (APR by Elo)
`** Dispersive Signal Technology (DST by 3M)
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Wave
`
`Surface
`Acoustic
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Surface Acoustic Wave...1
`
`Glass substrate
`
`Y- axis transmitting transducer
`
`Y- axis receiving transducer
`
`transducer
`transducer X- axis transmitting
`
`Edge of Active Area
`
`Arrayof reflectors (45°)
`
`Source: A-Touch
`
`Rayleigh wave
`
`Source: Onetouch
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Surface Acoustic Wave...2
`
`Transmit
`Burst
`
`Amplitude
`
`Touch Effect
`
`Time os
`proportional
`to distance
`
`Source: Elo Touch Solutions
`
`Time
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Surface Acoustic Wave...3
`
`
`
`** How two touches are supported by SAW
`
`X Transmit
`Transducer
`
`1301
`
`
`
`
`
`
`
`1301
`
`30° diagonal acoustic path
`originating at X bansmit
`transducer and terminating
`at Y receive
`
`path
`
`}e
`
`Y Transmit
`Transducer
`1305
`
`
`&b&&
`4] S88
`
`X Acoustic Path [Hi]
`om = in
`Sensing Touch \V/;
`Location
`as?
`750reftectors
`Yeé
`
`Reflectors|Nt if
`
`peat,
`a
`
`
`
`
`
`|
`
`iB
`
`YTransmit
`Transducer
`1305?
`
`—
`
`39
`|
`poy] + |
`
`?
`|
`~
`|
`||
`
`[Sraee |
`9.4"
`
`X&Y reflectors
`
`Diagonal reflectors
`x010/0117003«for “third axis” data
`Nei
`5
`
`:
`
`licati
`
`SID DISPLAY WEEK ‘14
`
`ry)
`
`
`
`
`
`Surface Acoustic Wave...4
`
`«+ Both Elo Touch Solutions and General Touch (China)
`are emphasizing zero-bezel and two-touch SAW
`+ This makes sense because SAW and Win7/8 will be important
`in commercial applications for at least the next five years
`+ Both companies put the piezos and reflectors on the back of the
`glass to achieve zero-bezel
`+ For two-touch zero-bezel, Elo uses a single set of multiplexed
`reflectors on the back of the glass (see US/629969)instead of the
`two sets of reflectors used on top of the glass for two-touch normal
`
`Touch surface
`
`Surface wave
`
`bezel
`
`
`
`Shaped edge for
`Transducer
`Reflectors
`surface-wave flow
`
` SID DISPLAY WEEK ‘14
`
`
`
`
`
`Surface Acoustic Wave...5
`
`** Elo Touch Solutions’ zero-bezel SAW
`
`<= =
`
`
`
`SID DISPLAY WEEK ‘14
`
`Source: Photos by Author
`
`
`
`
`
`Surface Acoustic Wave...6
`
`“+ Size range
`+ 6” to 52” (but some integrators won't use it above 32”)
`«+ Advantages
`+ Clear substrate (high optical performance)
`+ Finger, gloved hand & soft-stylus activation
`+ Very durable; can be vandal-proofed with tempered or CS glass
`«+ Disadvantages
`+ Very sensitive to any surface contamination, including water
`+ Relatively high activation force (50-80g typical)
`+ Requires “soft” (sound-absorbing) touch object
`
`+ Can be challenging to seal
`
`** Applications
`+ Kiosks
`+ Gaming
`
`i
`
`Euro
`
`source:
`Kiosks
`eae
`
`SID DISPLAY WEEK ‘14
`
`244
`
`
`
`
`
`
`
`Surface Acoustic Wave...7
`
`“* Suppliers
`+ Elo Touch Solutions and General Touch have >90% share
`
`+ <10 suppliers
`** Market trends
`
`+ Two-touch and zero-bezel SAW should help reduce loss of
`share to p-cap in commercial applications
`e SAW will continue to grow moderately through 2017
`+ Chinese suppliers other than General Touch havesignificant
`difficulty competing due to distribution and brand limitations
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`ia
`
`Source: Elo TouchSystems
`
`Acoustic
`Pulse
`Recognition
`(APR)
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Acoustic Pulse Recognition...1
`
`Pure glass overlay
`
`5 mm border
`
`Bending waves
`touch signatures’)
`
`** Plain glass sensorwith
`4 piezos on the edges
`** Table look-up of bending
`wave samples (“acoustic
`
`Piezoelectric transducer
`
`Source: Elo Touch Solutions
`
`
`
` SID DISPLAY WEEK ‘14 247
`
`Koy
`
`
`
`
`
`Acoustic Pulse Recognition...2
`
`** Variations
`+ “Stationary APR” from 10” to 52” with controller board
`+ “Mobile APR”from 2.8” to 10” with controller ASIC
`
`«+ Advantages
`+ Works with finger, stylus or any other touch object
`+ Very durable & transparent touch sensor
`+ Very simple sensor(plain glass + 4 piezoelectric transducers)
`+ Resistant to surface contamination; works with scratches
`+ Totally
`flush top
`surface (“Zero-Bezel”
`
`«+ Disadvantages
`+ No “touch & hold”; no multi-touch
`+ Requires enough touch-object velocity (a tap) to generate waves
`+ Control of mounting methodin bezelis critical
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Acoustic Pulse Recognition...3
`
`** Outlook: Not good!
`+ It's not available as a component (touchscreen) because
`it requires unique calibration and specialized integration
`+ Unsuitable for applications that use the Windows UI because
`of the lack of touch-and-hold
`
`+ Unsuitable for public-access applications because
`of the need to tap (everyone today expects p-cap’s light touch)
`+ Unsuitable for consumerelectronics applications because
`of the lack of multi-touch
`
`+ Elo Touch Solutions (sole-source!) withdrew APR from digital
`signage applications because of poor performance (they’re using
`Lumio’s camera-basedoptical instead)
`+ What's left? POS terminals!
`
`SID DISPLAY WEEK ‘14
`
`249
`
`Gee
`
`
`
`
`
`Acoustic Pulse Recognition...4
`
`** APR and Sensitive Object
`+ Elo Touch Solutions (then part of Tyco Electronics) purchased
`Sensitive Object (“S.O.”) in January, 2010 for $62M
`+ Sensitive Object’s technology (“ReverSys’”) is so similar to APR
`that the two companies cross-licensed in July, 2007
`
`FE
`
`In the 3.5 years since
`Elo purchasedS.O.,
`there have been zero
`new products that can
`be attributed to the
`
`J
`
`acquisition Source: Sensitive Object
`
`SID DISPLAY WEEK ‘14
`
`rE!
`
`Tmo
`
`
`
`
`
`(DST)
`
`Dispersive
`Signal
`Technology
`
`Source: 3M
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Dispersive Signal Technology...1
`
`of flight” calculation)
`
`** Plain glass sensor
`with 4 piezosin
`the corners
`
`** Real-time analysis
`of bending waves
`in the glass (“time
`
`Shielded silver
`trace to piezo
`
`Source: 3M
`
`SID DISPLAY WEEK ‘14
`
`ry)
`
`intel)
`
`
`
`
`
`Dispersive Signal Technology...2
`
`«* Visualization of the effect of bending waves
`on a rigid substrate
`
`Source: 3M
`
`Initial Touch Contact
`
`Progressing Dispersion
`with the Beginning of
`Reflection Effects Down
`
`Highly Complex
`Dispersion Pattern with
`Reflections
`
`Post-Algorithm Pattern
`
`Waveform that would
`be sampled by APR
`
`Waveform resulting from
`processing by DSTalgorithms
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Dispersive Signal Technology...3
`
`«<* Size range
`32” to 55” (available only on displays sold by 3M-trained integrators)
`«+ Advantages
`+ Workswith finger, stylus or any other touch object
`+ Very durable & transparent touch sensor
`+ Very simple sensor(plain glass + 4 piezoelectric transducers)
`+ Operates with static objects or scratches on the touch surface
`+ Fast response;highly repeatable touch accuracy;light touch
`«+ Disadvantages
`+ No “touch & hold”; no multi-touch
`+ Control of mounting methodin bezelis critical
`** Applications
`+ Interactive digital signage; point-of-information (POI)
`«* Status: 3M has discontinued all new development
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Acoustic Touch Startup: Sentons
`
`** Sentons
`
`+ “The next generation in high-performance multi-touch interfaces”
`+ Afabless analog semiconductor startup
`e Taking a new approachto real-time bending-wave analysis, applying
`the ever-increasing CPU horsepowerprovided by Moore’s Law
`e 27” Sentons multi-touch touch-screen can be 30% of p-cap cost,
`even lower than camera-basedoptical
`+ Started byfive people from Telegent, the analog mobile-TV chip
`startup that flamed out in July 2011
`
`SENT@NS
`
`SID DISPLAY WEEK‘14
`
`Pah
`
`intel)
`
`Source: Sentons Website
`
`
`
`
`
`Optical Touch Technologies
`
`«* Traditional Infrared (IR)
`«+ Waveguide Infrared (DVT by RPO)
`¢* Multi-Touch Infrared
`** Camera-Based Optical
`«+ Planar Scatter Detection (PSD)
`“+ Vision-Based
`
`
`
`SID DISPLAY WEEK ‘14
`
`rss
`
`Gee
`
`
`
`
`
`Infrared
`
`Traditional
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Traditional Infrared...1
`
`
`
`Edge of active
`display area
`
`Opto-matrix
`
`
`LEDs create grid
`ofinfrared light
`
`Inside and outside
`edges of infrared
`transparent bezel
`
`SID DISPLAY WEEK ‘14
`
`Pa:
`
`
`
`frame inside bezel
`
`
`
`
`“Cross-beam”light paths
`ay.
`HATYT
`
`increases resolution and
`oea
`fault-tolerance in infrared
`touchscreens(Elo)
`
`rt
`
`bakes
`
`
`
`
`
`
`Traditional Infrared...2
`
`+ Variations
`
`+ Bare PCBvs. enclosed frame; frame width & profile height;
`no glass substrate; enhanced sunlight immunity; force-sensing
`“+ Size range
`+ 8” to 150”
`
`¢* Controllers
`
`+ Mostly proprietary, except I[RTouch (China)
`«* Advantages
`+ Scalable to very large sizes
`+ Multi-touch capable (only 2 touches, and with some “ghost” points)
`+ Can be activated with any IR-opaque object
`+ High durability, optical performance and sealability
`+ Doesn't require a substrate
`
`SID DISPLAY WEEK ‘14
`
`Pa)
`
`Te
`
`
`
`
`
`Traditional Infrared...3
`
`** Multi-touch in traditional infrared
`
`+ Limited to 2 not-so-good touches
`+ “Ghost” points are the problem, and there’s no goodsolution
`
`broken Y1 Y2<a
`
`vee¥4<
`Real1x Y1 O
`
`points|x4, Y2 QO a Y2 »
`
`points|x4,¥1 @
`X3=X4
`x1
`
`o>x
`
`Source: Drawing by Author
`
`SID DISPLAY WEEK ‘14
`
`rr
`
`
`
`
`
`Traditional Infrared...4
`
`«+ Disadvantages
`+ Profile height (IR transceivers project above touch surface)
`+ Bezel must be designedto include IR-transparent window
`+ Sunlight immunity can be a problem in extreme environments
`+ Surface obstruction or hover can cause a false touch
`+ Low resolution
`+ High cost
`«* Applications
`+ Large displays (digital signage)
`+ POS(limited)
`+ Kiosks
`
`
`
`«* Suppliers
`+ IRTouch Systems, Minato, Nexio, OneTouch, SMK, Neonode...
`+ 10+ suppliers
`
`SID DISPLAY WEEK ‘14
`
`rly
`
`Te
`
`
`
`
`
`Traditional Infrared...5
`
`** Mobile Infrared: Neonode
`mobile phone implemented
`with traditional IR touch (2009)
`+ Samebattery life as iPhone
`
`
`
`
`
`«* Neonode couldn't
`complete in the
`cellphone market
`and went bankrupt
`in 2009
`
`readers (2010)
`Source: PC World
`
`
`
`
`
`
`Pen Computing
`
`
`SID DISPLAY WEEK ‘14
`
`Source:
`Neonode &
`
`+ Low bezelprofile height (~1 Piminy
`
`i!
`
`+ Finger-only
`+ No multi-touch
`
` Sony e-book
`
`
`
`
`
`Traditional Infrared...6
`
`«+ Neonode in 2013 has becomethe largest supplier
`of touchscreens for eReaders!
`
`+ Amazon Kindle and B&N Nook both use Neonode
`
`+ Neonode hasstrong IP on methods of minimizing border width
`and profile height
`e They're also in transition from traditional infrared architecture
`to multi-touch infrared architecture
`
`+ Neonode has announced design winsin e-readers, smartphones,
`tablets, toys, printers, gaming consoles, in-flight infotainment
`systems, and automotive consoles
`e How muchofit is real beyond e-readersis unclear
`+ Neonode doesn’t supply any actual hardware,just licenses
`and engineering implementation consulting services
`
`SID DISPLAY WEEK‘14
`
`rx)
`
`intel)
`
`
`
`
`
` Se
`Infrared
`
`Waveguide
`
`Source: RPO
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`WaveguideInfrared...1
`
`** Objective
`+ Reduce IR touchscreen cost by replacing multiple |R-emitters with a
`single LED and using optical waveguidesto distribute the light and
`to channelit to a line-scan CMOSpixel array
`
`Light Source
`
`
`
`
`
`Traditional
`Infrared
`
`‘od
`
`Transmit Side
`Waveguides
`
`LCD Display
`
`Receive Side
`Waveguides
`
` SID DISPLAY WEEK ‘14
`
`Source: RPO
`
`
`
`
`
`Waveguide Infrared...2
`
`RPO’s actual
`construction
`(3.5” screen)
`
`IR LED \
`
`(white) |> Waveguides
`
`Substrate
`
`Parabolic
`reflector
`
`Light path
`
`Line-scan
`optical sensor
`
`Light path
`
`SID DISPLAY WEEK ‘14
`
`266
`
`,
`Source: Photo by RPO; Annotation by Author
`
`in substrate)
`
`
`
`
`
`Waveguide Infrared...3
`
`** RPO timeline
`+ AnnouncedIR optical-waveguide infrared touch at SID .... 2007
`+ Showedimproved performance at SID ......................... 2008
`+ Showedlarger'sizes at SID ssscscissisccserazicsssmasrcwsammennnes 2009
`+ Appeared in a 13.3” LG Display notebook at SID ............ 2010
`+ Wentinto “voluntary administration”(liquidation) in April ... 2011
`+ Sold all assets to an NPE (patenttroll) in February ......... 2012
`(along with Poa Sana’s assets... it’s a long story!)
`“* Whydidit fail?
`+ There wasn’t any particular application for which it was “best”
`+ Waveguide technology limited touchscreen size to under ~14”
`+ RPO bet on one big partner in 2010 who cancelled their project
`abruptly, leaving the companywith insufficient $$$ to keep going
`
`SID DISPLAY WEEK ‘14
`
`ra
`
`Gee
`
`
`
`
`
`Infrared
`
`Multi-Touch
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Multi-Touch Infrared...1
`
`«> A little bit of history on the 2"4-oldest touch technology
`+ IR touchfirst appeared in 1972 (PLATOIV instructional terminal)
`+ IR touch was usedin HP’sfirst microcomputer, the HP150,in 1983
`+ After 30+ years of stability, it's changed from single-touch to
`(briefly) 2-touch, and now multi-touch!
`
` Source: University of Illinois
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Multi-Touch Infrared...2
`
`«+ “PQ Labs” method
`
`
`
`= IR emitter
`
`G = IR receiver
`
`+ 6 to 32
`touches
`
`+ 32” to 103”
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Multi-Touch Infrared...3
`
`«* “PulselR” (Image Display Systems) method
`LED,
`
`BEEBEBREBRBSBBBDBBBEBHBBBAAB
`
`—EEBEREBBEBEERBRBEBBBERBEBBEB
`
`LED,
`LED,
`
`LED,a fH = IR emitter
`BEBBBBBBRBEBBBEBRBERBEBEBREES
`
`W = IR receiver
`
`+ 2 to 40
`touches
`
`+ 5” to 103”
`
`LED,
`BEEBE BBBBRBEBBOBEBRBEBBBRBEBRBBRBEBBBBAA
`
`Source: Author
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Multi-Touch Infrared...4
`
`** Another possible method... being used?
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Multi-Touch Infrared...5
`
`«+ Variations
`+ Numberof touch points: 2 to 48 (determined by the controller)
`+ Architecture: 3 different ways of organizing the IR emitters
`and receivers (so far)
`e PQ Labsis licensing; others may be also
`«+ Controller
`+ Proprietary; generally requires a large amount of processing
`«+ Advantages
`+ High numberof multi-touch points
`+ Object-size recognition
`e Controller maintains position & size data for all touching objects
`+ Similar advantagesto those oftraditional infrared
`e Workswith a finger, stylus or any other IR-opaque touch object
`e Scalable to very large sizes (at some cost)
`e High durability and sealability
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Multi-Touch Infrared...6
`
`«+ Disadvantages
`+ Relatively low resolution (can get stair-stepping in lines)
`+ Increased processing load as size and numberof touches goes up
`+ Different minimum-object-size specfor stationary & moving objects
`+ Large objects close to emitters can decrease performance
`+ As with anytraditional IR system, pre-touch (or “pen-up”) is mostly
`a big problem that gets worse as the screen size increases
`+ Most can't meet Win8 Logo dueto pre-touch and accuracy
`«* Applications
`+ Multi-player games on large horizontal displays
`+ Multi-user interactive digital signage
`+ 3D design andinteraction; data visualization for business
`+ NOT interactive “whiteboard” displays due to pre-touch/pen-up
`
`
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Multi-Touch Infrared...7
`
`«+ Latest new multi-touch infrared product:
`“Projected Infrared Touch”(PIT) from General Touch
`+ Proprietary design using traditional opto layout (like PQ Labs)
`+ Meets Win8 Logo
`+ Bezelis a light-guide/prism (2.5 mm high, 4 mm wide)that
`allows IR emitters & receivers to be located underthe cover-glass,
`outside the LCD frame (reduced parallax due to no PCBontop)
`
`
`
`Source: General Touch
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Multi-Touch Infrared...8
`
`«+ Additional PIT features
`
`+ 15” to 42” size range standard; over 42” is custom
`e First sizes to launch in 2Q-2013 are 21.5” & 23” (for AiO)
`+ 2-touch for lowest cost; 5-touch for Win8; 10-touch for high-end
`e Only the controller changes
`+ Entire surface is touch-active, including the 20 mm (MS) border
`e Active icons can besilk-screened in the border’s black matrix
`
`+ Pre-touch meets the Win8 spec of 0.5 mm
`e Exceptionally low for any infrared touchscreen
`+ Touch surface can be any material that meets surface flatness spec
`e Can be sealed to IP65
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`
`
`
`k, Camera-
`Based
`= Optical
`
`
`ees
`
`touch-screen bya visitor to the AETI Exhibition in London on January 24, 2006.
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Camera-Based Optical...1
`
`[[Sfteeoto]2)Trove CO GG Hd GP HE Peakdetec Aotan|
`
`ShomApetaes [~ oesres||Semaesrae|5Satna |HoldotiO |
`
`
`IE pg reece
`“Cheeseating=20
`LED reflecting directly~ ine76in=a=28
`into the optica sensor | ;
`;
`
`
`
`LightIntensity
`
`«+ Win7 = 2 touches; 2 camerasdid it (inadequately)
`«“* Win8 = 5 touches; 6 camerasare required
`
`Glass Substrate
`
`
`
`- Touch Point
`
`
`108
`158
`208
`28
`me
`358
`
`Optical SensorPixel Position
`
`Source: NextWindow
`
` SID DISPLAY WEEK ‘14
`
`
`
`
`
`Camera-Based Optical...2
`
`** Two touches with two cameras (Win7 market focus)
`had two main limitations
`
`Cameras
`
`Cameras
`
`Ghost touches
`
`Source: Author
`
`Occlusions
`
`The quality of the touch experience depended on the sophistication
`of the algorithms that handled ghost touches and occlusions
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Camera-Based Optical...3
`
`¢* Another alternative: A mirror creates “virtual cameras”
`
`Virtual
`Virtual
`camera
`a
`|.fff/
`|
`|
`
`Mirror
`°
`
`
`+ Results
`+ SMARTinventeditin
`2003 but shelvedit
`+ Lumiotried it in 2010 but
`found that four real
`cameras werebetter
`
`e Lower cost
`
`e No mirror alignment
`issues
`e Less sensitivity to
`environment
`e Fewerpixels required
`for same resolution
`:
`e Less CPU processing
`
`PET
`
`intel)
`
`oO
`
`cS
`S
`£
`=
`7
`
`=.
`
`—
`5
`D
`So
`
`——
`Illumination
`Source: Lumio
`SID DISPLAY WEEK ‘14
`
`Camera
`
`Camera
`
`
`
`
`
`Camera-Based Optical...4
`
`¢* Another alternative: Baanto ShadowSense”
`
`90° aata
`
`~170° FOV Sensors
`
`reflectors
`
`90° FOV Sensor
`+ Baanto’s sensors
`aren't cameras;
`they're PIN
`diodes (photo-
`detectors)
`+ 940 nm LEDs
`provide back
`illumination
`instead of retro-
`
`| Erasers
`
`LED Emitters
`
`Source: Baanto
`
`
`
`SID DISPLAY WEEK ‘14
`
`(“FOV” = Field of View)
`
`
`
`
`
`Camera-Based Optical...5
`
`«+ Baanto’s competitive comparison
`+ 4 sources of sensor-data work muchbetter than two!
`
`“* Suppliers
`+ NextWindow (SMART)
`+ Lumio
`
`+ |RTouch
`
`+ Xiroku/elT
`
`+ Baanto
`
`+ LG Displays
`+ Qisda
`
`+ Several more in China
`
`Baanto
`
`Competitor
`
`Source: Baanto
`
`SID DISPLAY WEEK ‘14
`
` Te
`
`
`
`
`
`Camera-Based Optical...6
`
`«+ Advantages
`+ Stylus independence
`+ Scalability to large sizes (15” to 120”)
`+ Multi-touch (2-5 touches)
`+ Object-size recognition
`+ Low cost
`
`f
`
`HP TouchSmart all-in-one computer
`“ure
`
`
`
`eS,
`“+ Disadvantages
`+ Profile height (~3 mm on a 19” screen)
`+ The “unintended touch” problem
`+ Screen rigidity requirement
`** Applications
`+ Consumertouch monitors & AiOs
`
`+ Interactive digital signage, point-of-information, & education
`
`SID DISPLAY WEEK ‘14
`
`283
`
`Tee
`
`
`
`
`
`Camera-Based Optical...7
`
`** Optical is able to meet the Win8 touch specifications
`+ NextWindow’s newest desktop-component product (15” to 30”)
`
`uses six CMOS cameras(4 in the corners + 2 on the top edge)
`
`Source: Jennifer Colegrove (DisplaySearch)at FineTech 2012
`
`
`
` SID DISPLAY WEEK ‘14 ray
`
`
`
`
`
`Camera-Based Optical...8
`
`«* The range of form-factors and configurations
`in which optical touch is used is expanding
`
`Cameras & lasers
`at top of video wall
`
`Se)@
`
`—to—col iE =
`es~ ELI *:
`
`Source: Photos by Author
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Camera-Based Optical...9
`
`** Outlook
`+ Touch on the consumer desktop (in Win7 AiOs)failed to
`take off due to lack of any applications
`e Touch penetration hit 30% in 2010 but dropped to ~10% in 2012
`+ Win8 may drive more penetration, but thereis still the
`“gorilla arm” usage-model question
`e “Adaptive” AiOs will help address that issue
`+ Camera-based optical touch is
`ideal for large-format, but...
`e Theinteractive digital-signage
`market hasn’t emerged yet
`e Interactive information on large
`screens is still a niche market
`e The education market (whiteboards)
`
`has beenslow to adopt optical
`
`because of entrenchedresistive
`Dell ST2220T (Win7) Touch Monitor
`
`and electromagnetic technologies
`
`SID DISPLAY WEEK ‘14
`rE
`intel)
`
`
`
`
`
`
`
`Source: FlatFrog
`
`Planar
`Scatter
`Detection
`(PSD)
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Planar Scatter Detection...1
`
`
`Total Internal
`IR Emitter
`Reflection (TIR)
`IR Receiver
`elsl
`
`
`Substrate (any
`Scattered Light (FTIR)
`transparent material,
`flat or curved)
`
`
`
`Source: FlatFrog
`
` SID DISPLAY WEEK ‘14 rE:
`
`
`
`
`
`
`
`
`
`Planar Scatter Detection...2
`
`«+ Characteristics it shares with p-cap
`+ Flush surface (“zero bezel”)
`+ Very light touch
`+ Multi-touch (40 touches)
`+ Windows 8 Logo
`«* Characteristics that are better than p-cap
`+ Plain glass or plastic substrate (0.3 mm) —no ITO
`+ Works with glove, stylus or other objects (400 dpi)
`+ Pressure-sensitive (10 bits)
`+ Insensitive to EMI/RFI
`
`+ High scan-rate for larger screens (up to 1 KHz)
`+ Lowercost
`
`
`
`Source: FlatFrog
`
`SID DISPLAY WEEK ‘14
`
`rt
`
`Toy
`
`
`
`
`
`Planar Scatter Detection...3
`
`“* Size range
`+ 32” (with display) at launch in May, 2012
`+ Practical size range 15” to 84”
`«+ Disadvantages
`+ Initial product is a 32” display for $5,500 MSRP (+$190 housing)
`+ Designedfor indoor use (no sunlight) without dust or smoke
`e Limited to 30°C ambient due to display
`e Sensitive to contamination on surface
`+ Scaling to larger sizes is similar to traditional infrared
`e ~200 IR emitter-receiver pairs required for 32” display; 96 pairs for 22”
`+ FlatFrog is a small companywith limited resources
`
`SID DISPLAY WEEK ‘14
`
`
`
`
`
`Planar Scatter Detection...4
`
`«+ Applications
`
`command & control
`
`+ Realistic today: Gaming,digital
`signage, POI, medical, hospitality,
`+ Future: consumerelectronics, education
`
`
`
`ay e ol
`
`
`a) FS ry ee
`
`5) cl
`
`¢* Full disclosure:
`
`Source: FlatFrog
`
`+ Intel has invested in andis doing a joint developmentproject with
`FlatFrog to extend and improve the technology beyond whatthey
`have already done
`e Current focus is onall-in-one PCs (20”to 30”)
`+ Supply-chain (availability) will also be improved
`
`SID DISPLAY WEEK ‘14
`
`291
`
`Tie
`
`
`
`
`
`Optical-Touch Startup: RAPT
`
`“ RAPT
`
`+ “Opto-electro-mechanical” (rumored to be similar to FlatFrog)
`+ “The most robust multi-touch system on the planet and quite
`different from current solutions in the market’
`
`Curved Surfaces ii
`Source: RAPT Website SID DISPLAY WEEK ‘14
`
`Capacitive
`/
`
`Optical
`
`te
`
`"A
`
`/ "
`
`A
`
`Multi-touch Robustness
`
`Jute teet
`
`Ambient Light Performance
`
`Flush Display
`
`Cost Effectiveness
`
`Large Screen
`Glove and Stylus
`
`
`
`
`
`
`
`Source: Perceptive Pixel
`
`Vision-
`Based
`
`SID DISPLAY WEEK ‘14
`
`293
`
`
`
`
`
`Vision-Based...1
`
`
`
`«+ Principle (Simplest version)
`
`otejen 7Reflection (TIR)
`
`
`
`
`Multiple touch points;
`Image taken without a diffuser
`(Source: Perceptive Pixel)
`
`/ /
`
`Baffle Diffuser
`
`Scattered
`
`Light
`
`Video Camera
`
`Projector
`
`Frustrated Total
`Internal Reflection
`(FTIR)
`
`Source: Perceptive Pixel
`
`SID DISPLAY WEEK ‘14
`
`294
`
`Wey
`
`
`
`
`
`Vision-Based...2
`
`Microsoft
`“Surface computing is about integrating the physical and
`Surface
`virtual worlds through the use of vision-based touch”
`(v1, 2007) a as
`|
`Source: Information Display
`Projector
`resolution
`1024x768
`
`1280x960
` 2 Of~ 1 — Screen with diffuser
`
`Touch
`resolution
`
`he
`
`2 -IRLEDlight source
`3 — Four IR cameras
`4 — DLPprojector
`5 — Vista desktop
`
`i
`
`.
`
`Source: Popular Mechanics
`
`SID DISPLAY WEEK ‘14
`
`295
`
`intel)
`
`
`
`
`
`Vision-Based...3
`
`“* Samsung SUR40 with Microsoft Surface (v2.0, 2012)
`
`ee)
`
`4" thick
`on surface
`Source: TechCrunch.com
`
`Document
`
`Source: Mi