throbber
Surface Capacitive...3
`
`«+ Disadvantages
`+ No multi-touch
`+ Finger-only (or tethered pen)
`+ Calibration drift & susceptible to EMI
`+ Moderate optical quality (85% - 90%)
`«+ Applications
`+ Regulated (casino) gaming
`+ Point-of-Sale (POS) terminals
`+ Point-of-Information (PO vinecle
`+ Medical equipment
`rT
`Matocrerperce
`|
`
`
`
`«* Suppliers
`
`— = + 3M is the only significant supplier left
`
`“+ Status
`
`Source: 3M
`
`+ It will be an irrelevant, obsolete technology in 5-7 years
`
` SID DISPLAY WEEK ‘14
`(intel)
`
`SAMSUNG EXHIBIT 1011 (Part 3 of 3)
`
`

`

`Wacom’s Improved RRFC
`Surface Capacitive Technology...1
`
`“* How it works
`
`+ Alinear voltage AND a ramp-shaped
`electrostatic field is created on the
`surface by applying AC on 2 corners &
`DC on the other two corners
`
`+ Controller switches signals around all
`4 corners, creating 4 rampfields vs.
`single flat field in standard capacitive,
`and measurescurrent in each case
`
`
`
`+ Resulting touch-eventsignalis
`independentof all capacitance effects
`except those dueto finger-touch
`+ Controller does additional digital signal
`(Trademark = CapPLUS)
`processing to compensate forfactors
`RRFC= Reversing Ramped
`that affect accuracy anddrift
`Ren Saas
`
`
`SID DISPLAY WEEK ‘14
`
`Source: Wacom
`
`
`
`

`

`Wacom’s Improved RRFC
`Surface Capacitive Technology...2
`
`«+ Advantages
`+ Solves all the problemsof traditional surface capacitive
`e Works in mobile & stationary devices (10” to 32” now; 46” capable)
`
`e Unaffected by grounding changes, EMI, variations in skin dryness
`& finger size, temperature, humidity, metal bezels, etc.
`e Works outdoorsin rain and snow
`
`e Works through latex or polypropylene gloves
`e Allows 4X thicker hardcoatfor improved durability
`+ Uses same ASIC as Wacom’s EMR pendigitizer, so dual-mode
`input is lower cost & moreefficient (e.g., in Tablet PC)
`«+ Disadvantages (2 very big ones!)
`+ No multi-touch
`
`+ Sole-source supplier
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Resistive Touch Technologies
`
`«+ Analog Resistive
`** Analog Multi-Touch Resistive (AMR)
`** Digital Multi-Touch Resistive (DMR)
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Resistive
`
`Analog
`
`Source: Engadget
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Analog Resistive...1
`
`Conductive coating
`
`(ITO)
`
`substrate
`
`
`
`Source: Bergquist
`
`4G
`
`lass
`
`4 F
`
`lexible
`hard-coated— [©
`outer membrane
`
`(PET)
`
`Source: Elo Touch Solutions
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Analog Resistive...2
`(4-Wire Construction)
`
`
`
`Equivalentcircuit
`
`Voltage
`measured
`on glass
`
`psaeeMueaeetniy
`
`$3:
`
`oom
`
`
`
`measured on
`coversheet
`
`:
`
`HHHHTTE
`
`333pets
`ei33
`erta
`prrititsassartrtrsassasaerertisa3¢
`piatatsarrrrets
`sitesissssstespeeesssasesese
`3isagstiesess
`sasasetteetass
`+3]
`+
`+
`
`X-Axis
`
`
`
`Voltage
`gradient
`applied
`across
`
`Voltage
`gradient
`applied
`across
`coversheet
`
`sree eee seersisiess
`heesag
`PsatECPENSHESSeaaseeeSteediene
`
`aasaeetees
`poasateees
`paaaerers
`eteeeees
`seaasrcess
`
`
` Voltage
`oOo =” Y-Axis
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Analog Resistive...3
`(5-Wire Construction)
`
`
`
`X-Axis
`
`eessatetisensesesessesees
`seaaaatenslsstsesesaaaeaaes
`errr)
`perrrett
`eeeheees:
`3
`eeeeriaastsrerrs
`prererts
`SPrShreeeieeees
`ee}
`REReesiteretetts
`prseet
`presessagastenes
`sar otereseer ceessesesesrers
`poeseesecoreses
`Rictehehibeseeemmesaeeereeeieerettseececerss
`
`Contact point
`on coversheetis
`a voltage probe
`
`Linearization
`attern
`
`peetanaaeaeeenees
` Sieasateritesreteeresseeste
`
`Oo
`Voltage
`gradient
`applied
`across
`glassin
`X-axis
`
`8
`Voltage
`gradient
`applied
`across
`glassin
`Y-axis
`
`hegrest
`;
`
`igs
`sesea
`Pebtaesaaliaassasnneeetssaeas
`eeeessass
`iittsssecesestsasaae
`simedirstteHaaaiass
`Seeetsag
`EEE HT
`
`ae
`:
`S
`
`Equivalentcircuit
`
`E
`
`Contact point
`on coversheet
`is a voltage
`probe
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Analog Resistive...4
`
`“* Types
`+ 4-wire (low cost, short life) is common in mobile devices
`+ 5-wire (higher cost, long life) is commonin stationary devices
`+ 6-wire & 7-wire = obsolete 5-wire; 8-wire = replacement only
`«+ Constructions
`
`+ Film (PET) + glass (previousillustration) is the most common
`+ Film + film (used in some cellphones) can be madeflexible
`+ Glass + glass is the most durable; automotive is the primary use
`+ Film + film + glass, others...
`«+ Options
`+ Surface treatments (AR, AG, AF, AC, AB),
`rugged substrate, dual-force touch,
`high-transmissivity, surface armoring,
`manyothers...
`
`
`SID DISPLAY WEEK ‘14
`
`rey
`
`
`
`(50-uM glass) Source: Schott
`
`
`
`

`

`Analog Resistive...5
`
`“* Size range
`+ 1° to ~24” (>20”is rare)
`** Controllers
`+ Many sources
`+ Single chip, embeddedin chipset/CPU,
`or “universal” controller board
`«* Advantages
`+ Workswith finger, stylus or any non-sharp object
`+ Lowest-cost touch technology
`+ Widely available (it’s a commodity)
`+ Easily sealable to IP65 or NEMA-4
`+ Resistant to screen contaminants
`+ Low power consumption
`
`
`yee
`
`Source:Liyitec
`
`SID DISPLAY WEEK ‘14
`
`ree
`
`
`
`Source: Microchip
`
`
`
`

`

`Analog Resistive...6
`
`«+ Disadvantages
`+ Not durable (PET top surface is easily damaged)
`+ Pooroptical quality (10%-20% light loss)
`+ No multi-touch
`
`“+ Applications
`
`+ Mobile devices (shrinking) a
`
`+ Automotive
`
`
`+ Point of sale (POS) terminals
`
`+ Industrial ——————> ]
`
`= «
`
`Source: Sinocan
`
`+ Wherevercostis #1
`
`Source: Renu
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Analog Resistive...7
`
`“* Suppliers
`+ Young Fast, Nissha, Nanjing Wally, Truly, EELY, Mutto, J-Touch...
`+ 60+ suppliers
`** Market trends
`
`+ Analog resistive is shrinking in units and revenue
`e P-cap dominates in most consumerapplications
`+ Analog resistive is still significant in commercial applications
`e Especially POS andindustrial-control terminals
`
`SID DISPLAY WEEK ‘14
`
`Ps
`
`
`
`

`

`Analog
`Multi-Touch
`Resistive
`
`g 3
`
`Source: TouchInternational
`
`SID DISPLAY WEEK ‘14
`
`226
`
`DUP? (23163
`B45 CGO) CLEAR VIEW AREA
`B34S3 (2120) ACTIVE AREA
`
`COS (42D
`(261 (66D
`
`gaizg==2+
`Sass!LLL=e
`i
`i
`t
`i
`;
`i
`i
`ee
`:
`.‘a1‘
`'
`'
`'
`{
`nahnnd wondnnnt- antes ombao ncton
`nat
`a oe eepie|
`PtCroesnub—-morimerer
`
`*“a”.aa
`
`+
`
`
`
`

`

`Analog Multi-Touch Resistive...1
`
`“4-wire analog touchscreen”
`
`"
`
`for consumerproduct a
`
`SID DISPLAY WEEK ‘14
`
`227
`
`Gee
`
`Source: The Author
`
`“+ Multiple names
`+ AMR (Analog Multi-
`Touch/Matrix Resistive)
`+ MARS(Multi-Touch
`Analog Resistive Sensor)
`+ “Hybrid analog-digital”
`«+ Primary limitation
`
`fingers on the same
`
`~
`
`eo
`
`ittchannel” 10-20 mm
`”faapancenties ——
`
`
`
`ttttt
` Typical AMR design e—
`
`
`
`

`

`Analog Multi-Touch Resistive...2
`
`X axis! 7.08)
`
`Out Ares 495.608),50
`
`(7.98)
`View Ares (479.64)
`(7.98)
`aven.0
`Active Area477.6410.50
`|.
`898¢0.50 Actua|
`
`21371oO|Product
`|
`247.8040.50
`=)4
`
`
`
`
`
`
`
`
`
`
`
`
`Ce
`CCCCLELCILIELLIxeeeCTLEMLLL
`|
`COPeer s
`| (ECeee 21.5” analog
`ICLTITTITITITITrTitTtittttyyertis multitouch
`gs

`(EEEeeeeee ae
`le PEPer » resistive by
`fee ECEECCee P eTibeTotich
`q\=|2
`3
`aela a esee es /
`382
`mTTTTTeePr
`99x 17 lines
`POCCCCCCEeeeLEELEE
`PCCCCCCCEEEELEE
`=17 mmx
`COPeeereeTT
`CCOLOOCECEELEEEeEeELEEE
`rrPreretTrrrrfrereerereteeeeeeeetete 16 mm squares
`eT (90 pins)
`patPAe p
`
`i Mmrll|nsstom|C|10.54)
`11,$430.50
`y
`, 23” = 35 x 22 lines
`q7!) 18mmx 13mm
`—
`(114 pins)
`
`214.80+1,00
`Page228 of315 Ge
`
`
`SID DISPLAY WEEK ‘14
`
`a)
`
`
`
`

`

`Analog Multi-Touch Resistive...3
`
`“+ Gateway ZX6910 AiO with 23” AMR touchscreen from
`eTurboTouch
`
`+ Example of a failed consumer product with 15x13 mm AMR
`e Drawing parallel lines with two closely held fingers
`
`
`
`Source: Photos by Author
`
`
`
` SID DISPLAY WEEK ‘14 yd
`
`
`
`

`

`Analog Multi-Touch Resistive...4
`
`«* Controllers
`+ AD Semi & others; some home-grown(e.g., Touch International)
`«* Suppliers
`+ eTurboTouch, Touch International, Mildex, Mutto, EETI...
`«+ Advantages
`+ Multi-touch (but without two touches on the same square)
`+ Simple & familiar resistive technology
`+ Lowercost than p-cap
`«+ Disadvantages
`+ Poor durability (PET top surface)
`+ Pooroptical performance
`+ Non-zero touch force
`
`+ Industrial & other commercial
`
`«+ Applications
`
`
`
`SID DISPLAY WEEK ‘14
`
`Source: Apex
`
`
`
`

`

`
`
`Digital
`Multi-Touch
`Resistive
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Digital Multi-Touch Resistive...1
`
`«+ Stantum’s product (iVSM)
`+ “Interpolated Voltage-Sensing Matrix”
`+ Stantum’s strategy is to license
`controller IP to IC manufacturers,
`not to sell touchscreens
`
`+ Aimed at tablets
`
`“Mechanical contact switch” SID DISPLAY WEEK ‘14
`
`+ Fine pitch results in a
`much higher number
`of connections than
`AMR (400+ on a 10”
`tablet screen)
`e 250-290 |/O’s per controller
`
`
`
`

`

`Digital Multi-Touch Resistive...2
`
`«* Controllers
`+ ST Micro is currently the only one
`e Numberof touch points is controller-dependent(2-10)
`«+ Advantages
`+ Multi-touch
`+ Simple & familiar resistive technology
`+ Lowercost than p-cap
`«+ Disadvantages
`+ Poor durability (PET top surface)
`+ Poor optical performance
`+ Non-zero touch force
`
`“+ Applications
`+ Commercial mobile applications such as education
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Digital Multi-Touch Resistive...3
`
`«+ Stantum’s successes(against a BIG P-cap headwind)
`+ Co-developed a pen & finger solution with Nissha
`for 5.7 to 12-inch tablets
`+ Licensed IP to a US-based semiconductor vendor developing
`a controller optimized for 5.7” to 12” tablets
`+ Design win with a tier-1 OEM for a pen & finger A4 e-reader
`targeted at education and note-taking
`+ Two 7”tablets for military applications (one by Harris)
`+ 10.4” professional lighting-control application (Europe)
`+ Signed a licensing agreementwith a tier-1 OEM for a mobile
`enterprise tablet
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Digital Multi-Touch Resistive...4
`
`«+ One of Stantum’s shipping (military) OEM products
`
`*~
`
`Bs
`
`iil,
`
`
`
`%
`
`Source:
`Harris
`
`
`
`“A new 7-inch Android tablet that's so hard-as-nails it would
`make a Galaxy Tab go homeandcall its mother” (Engadget)
`
`SID DISPLAY WEEK ‘14
`
`PES
`
`
`
`

`

`Digital Multi-Touch Resistive...5
`
`«* The funny thing is, Stantum’s original products were
`the first commercial products to use multi-touch!
`+ In 2005, when the companywasselling music controllers
`under the name “Jazz Mutant”
`
`
`
`Source: Jazz Mutant
`
`SID DISPLAY WEEK ‘14
`
`PEM
`
`
`
`

`

`Acoustic Touch Technologies
`
`** Surface Acoustic Wave (SAW)
`** Acoustic Pulse Recognition (APR by Elo)
`** Dispersive Signal Technology (DST by 3M)
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Wave
`
`Surface
`Acoustic
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Surface Acoustic Wave...1
`
`Glass substrate
`
`Y- axis transmitting transducer
`
`Y- axis receiving transducer
`
`transducer
`transducer X- axis transmitting
`
`Edge of Active Area
`
`Arrayof reflectors (45°)
`
`Source: A-Touch
`
`Rayleigh wave
`
`Source: Onetouch
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Surface Acoustic Wave...2
`
`Transmit
`Burst
`
`Amplitude
`
`Touch Effect
`
`Time os
`proportional
`to distance
`
`Source: Elo Touch Solutions
`
`Time
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Surface Acoustic Wave...3
`
`
`
`** How two touches are supported by SAW
`
`X Transmit
`Transducer
`
`1301
`
`
`
`
`
`
`
`1301
`
`30° diagonal acoustic path
`originating at X bansmit
`transducer and terminating
`at Y receive
`
`path
`
`}e
`
`Y Transmit
`Transducer
`1305
`
`
`&b&&
`4] S88
`
`X Acoustic Path [Hi]
`om = in
`Sensing Touch \V/;
`Location
`as?
`750reftectors
`Yeé
`
`Reflectors|Nt if
`
`peat,
`a
`
`
`
`
`
`|
`
`iB
`
`YTransmit
`Transducer
`1305?
`
`—
`
`39
`|
`poy] + |
`
`?
`|
`~
`|
`||
`
`[Sraee |
`9.4"
`
`X&Y reflectors
`
`Diagonal reflectors
`x010/0117003«for “third axis” data
`Nei
`5
`
`:
`
`licati
`
`SID DISPLAY WEEK ‘14
`
`ry)
`
`
`
`

`

`Surface Acoustic Wave...4
`
`«+ Both Elo Touch Solutions and General Touch (China)
`are emphasizing zero-bezel and two-touch SAW
`+ This makes sense because SAW and Win7/8 will be important
`in commercial applications for at least the next five years
`+ Both companies put the piezos and reflectors on the back of the
`glass to achieve zero-bezel
`+ For two-touch zero-bezel, Elo uses a single set of multiplexed
`reflectors on the back of the glass (see US/629969)instead of the
`two sets of reflectors used on top of the glass for two-touch normal
`
`Touch surface
`
`Surface wave
`
`bezel
`
`
`
`Shaped edge for
`Transducer
`Reflectors
`surface-wave flow
`
` SID DISPLAY WEEK ‘14
`
`
`
`

`

`Surface Acoustic Wave...5
`
`** Elo Touch Solutions’ zero-bezel SAW
`
`<= =
`
`
`
`SID DISPLAY WEEK ‘14
`
`Source: Photos by Author
`
`
`
`

`

`Surface Acoustic Wave...6
`
`“+ Size range
`+ 6” to 52” (but some integrators won't use it above 32”)
`«+ Advantages
`+ Clear substrate (high optical performance)
`+ Finger, gloved hand & soft-stylus activation
`+ Very durable; can be vandal-proofed with tempered or CS glass
`«+ Disadvantages
`+ Very sensitive to any surface contamination, including water
`+ Relatively high activation force (50-80g typical)
`+ Requires “soft” (sound-absorbing) touch object
`
`+ Can be challenging to seal
`
`** Applications
`+ Kiosks
`+ Gaming
`
`i
`
`Euro
`
`source:
`Kiosks
`eae
`
`SID DISPLAY WEEK ‘14
`
`244
`
`
`
`
`
`

`

`Surface Acoustic Wave...7
`
`“* Suppliers
`+ Elo Touch Solutions and General Touch have >90% share
`
`+ <10 suppliers
`** Market trends
`
`+ Two-touch and zero-bezel SAW should help reduce loss of
`share to p-cap in commercial applications
`e SAW will continue to grow moderately through 2017
`+ Chinese suppliers other than General Touch havesignificant
`difficulty competing due to distribution and brand limitations
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`ia
`
`Source: Elo TouchSystems
`
`Acoustic
`Pulse
`Recognition
`(APR)
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Acoustic Pulse Recognition...1
`
`Pure glass overlay
`
`5 mm border
`
`Bending waves
`touch signatures’)
`
`** Plain glass sensorwith
`4 piezos on the edges
`** Table look-up of bending
`wave samples (“acoustic
`
`Piezoelectric transducer
`
`Source: Elo Touch Solutions
`
`
`
` SID DISPLAY WEEK ‘14 247
`
`Koy
`
`
`
`

`

`Acoustic Pulse Recognition...2
`
`** Variations
`+ “Stationary APR” from 10” to 52” with controller board
`+ “Mobile APR”from 2.8” to 10” with controller ASIC
`
`«+ Advantages
`+ Works with finger, stylus or any other touch object
`+ Very durable & transparent touch sensor
`+ Very simple sensor(plain glass + 4 piezoelectric transducers)
`+ Resistant to surface contamination; works with scratches
`+ Totally
`flush top
`surface (“Zero-Bezel”
`
`«+ Disadvantages
`+ No “touch & hold”; no multi-touch
`+ Requires enough touch-object velocity (a tap) to generate waves
`+ Control of mounting methodin bezelis critical
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Acoustic Pulse Recognition...3
`
`** Outlook: Not good!
`+ It's not available as a component (touchscreen) because
`it requires unique calibration and specialized integration
`+ Unsuitable for applications that use the Windows UI because
`of the lack of touch-and-hold
`
`+ Unsuitable for public-access applications because
`of the need to tap (everyone today expects p-cap’s light touch)
`+ Unsuitable for consumerelectronics applications because
`of the lack of multi-touch
`
`+ Elo Touch Solutions (sole-source!) withdrew APR from digital
`signage applications because of poor performance (they’re using
`Lumio’s camera-basedoptical instead)
`+ What's left? POS terminals!
`
`SID DISPLAY WEEK ‘14
`
`249
`
`Gee
`
`
`
`

`

`Acoustic Pulse Recognition...4
`
`** APR and Sensitive Object
`+ Elo Touch Solutions (then part of Tyco Electronics) purchased
`Sensitive Object (“S.O.”) in January, 2010 for $62M
`+ Sensitive Object’s technology (“ReverSys’”) is so similar to APR
`that the two companies cross-licensed in July, 2007
`
`FE
`
`In the 3.5 years since
`Elo purchasedS.O.,
`there have been zero
`new products that can
`be attributed to the
`
`J
`
`acquisition Source: Sensitive Object
`
`SID DISPLAY WEEK ‘14
`
`rE!
`
`Tmo
`
`
`
`

`

`(DST)
`
`Dispersive
`Signal
`Technology
`
`Source: 3M
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Dispersive Signal Technology...1
`
`of flight” calculation)
`
`** Plain glass sensor
`with 4 piezosin
`the corners
`
`** Real-time analysis
`of bending waves
`in the glass (“time
`
`Shielded silver
`trace to piezo
`
`Source: 3M
`
`SID DISPLAY WEEK ‘14
`
`ry)
`
`intel)
`
`
`
`

`

`Dispersive Signal Technology...2
`
`«* Visualization of the effect of bending waves
`on a rigid substrate
`
`Source: 3M
`
`Initial Touch Contact
`
`Progressing Dispersion
`with the Beginning of
`Reflection Effects Down
`
`Highly Complex
`Dispersion Pattern with
`Reflections
`
`Post-Algorithm Pattern
`
`Waveform that would
`be sampled by APR
`
`Waveform resulting from
`processing by DSTalgorithms
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Dispersive Signal Technology...3
`
`«<* Size range
`32” to 55” (available only on displays sold by 3M-trained integrators)
`«+ Advantages
`+ Workswith finger, stylus or any other touch object
`+ Very durable & transparent touch sensor
`+ Very simple sensor(plain glass + 4 piezoelectric transducers)
`+ Operates with static objects or scratches on the touch surface
`+ Fast response;highly repeatable touch accuracy;light touch
`«+ Disadvantages
`+ No “touch & hold”; no multi-touch
`+ Control of mounting methodin bezelis critical
`** Applications
`+ Interactive digital signage; point-of-information (POI)
`«* Status: 3M has discontinued all new development
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Acoustic Touch Startup: Sentons
`
`** Sentons
`
`+ “The next generation in high-performance multi-touch interfaces”
`+ Afabless analog semiconductor startup
`e Taking a new approachto real-time bending-wave analysis, applying
`the ever-increasing CPU horsepowerprovided by Moore’s Law
`e 27” Sentons multi-touch touch-screen can be 30% of p-cap cost,
`even lower than camera-basedoptical
`+ Started byfive people from Telegent, the analog mobile-TV chip
`startup that flamed out in July 2011
`
`SENT@NS
`
`SID DISPLAY WEEK‘14
`
`Pah
`
`intel)
`
`Source: Sentons Website
`
`
`
`

`

`Optical Touch Technologies
`
`«* Traditional Infrared (IR)
`«+ Waveguide Infrared (DVT by RPO)
`¢* Multi-Touch Infrared
`** Camera-Based Optical
`«+ Planar Scatter Detection (PSD)
`“+ Vision-Based
`
`
`
`SID DISPLAY WEEK ‘14
`
`rss
`
`Gee
`
`
`
`

`

`Infrared
`
`Traditional
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Traditional Infrared...1
`
`
`
`Edge of active
`display area
`
`Opto-matrix
`
`
`LEDs create grid
`ofinfrared light
`
`Inside and outside
`edges of infrared
`transparent bezel
`
`SID DISPLAY WEEK ‘14
`
`Pa:
`
`
`
`frame inside bezel
`
`
`
`
`“Cross-beam”light paths
`ay.
`HATYT
`
`increases resolution and
`oea
`fault-tolerance in infrared
`touchscreens(Elo)
`
`rt
`
`bakes
`
`
`
`
`

`

`Traditional Infrared...2
`
`+ Variations
`
`+ Bare PCBvs. enclosed frame; frame width & profile height;
`no glass substrate; enhanced sunlight immunity; force-sensing
`“+ Size range
`+ 8” to 150”
`
`¢* Controllers
`
`+ Mostly proprietary, except I[RTouch (China)
`«* Advantages
`+ Scalable to very large sizes
`+ Multi-touch capable (only 2 touches, and with some “ghost” points)
`+ Can be activated with any IR-opaque object
`+ High durability, optical performance and sealability
`+ Doesn't require a substrate
`
`SID DISPLAY WEEK ‘14
`
`Pa)
`
`Te
`
`
`
`

`

`Traditional Infrared...3
`
`** Multi-touch in traditional infrared
`
`+ Limited to 2 not-so-good touches
`+ “Ghost” points are the problem, and there’s no goodsolution
`
`broken Y1 Y2<a
`
`vee¥4<
`Real1x Y1 O
`
`points|x4, Y2 QO a Y2 »
`
`points|x4,¥1 @
`X3=X4
`x1
`
`o>x
`
`Source: Drawing by Author
`
`SID DISPLAY WEEK ‘14
`
`rr
`
`
`
`

`

`Traditional Infrared...4
`
`«+ Disadvantages
`+ Profile height (IR transceivers project above touch surface)
`+ Bezel must be designedto include IR-transparent window
`+ Sunlight immunity can be a problem in extreme environments
`+ Surface obstruction or hover can cause a false touch
`+ Low resolution
`+ High cost
`«* Applications
`+ Large displays (digital signage)
`+ POS(limited)
`+ Kiosks
`
`
`
`«* Suppliers
`+ IRTouch Systems, Minato, Nexio, OneTouch, SMK, Neonode...
`+ 10+ suppliers
`
`SID DISPLAY WEEK ‘14
`
`rly
`
`Te
`
`
`
`

`

`Traditional Infrared...5
`
`** Mobile Infrared: Neonode
`mobile phone implemented
`with traditional IR touch (2009)
`+ Samebattery life as iPhone
`
`
`
`
`
`«* Neonode couldn't
`complete in the
`cellphone market
`and went bankrupt
`in 2009
`
`readers (2010)
`Source: PC World
`
`
`
`
`
`
`Pen Computing
`
`
`SID DISPLAY WEEK ‘14
`
`Source:
`Neonode &
`
`+ Low bezelprofile height (~1 Piminy
`
`i!
`
`+ Finger-only
`+ No multi-touch
`
` Sony e-book
`
`
`
`

`

`Traditional Infrared...6
`
`«+ Neonode in 2013 has becomethe largest supplier
`of touchscreens for eReaders!
`
`+ Amazon Kindle and B&N Nook both use Neonode
`
`+ Neonode hasstrong IP on methods of minimizing border width
`and profile height
`e They're also in transition from traditional infrared architecture
`to multi-touch infrared architecture
`
`+ Neonode has announced design winsin e-readers, smartphones,
`tablets, toys, printers, gaming consoles, in-flight infotainment
`systems, and automotive consoles
`e How muchofit is real beyond e-readersis unclear
`+ Neonode doesn’t supply any actual hardware,just licenses
`and engineering implementation consulting services
`
`SID DISPLAY WEEK‘14
`
`rx)
`
`intel)
`
`
`
`

`

` Se
`Infrared
`
`Waveguide
`
`Source: RPO
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`WaveguideInfrared...1
`
`** Objective
`+ Reduce IR touchscreen cost by replacing multiple |R-emitters with a
`single LED and using optical waveguidesto distribute the light and
`to channelit to a line-scan CMOSpixel array
`
`Light Source
`
`
`
`
`
`Traditional
`Infrared
`
`‘od
`
`Transmit Side
`Waveguides
`
`LCD Display
`
`Receive Side
`Waveguides
`
` SID DISPLAY WEEK ‘14
`
`Source: RPO
`
`
`
`

`

`Waveguide Infrared...2
`
`RPO’s actual
`construction
`(3.5” screen)
`
`IR LED \
`
`(white) |> Waveguides
`
`Substrate
`
`Parabolic
`reflector
`
`Light path
`
`Line-scan
`optical sensor
`
`Light path
`
`SID DISPLAY WEEK ‘14
`
`266
`
`,
`Source: Photo by RPO; Annotation by Author
`
`in substrate)
`
`
`
`

`

`Waveguide Infrared...3
`
`** RPO timeline
`+ AnnouncedIR optical-waveguide infrared touch at SID .... 2007
`+ Showedimproved performance at SID ......................... 2008
`+ Showedlarger'sizes at SID ssscscissisccserazicsssmasrcwsammennnes 2009
`+ Appeared in a 13.3” LG Display notebook at SID ............ 2010
`+ Wentinto “voluntary administration”(liquidation) in April ... 2011
`+ Sold all assets to an NPE (patenttroll) in February ......... 2012
`(along with Poa Sana’s assets... it’s a long story!)
`“* Whydidit fail?
`+ There wasn’t any particular application for which it was “best”
`+ Waveguide technology limited touchscreen size to under ~14”
`+ RPO bet on one big partner in 2010 who cancelled their project
`abruptly, leaving the companywith insufficient $$$ to keep going
`
`SID DISPLAY WEEK ‘14
`
`ra
`
`Gee
`
`
`
`

`

`Infrared
`
`Multi-Touch
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Multi-Touch Infrared...1
`
`«> A little bit of history on the 2"4-oldest touch technology
`+ IR touchfirst appeared in 1972 (PLATOIV instructional terminal)
`+ IR touch was usedin HP’sfirst microcomputer, the HP150,in 1983
`+ After 30+ years of stability, it's changed from single-touch to
`(briefly) 2-touch, and now multi-touch!
`
` Source: University of Illinois
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Multi-Touch Infrared...2
`
`«+ “PQ Labs” method
`
`
`
`= IR emitter
`
`G = IR receiver
`
`+ 6 to 32
`touches
`
`+ 32” to 103”
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Multi-Touch Infrared...3
`
`«* “PulselR” (Image Display Systems) method
`LED,
`
`BEEBEBREBRBSBBBDBBBEBHBBBAAB
`
`—EEBEREBBEBEERBRBEBBBERBEBBEB
`
`LED,
`LED,
`
`LED,a fH = IR emitter
`BEBBBBBBRBEBBBEBRBERBEBEBREES
`
`W = IR receiver
`
`+ 2 to 40
`touches
`
`+ 5” to 103”
`
`LED,
`BEEBE BBBBRBEBBOBEBRBEBBBRBEBRBBRBEBBBBAA
`
`Source: Author
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Multi-Touch Infrared...4
`
`** Another possible method... being used?
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Multi-Touch Infrared...5
`
`«+ Variations
`+ Numberof touch points: 2 to 48 (determined by the controller)
`+ Architecture: 3 different ways of organizing the IR emitters
`and receivers (so far)
`e PQ Labsis licensing; others may be also
`«+ Controller
`+ Proprietary; generally requires a large amount of processing
`«+ Advantages
`+ High numberof multi-touch points
`+ Object-size recognition
`e Controller maintains position & size data for all touching objects
`+ Similar advantagesto those oftraditional infrared
`e Workswith a finger, stylus or any other IR-opaque touch object
`e Scalable to very large sizes (at some cost)
`e High durability and sealability
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Multi-Touch Infrared...6
`
`«+ Disadvantages
`+ Relatively low resolution (can get stair-stepping in lines)
`+ Increased processing load as size and numberof touches goes up
`+ Different minimum-object-size specfor stationary & moving objects
`+ Large objects close to emitters can decrease performance
`+ As with anytraditional IR system, pre-touch (or “pen-up”) is mostly
`a big problem that gets worse as the screen size increases
`+ Most can't meet Win8 Logo dueto pre-touch and accuracy
`«* Applications
`+ Multi-player games on large horizontal displays
`+ Multi-user interactive digital signage
`+ 3D design andinteraction; data visualization for business
`+ NOT interactive “whiteboard” displays due to pre-touch/pen-up
`
`
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Multi-Touch Infrared...7
`
`«+ Latest new multi-touch infrared product:
`“Projected Infrared Touch”(PIT) from General Touch
`+ Proprietary design using traditional opto layout (like PQ Labs)
`+ Meets Win8 Logo
`+ Bezelis a light-guide/prism (2.5 mm high, 4 mm wide)that
`allows IR emitters & receivers to be located underthe cover-glass,
`outside the LCD frame (reduced parallax due to no PCBontop)
`
`
`
`Source: General Touch
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Multi-Touch Infrared...8
`
`«+ Additional PIT features
`
`+ 15” to 42” size range standard; over 42” is custom
`e First sizes to launch in 2Q-2013 are 21.5” & 23” (for AiO)
`+ 2-touch for lowest cost; 5-touch for Win8; 10-touch for high-end
`e Only the controller changes
`+ Entire surface is touch-active, including the 20 mm (MS) border
`e Active icons can besilk-screened in the border’s black matrix
`
`+ Pre-touch meets the Win8 spec of 0.5 mm
`e Exceptionally low for any infrared touchscreen
`+ Touch surface can be any material that meets surface flatness spec
`e Can be sealed to IP65
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`
`
`
`k, Camera-
`Based
`= Optical
`
`
`ees
`
`touch-screen bya visitor to the AETI Exhibition in London on January 24, 2006.
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Camera-Based Optical...1
`
`[[Sfteeoto]2)Trove CO GG Hd GP HE Peakdetec Aotan|
`
`ShomApetaes [~ oesres||Semaesrae|5Satna |HoldotiO |
`
`
`IE pg reece
`“Cheeseating=20
`LED reflecting directly~ ine76in=a=28
`into the optica sensor | ;
`;
`
`
`
`LightIntensity
`
`«+ Win7 = 2 touches; 2 camerasdid it (inadequately)
`«“* Win8 = 5 touches; 6 camerasare required
`
`Glass Substrate
`
`
`
`- Touch Point
`
`
`108
`158
`208
`28
`me
`358
`
`Optical SensorPixel Position
`
`Source: NextWindow
`
` SID DISPLAY WEEK ‘14
`
`
`
`

`

`Camera-Based Optical...2
`
`** Two touches with two cameras (Win7 market focus)
`had two main limitations
`
`Cameras
`
`Cameras
`
`Ghost touches
`
`Source: Author
`
`Occlusions
`
`The quality of the touch experience depended on the sophistication
`of the algorithms that handled ghost touches and occlusions
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Camera-Based Optical...3
`
`¢* Another alternative: A mirror creates “virtual cameras”
`
`Virtual
`Virtual
`camera
`a
`|.fff/
`|
`|
`
`Mirror

`
`
`+ Results
`+ SMARTinventeditin
`2003 but shelvedit
`+ Lumiotried it in 2010 but
`found that four real
`cameras werebetter
`
`e Lower cost
`
`e No mirror alignment
`issues
`e Less sensitivity to
`environment
`e Fewerpixels required
`for same resolution
`:
`e Less CPU processing
`
`PET
`
`intel)
`
`oO
`
`cS
`S

`=
`7
`
`=.
`
`—
`5
`D
`So
`
`——
`Illumination
`Source: Lumio
`SID DISPLAY WEEK ‘14
`
`Camera
`
`Camera
`
`
`
`

`

`Camera-Based Optical...4
`
`¢* Another alternative: Baanto ShadowSense”
`
`90° aata
`
`~170° FOV Sensors
`
`reflectors
`
`90° FOV Sensor
`+ Baanto’s sensors
`aren't cameras;
`they're PIN
`diodes (photo-
`detectors)
`+ 940 nm LEDs
`provide back
`illumination
`instead of retro-
`
`| Erasers
`
`LED Emitters
`
`Source: Baanto
`
`
`
`SID DISPLAY WEEK ‘14
`
`(“FOV” = Field of View)
`
`
`
`

`

`Camera-Based Optical...5
`
`«+ Baanto’s competitive comparison
`+ 4 sources of sensor-data work muchbetter than two!
`
`“* Suppliers
`+ NextWindow (SMART)
`+ Lumio
`
`+ |RTouch
`
`+ Xiroku/elT
`
`+ Baanto
`
`+ LG Displays
`+ Qisda
`
`+ Several more in China
`
`Baanto
`
`Competitor
`
`Source: Baanto
`
`SID DISPLAY WEEK ‘14
`
` Te
`
`
`
`

`

`Camera-Based Optical...6
`
`«+ Advantages
`+ Stylus independence
`+ Scalability to large sizes (15” to 120”)
`+ Multi-touch (2-5 touches)
`+ Object-size recognition
`+ Low cost
`
`f
`
`HP TouchSmart all-in-one computer
`“ure
`
`
`
`eS,
`“+ Disadvantages
`+ Profile height (~3 mm on a 19” screen)
`+ The “unintended touch” problem
`+ Screen rigidity requirement
`** Applications
`+ Consumertouch monitors & AiOs
`
`+ Interactive digital signage, point-of-information, & education
`
`SID DISPLAY WEEK ‘14
`
`283
`
`Tee
`
`
`
`

`

`Camera-Based Optical...7
`
`** Optical is able to meet the Win8 touch specifications
`+ NextWindow’s newest desktop-component product (15” to 30”)
`
`uses six CMOS cameras(4 in the corners + 2 on the top edge)
`
`Source: Jennifer Colegrove (DisplaySearch)at FineTech 2012
`
`
`
` SID DISPLAY WEEK ‘14 ray
`
`
`
`

`

`Camera-Based Optical...8
`
`«* The range of form-factors and configurations
`in which optical touch is used is expanding
`
`Cameras & lasers
`at top of video wall
`
`Se)@
`
`—to—col iE =
`es~ ELI *:
`
`Source: Photos by Author
`
`
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Camera-Based Optical...9
`
`** Outlook
`+ Touch on the consumer desktop (in Win7 AiOs)failed to
`take off due to lack of any applications
`e Touch penetration hit 30% in 2010 but dropped to ~10% in 2012
`+ Win8 may drive more penetration, but thereis still the
`“gorilla arm” usage-model question
`e “Adaptive” AiOs will help address that issue
`+ Camera-based optical touch is
`ideal for large-format, but...
`e Theinteractive digital-signage
`market hasn’t emerged yet
`e Interactive information on large
`screens is still a niche market
`e The education market (whiteboards)
`
`has beenslow to adopt optical
`
`because of entrenchedresistive
`Dell ST2220T (Win7) Touch Monitor
`
`and electromagnetic technologies
`
`SID DISPLAY WEEK ‘14
`rE
`intel)
`
`
`
`

`

`
`
`Source: FlatFrog
`
`Planar
`Scatter
`Detection
`(PSD)
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Planar Scatter Detection...1
`
`
`Total Internal
`IR Emitter
`Reflection (TIR)
`IR Receiver
`elsl
`
`
`Substrate (any
`Scattered Light (FTIR)
`transparent material,
`flat or curved)
`
`
`
`Source: FlatFrog
`
` SID DISPLAY WEEK ‘14 rE:
`
`
`
`
`
`
`
`

`

`Planar Scatter Detection...2
`
`«+ Characteristics it shares with p-cap
`+ Flush surface (“zero bezel”)
`+ Very light touch
`+ Multi-touch (40 touches)
`+ Windows 8 Logo
`«* Characteristics that are better than p-cap
`+ Plain glass or plastic substrate (0.3 mm) —no ITO
`+ Works with glove, stylus or other objects (400 dpi)
`+ Pressure-sensitive (10 bits)
`+ Insensitive to EMI/RFI
`
`+ High scan-rate for larger screens (up to 1 KHz)
`+ Lowercost
`
`
`
`Source: FlatFrog
`
`SID DISPLAY WEEK ‘14
`
`rt
`
`Toy
`
`
`
`

`

`Planar Scatter Detection...3
`
`“* Size range
`+ 32” (with display) at launch in May, 2012
`+ Practical size range 15” to 84”
`«+ Disadvantages
`+ Initial product is a 32” display for $5,500 MSRP (+$190 housing)
`+ Designedfor indoor use (no sunlight) without dust or smoke
`e Limited to 30°C ambient due to display
`e Sensitive to contamination on surface
`+ Scaling to larger sizes is similar to traditional infrared
`e ~200 IR emitter-receiver pairs required for 32” display; 96 pairs for 22”
`+ FlatFrog is a small companywith limited resources
`
`SID DISPLAY WEEK ‘14
`
`
`
`

`

`Planar Scatter Detection...4
`
`«+ Applications
`
`command & control
`
`+ Realistic today: Gaming,digital
`signage, POI, medical, hospitality,
`+ Future: consumerelectronics, education
`
`
`
`ay e ol
`
`
`a) FS ry ee
`
`5) cl
`
`¢* Full disclosure:
`
`Source: FlatFrog
`
`+ Intel has invested in andis doing a joint developmentproject with
`FlatFrog to extend and improve the technology beyond whatthey
`have already done
`e Current focus is onall-in-one PCs (20”to 30”)
`+ Supply-chain (availability) will also be improved
`
`SID DISPLAY WEEK ‘14
`
`291
`
`Tie
`
`
`
`

`

`Optical-Touch Startup: RAPT
`
`“ RAPT
`
`+ “Opto-electro-mechanical” (rumored to be similar to FlatFrog)
`+ “The most robust multi-touch system on the planet and quite
`different from current solutions in the market’
`
`Curved Surfaces ii
`Source: RAPT Website SID DISPLAY WEEK ‘14
`
`Capacitive
`/
`
`Optical
`
`te
`
`"A
`
`/ "
`
`A
`
`Multi-touch Robustness
`
`Jute teet
`
`Ambient Light Performance
`
`Flush Display
`
`Cost Effectiveness
`
`Large Screen
`Glove and Stylus
`
`
`
`

`

`
`
`Source: Perceptive Pixel
`
`Vision-
`Based
`
`SID DISPLAY WEEK ‘14
`
`293
`
`
`
`

`

`Vision-Based...1
`
`
`
`«+ Principle (Simplest version)
`
`otejen 7Reflection (TIR)
`
`
`
`
`Multiple touch points;
`Image taken without a diffuser
`(Source: Perceptive Pixel)
`
`/ /
`
`Baffle Diffuser
`
`Scattered
`
`Light
`
`Video Camera
`
`Projector
`
`Frustrated Total
`Internal Reflection
`(FTIR)
`
`Source: Perceptive Pixel
`
`SID DISPLAY WEEK ‘14
`
`294
`
`Wey
`
`
`
`

`

`Vision-Based...2
`
`Microsoft
`“Surface computing is about integrating the physical and
`Surface
`virtual worlds through the use of vision-based touch”
`(v1, 2007) a as
`|
`Source: Information Display
`Projector
`resolution
`1024x768
`
`1280x960
` 2 Of~ 1 — Screen with diffuser
`
`Touch
`resolution
`
`he
`
`2 -IRLEDlight source
`3 — Four IR cameras
`4 — DLPprojector
`5 — Vista desktop
`
`i
`
`.
`
`Source: Popular Mechanics
`
`SID DISPLAY WEEK ‘14
`
`295
`
`intel)
`
`
`
`

`

`Vision-Based...3
`
`“* Samsung SUR40 with Microsoft Surface (v2.0, 2012)
`
`ee)
`
`4" thick
`on surface
`Source: TechCrunch.com
`
`Document
`
`Source: Mi

This document is available on Docket Alarm but you must sign up to view it.


Or .

Accessing this document will incur an additional charge of $.

After purchase, you can access this document again without charge.

Accept $ Charge
throbber

Still Working On It

This document is taking longer than usual to download. This can happen if we need to contact the court directly to obtain the document and their servers are running slowly.

Give it another minute or two to complete, and then try the refresh button.

throbber

A few More Minutes ... Still Working

It can take up to 5 minutes for us to download a document if the court servers are running slowly.

Thank you for your continued patience.

This document could not be displayed.

We could not find this document within its docket. Please go back to the docket page and check the link. If that does not work, go back to the docket and refresh it to pull the newest information.

Your account does not support viewing this document.

You need a Paid Account to view this document. Click here to change your account type.

Your account does not support viewing this document.

Set your membership status to view this document.

With a Docket Alarm membership, you'll get a whole lot more, including:

  • Up-to-date information for this case.
  • Email alerts whenever there is an update.
  • Full text search for other cases.
  • Get email alerts whenever a new case matches your search.

Become a Member

One Moment Please

The filing “” is large (MB) and is being downloaded.

Please refresh this page in a few minutes to see if the filing has been downloaded. The filing will also be emailed to you when the download completes.

Your document is on its way!

If you do not receive the document in five minutes, contact support at support@docketalarm.com.

Sealed Document

We are unable to display this document, it may be under a court ordered seal.

If you have proper credentials to access the file, you may proceed directly to the court's system using your government issued username and password.


Access Government Site

We are redirecting you
to a mobile optimized page.





Document Unreadable or Corrupt

Refresh this Document
Go to the Docket

We are unable to display this document.

Refresh this Document
Go to the Docket