`Reeves et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 9.703,468 B2
`Jul. 11, 2017
`
`USOO9703468B2
`
`(54) UNIFIED DESKTOP INDEPENDENT FOCUS
`IN AN APPLICATION MANAGER
`
`(71) Applicant: Z124, George Town (KY)
`
`(72) Inventors: Paul E. Reeves, Oakville (CA); Sanjiv
`Sirpal, Oakville (CA); Martin Gimpl.
`Helsinki (FI)
`(73) Assignee: Z124, George Town (KY)
`(*) Notice:
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 983 days.
`(21) Appl. No.: 13/627,679
`(22) Filed:
`Sep. 26, 2012
`
`(65)
`
`Prior Publication Data
`US 2013/011 1371 A1
`May 2, 2013
`
`Related U.S. Application Data
`(63) Continuation-in-part of application No. 13/605,740,
`filed on Sep. 6, 2012, now Pat. No. 9,529,494, and a
`continuation-in-part of application No. 13/605,482,
`filed on Sep. 6, 2012, and a continuation-in-part of
`application No. 13/605,145, filed on Sep. 6, 2012,
`now Pat. No. 8,990.713, and a continuation-in-part of
`application No. 13/604,960, filed on Sep. 6, 2012,
`now abandoned, and a continuation-in-part of
`(Continued)
`
`(51) Int. Cl.
`G06F 3/048
`G06F 3/0486
`G06F 3/0488
`GO6F 3/14
`(52) U.S. Cl.
`CPC ........ G06F 3/0486 (2013.01); G06F 3/04883
`(2013.01); G06F 3/1423 (2013.01); G06F
`2203/04803 (2013.01)
`
`(2013.01)
`(2013.01)
`(2013.01)
`(2006.01)
`
`(58) Field of Classification Search
`None
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,757,371 A * 5/1998 Oran et al. .................... 71.5/779
`6,304.261 B1
`10/2001 Shields et al.
`(Continued)
`
`OTHER PUBLICATIONS
`
`Soper “Sams Teach Yourself Microsoft Windows(R 7 in 10 Min
`utes.’ Sams, 2010, Safari books, Web, Jul. 1, 2014 techbus.
`Safaribooksonline.com/book/operating-systems/
`9780132121897?bookview=overview 4 pages.
`(Continued)
`
`Primary Examiner — Ryan Barrett
`Assistant Examiner — Haimei Jiang
`(74) Attorney, Agent, or Firm — Sheridan Ross P.C.
`
`ABSTRACT
`(57)
`Methods and devices for selectively presenting a user inter
`face or “desktop' across two devices are provided. More
`particularly, a unified desktop is presented across a device
`and a computer system that comprise a unified system. The
`unified desktop acts as a single user interface that presents
`data and receives user interaction in a seamless environment
`that emulates a personal computing environment. To func
`tion within the personal computing environment, the unified
`desktop includes a process for docking and undocking the
`device with the computer system. The unified desktop
`presents a new user interface to allow access to functions of
`the unified desktop.
`
`20 Claims, 104 Drawing Sheets
`
`to
`
`4.
`
`
`
`324
`
`7328
`
`338
`
`744
`
`7332
`
`Window 8
`
`Apple Ex. 1019
`Apple Inc. v. Firstface Co., Ltd.
`IPR2019-00614
`Page 00001
`
`
`
`US 9,703.468 B2
`Page 2
`
`a
`
`T18, 1
`
`2008/0307350 A1 12/2008 Sabatelli et al.
`Related U.S. Application Data
`2008/0313632 A1 12/2008 Kumar et al.
`2009/0094523 A1* 4/2009 Treder et al. ................. 715.738
`application No. 13/604,384, filed on Sep. 5, 2012,
`2009/0164915 A1
`6/2009 Gasnet al.
`now Pat. No. 8,990,712, and a continuation-in-part of
`38885 A. 1939 Real
`application No. 13/603,136, filed on Sep. 4, 2012,
`ands
`catapagippi 2009/0328033 A1* 12/2009 Kohavi ................. GO6F 9/5027
`Ca10 TNO.
`CC. O. Va.
`OW
`s
`s
`s
`s
`Pat. No. 8,872,727, and a continuation-in-part of
`2010, 0037145 A1
`2/2010 Sides
`application No. 13/566,336, filed on Aug. 3, 2012,
`2010.0088598 A1
`4/2010 Lee et al.
`now Pat. No. 9,405.459, and a continuation-in-part of
`2010, 0138780 A1* 6, 2010 Marano ................. G06F 3.1415
`application No. 13/566,244, filed on Aug. 3, 2012,
`2011/0093836 A1
`4/2011 Galicia et all
`T15,804
`now abandoned, and a continuation-in-part of appli-
`2011 0138314 A1* 6, 2011 Mir et al. ...................... 71.5/779
`cation No. 13/566,168, filed on Aug. 3, 2012, and a
`2011 O197141 A1
`8, 2011 MaZZaferri
`continuation-in-part of application No. 13/566,103,
`2011/0225553 A1
`9, 2011 Abramson et al.
`filed on Aug. 3, 2012, now abandoned, and a con- S.S. A1
`3. Robert et al
`tinuation-in-part of application No. 13/543,678, filed
`2012/0081353 A1
`4/2012 Yusupov et al.
`on Jul. 6, 2012, now Pat. No. 9.268.518, and a
`2012,0081380 A1
`4/2012 Reeves et al.
`•
`Yus
`s
`•
`- s
`s
`s
`2012,0081383 A1
`4/2012 Reeves et al.
`continuation-in-part of application No. 13/543,635,
`2012/008 1396 A1
`4/2012 Yusupov et al.
`filed on Jul. 6, 2012, now abandoned, and a continu-
`2012/0084480 A1
`4/2012 Reeves et al.
`ation-in-part of application No. 13/408.530, filed on
`3.39. A. 38:
`s al
`G06F 1, 1616
`Feb. 29, 2012, now abandoned, and a continuation-
`2012,008471.0 A1* 4, 2012 SE C. a.
`in-part of application No. 13/410,958, filed on Mar. 2,
`"
`' " 715.783
`2012, now Pat. No. 9,122,441, and a continuation-
`4/2012 Gimpl et al.
`2012fOO84737 A1
`in-part of application No. 13/410.983, filed on Mar. 2,
`4/2012 Benedek et al.
`2012/0084791 A1
`2012, now Pat. No. 9,003.311, and a continuation-in-
`t38: Elek et al
`38:8.76 A.
`part of application No. 13/411,034, filed on Mar. 2,
`4, 2012 E. I.
`2012,0084.798 A1
`2012, OW Pat. No. 8,910,061, and a continuation-
`4/2012 Reeves et al.
`2012fOO8671.6 A1
`in-part of application No. 13/411,075, filed on Mar. 2,
`4, 2012 Liu
`2012,0086,717 A1
`2012, now abandoned, and a continuation-in-part of
`4/2012 Reeves et al.
`2012/008990.6 A1
`71.5/799
`application No. 13/436,593, filed on Mar. 30, 2012,
`3:39: A. 23: S. s al
`now Pat. No. 9,069,518, and a continuation-in-part of
`2012/O1242.45 A1
`5/2012 E. etal."
`application No. 13/436,823, filed on Mar. 30, 2012,
`2012/0143944 A1
`6, 2012 Reeves et al.
`now Pat. No. 9.213,516, and a continuation-in-part of
`2012fO166959 A1
`6, 2012 Hillerio et al.
`application No. 13/436,826, filed on Mar. 30, 2012,
`2012/0174021 A1, 7/2012 Dharawat
`now abandoned, and a continuation-in-part of appli-
`2012fO296959 A1* 11/2012 Momchilov .............. GO6F 9/54
`s
`TO9,203
`No.
`yed O ME R 2. 2012/0324365 A1 12/2012 Momchilov .............. G06F 3/14
`al. No. 8.8/4,894, and a conunuauon-1n-part o
`715.738
`application No. 13/485,743, filed on May 31, 2012,
`2013, OO19183 A1
`1/2013 Reeves
`now Pat. No. 8,904,165.
`2013,0021262 A1
`1/2013 Chen
`2013, OO24778 A1
`1/2013 Reeves
`(60) Provisional application No. 61/539,884, filed on Sep.
`2013, OO24812 A1
`1/2013 Reeves
`27, 2011.
`2013/0076592 A1
`3/2013 Reeves et al.
`2013/0076593 A1
`3/2013 Reeves et al.
`2013/0076594 A1
`3/2013 Sirpal et al.
`2013/0076664 A1
`3/2013 Reeves et al.
`2013/0076665 A1
`3/2013 Reeves et al.
`2013/0076780 A1
`3/2013 Reeves et al.
`2013,008O143 A1
`3/2013 Reeves et al.
`2013/0080759 A1
`3/2013 Reeves et al.
`2013/0080899 A1
`3/2013 Reeves et al.
`2013,0080909 A1
`3/2013 Reeves et al.
`2013/0080933 A1
`3/2013 Reeves et al.
`2013,0080934 A1
`3/2013 Reeves et al.
`2013/0080935 A1
`3/2013 Reeves et al.
`2013,0080936 A1
`3/2013 Reeves et al.
`2013/0080938 A1
`3/2013 Reeves et al.
`2013,0080939 A1
`3/2013 Reeves et al.
`2013/008094.0 A1
`3/2013 Reeves et al.
`2013,0080941 A1
`3/2013 Reeves et al.
`2013/0080942 A1
`3/2013 Reeves et al.
`2013,0080943 A1
`3/2013 Reeves et al.
`2013,0080944 A1
`3/2013 Reeves et al.
`2013,0080969 A1
`3/2013 Reeves et al.
`2013, O104051 A1
`4/2013 Reeves et al.
`2013,0104.062 A1
`4/2013 Reeves et al.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4/2005 Driskell
`6,883,143 B2
`386 SER's al
`2. R
`wk I
`7.987,432 B1* 7/2011 Grechishkin ......... Goog.
`
`ck
`
`ck
`8,291.344 B2 * 10/2012 Chaudhri ............ G06F s
`
`ck
`. 717/109
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`3. R 1933; As a .
`8.62883 B2 12/2013 Louch ........o G06F 3.0481
`wk 4
`71.5/792
`3/2014 Runov et al.
`8,677.274 B2
`9,317,195 B1 * 4/2016 Grechishkin ......... G06F 3.0486
`2004/0172588 A1
`9/2004 Mattaway
`2004/0201628 A1 10, 2004 Johanson et al.
`2004/0267815 A1 12, 2004 De Mes
`2006/0230156 A1* 10/2006 Shappir ................. G06F 3/1454
`709,227
`2006/0288306 A1* 12/2006 Mahajan ............... G06F 9/4445
`T15,804
`2007/0011622 A1
`1/2007 Chae et al.
`2007/0022387 A1
`1/2007 Mayer et al.
`2007/0O83829 A1
`4/2007 Lauridsen et al.
`2007.0089064 A1
`4/2007 Facemire et al.
`
`OTHER PUBLICATIONS
`
`Official Action for U.S. Appl. No. 13/604,384, mailed Jun. 4, 2014
`11 pages.
`
`IPR2019-00614 Page 00002
`
`
`
`US 9,703.468 B2
`Page 3
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`Official Action for U.S. Appl. No. 13/604,960, mailed May 6, 2014
`26 pages.
`Official Action for U.S. Appl. No. 13/605,145, mailed Jun. 5, 2014
`13 pages.
`Official Action for U.S. Appl. No. 13/605,740, mailed Jul. 16, 2014
`27 pages.
`Zain "Pin Wesbites' bookmarks in Tasklist for Quickest Access
`Windows 7).” Archived Oct. 10, 2010, Accessed Web. Jan. 15,
`2015.
`http://www.tipsotricks.com/2010/10pin-wesbites-book
`marks-in-tasklist-for-quickest-access.html, 6 pages.
`Notice of Allowance for U.S. Appl. No. 13/604,384, mailed Oct. 7,
`2014.9 pages.
`Official Action for U.S. Appl. No. 13/604,960, mailed Sep. 23, 2014
`29 pages.
`Official Action for U.S. Appl. No. 13/604,960, mailed Mar. 26, 2015
`32 pages.
`Notice of Allowance for U.S. Appl. No. 13/605,145, mailed Oct. 15,
`2014 10 pages.
`Official Action for U.S. Appl. No. 13/605,740, mailed Jan. 29, 2015
`29 pages.
`U.S. Appl. No. 13/485,734, filed May 31, 2012, Reeves et al.
`U.S. Appl. No. 13/543,678, filed Jul. 6, 2012, Reeves et al.
`Google Image Result for Fujitsu Dual Screen Phone, published date
`unknown, retrieved Apr. 18, 2011, 1 page. Retrieved from: www.
`google.com/imgres?imgurl=http://www.computerriver.com/im
`ages/dual-screen-phone.jpg.
`Google Image Result for LG Dual Touch Screen Concept Phone by
`Eugene Kim, published date unknown, retrieved Apr. 18, 2011, 1
`page. Retrieved from: www.google.com/imgres?imgurl=http://
`fgadgets.com/wp-content/uploads/2010/08/Ig-dual-touch-screen
`phone-Eugene-Kim-01.jpg.
`Google Image Result for Fujitsu Dual Screen Phone, published date
`unknown, retrieved Apr. 18, 2011, 1 page. Retrieved from: www.
`google.com/imgres?imgurl=http://www.gSmdome.com/wp-con
`tent/uploads/2010/10/fujitsu-dual-screen-phone w2cP7 54.jpg.
`Google Image Result for Kyocera Echo, published date unknown,
`retrieved Apr. 18, 2011), 1 page. Retrieved from: www.google.
`
`com/imgres?imgurl=http://www.hardwaresphere.com/wp-content/
`uploads/2011/02/kyocera-echo-dual-screen-android-phone-for
`sprint-network.jpg.
`Google Image Result for HTC Triple Viper, published date
`unknown, retrieved Apr. 18, 2011), 1 page. Retrieved from:www.
`google.com/imgres?imgurl=http://www.santafemods.com/Forum/
`AndroidForums/htcTripleViper.png.
`Google Image Result for Dual-Screen Phone, retrieved Apr. 18.
`2011,
`1
`page.
`Retrieved
`from:
`www.google.com/
`imgres?imgurl=http://www.netshet.org/wp-content/uploads/2011/
`02/Dual-Scree .
`. . .
`Website entitled “LapdockTM for Motorola ATRIX.” Motorola
`Mobility, Inc., 2011, retrieved on Apr. 18, 2011), 1 page. Retrieved
`from: www.motorola.com/Consumers/US-EN/Consumer-Product
`and-Services/Mobile+Ph . . . .
`Website entitled “Motorola ATRIX 4G Laptop Dock Review.”
`phoneArena.com, posted Mar. 2, 2011, retrieved on Apr. 18, 2011).
`6 pages. Retrieved from: www.phonearena.com/reviews/Motorola
`ATRIX-4G-Laptop-Dock-Review id2667.
`Burns, C., “Motorola ATRIX 4G Laptop Dock Review.” Android
`Community, Feb. 20, 2011, retrieved on Apr. 18, 2011), 5 pages.
`Retrieved from: www.androidcommunity.com/motorola-atrix-4g
`laptop-dock-review-20110220/.
`Catacchio, “This Smartphone has two huge screens . . . that rotate.”
`The Next Web, Inc., Oct. 7, 2010, retrieved on Jul. 21, 2011, 2
`pages. Retrieved from: www.thenextweb.com/asia/2010/10/07/this
`Smartphone-has-two-huge-screens-that-rotate?.
`Posted by Harman03. “Kyocera Echo Dual-screen Android Phone.”
`posted 4 weeks from Apr. 18, 2011, retrieved on Apr. 18, 2011). 3
`pages. Retrieved from: www.unp.meff106/kyocera-echo-dual
`screen-android-phone-143800?.
`Stein, S., “How does the Motorola Atrix 4G Lapdock compare with
`a laptop?” Crave—CNET, Feb. 9, 2011 retrieved on Apr. 18, 2011).
`7 pages. Retrieved from: www.news.cnet.com/8301-17938 105
`20031251-1.html.
`Website entitled, “Kyocera Echo.” Kyocera Communications, Inc.,
`2011, retrieved on Aug. 27, 2012), 6 pages. Retrieved from:
`www.echobykyocera.com/.
`Website entitled, “Sony Tablet.” Sony Corporation, 2012, retrieved
`on Aug. 27, 2012, 3 pages. Retrieved from: www.store. Sony.com/
`webapp/wcs/stores/servlet/Category|Display?catalogId=10551
`&storeId=10151&langId=-1&categoryId=8198552921644795521.
`
`* cited by examiner
`
`IPR2019-00614 Page 00003
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`
`
`Sheet 1 of 104
`Sheet 1 of 104
`
`US 9,703,468 B2
`
`US 9,703,468 B2
`
`IPR2019-00614 Page 00004
`
`IPR2019-00614 Page 00004
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 2 of 104
`
`US 9,703,468 B2
`
`156
`
`1OO
`
`FIG. 1F
`
`100.
`
`
`
`44
`
`148
`
`52
`
`100
`
`32
`
`136
`
`140
`
`IPR2019-00614 Page 00005
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 3 of 104
`Sheet 3 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`5 to
`y
`
`O o
`O cx
`
`
`
`
`
`IPR2019-00614 Page 00006
`
`IPR2019-00614 Page 00006
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 4 of 104
`
`US 9,703,468 B2
`
`
`
`Screen 2
`
`Touch Sensitive
`Display
`
`Touch Sensitive
`
`Configurable Area
`
`Configurable Area
`
`216a
`
`208
`
`22
`
`204
`
`Display
`Controller
`
`Memory
`
`Data
`storage
`
`Processor
`
`Display
`Controller
`
`224
`
`228
`
`236 GPS
`
`Cellular
`Telephony
`Module
`
`Other Wireless
`Communication
`Module
`
`Power Source and
`Power control Module
`
`Port
`Interface
`
`integrated
`Audio if C)
`
`Hardware
`Buttons
`
`Position
`Sensor(s)
`
`Accelerometer(s)
`
`Audio f()
`interface
`
`FIG. 2
`
`IPR2019-00614 Page 00007
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 5 of 104
`Sheet S of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`
`
`340
`
`dscape
`
`
`
`400
`
`336
`
`308
`
`
`
`Inbound
`Outbound
`call
`
`
`
`
`Dacked
`
`348
`
`344
`
`FIG. 3A
`
`IPR2019-00614 Page 00008
`
`IPR2019-00614 Page 00008
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 6 of 104
`
`US 9,703,468 B2
`
`998
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Z28
`
`999
`
`#799
`
`No.odi IV)
`
`IPR2019-00614 Page 00009
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 7 of 104
`
`US 9,703,468 B2
`
`Tap
`
`Long Press
`
`Drag
`
`Fick
`
`Pinch
`
`Spread
`
`432a
`
`428a
`
`428b
`
`428b
`
`428b
`
`--S 420
`
`FIG. 4A
`432b
`
`- S. 424
`
`FIG. 4B
`432
`
`436
`
`-S 400
`
`436
`- S. 404
`
`FIG. 4C
`432
`9
`
`FIG. 4D
`
`428a
`
`432a
`436a
`
`436b
`
`432b
`
`- S. 408
`
`428b
`
`FIG. 4E
`
`432a
`
`3:6a)
`
`432b
`
`436b
`--S 410
`
`428a
`
`FIG. 4F
`
`428b
`
`IPR2019-00614 Page 00010
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 8 of 104
`
`US 9,703,468 B2
`
`ty 428b.
`
`428a
`
`432b - 400
`2 -
`
`436
`
`FIG. 4G
`
`432a
`420 -
`
`432b
`400
`428b. -
`
`428a
`
`436
`
`FIG. 4H.
`
`IPR2019-00614 Page 00011
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 9 of 104
`
`US 9,703,468 B2
`
`i
`
`eee
`
`jJobeusy
`
`uoyeoyddy|
`
`
`
`
`
`|opeis
`
` mopulny|ginpoy,uouabeubyMOpUIA|
`
`
`
`
`
`CvSSeOrs
`
`YOEYSYSeL
`
`
` alo}guoleojddy
`
`
`Zzuoeayddy
`279|uoHRoiddy
`
`{OpaluoHedyday||juouebeuey|ysey
`
`JaBeueyyainpoyy
`
`
`
` juenq||ese|ainpoyyuawoabeusyyinduy
`|Jayng
`
`qv9g
`
`
`
`res
`
`
`
`itLi
`
`
`
`
`
`sJayngswels
`
`
`
`
`
`Wia}shgBugeredo
`
`ri!1
`
`
`
`
`
`Aeydsig
`
`aINpo|eyoeDaokwynsae976|Jayoguoy
`
`
`
`BCLS
`
`Acts
`
`9ZLG
`
`
`
`VS‘Sid
`
`IPR2019-00614 Page 00012
`
`IPR2019-00614 Page 00012
`
`
`
`
`
`
`
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 10 of 104
`
`US 9,703,468 B2
`
`524
`
`Multi-Display Management Module
`
`568
`
`------------------------------------------------------------------------------------------
`
`s Display Configuration Module
`
`5 7 2
`
`-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a---------------------------------
`S Preferences Module
`
`S Device State Module
`
`576 S -----------...------------------------------------------
`Gesture Module
`
`58O S on ------------
`Requirements Module
`
`584
`
`-------------------------
`
`armammadysmm was -----------N
`
`S Event Module
`
`FIG. 5B
`
`IPR2019-00614 Page 00013
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 11 of 104
`Sheet 11 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`tT_
`w
`—
`xer
`ve
`
`
`
`110
`
`FIG.6B
`
`
`FIG.6A
`
`608
`
`604
`
`IPR2019-00614 Page 00014
`
`IPR2019-00614 Page 00014
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 12 of 104
`
`US 9,703,468 B2
`
`
`
`O
`were
`w
`
`r
`O
`CO
`
`IPR2019-00614 Page 00015
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 13 of 104
`Sheet 13 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`FIG.6E
`FIG.6D
`
`
`
`IPR2019-00614 Page 00016
`
`IPR2019-00614 Page 00016
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 14 of 104
`
`US 9,703,468 B2
`
`s
`
`
`
`3
`
`c
`voir
`c
`
`IPR2019-00614 Page 00017
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 15 of 104
`Sheet 15 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`IPR2019-00614 Page 00018
`
`S.
`
`©
`
`
`
`f
`OQ
`
`s
`
` g
`L
`
`<© ©L
`
`e
`
`:
`=
`
`oe
`Q
`
`3
`
`wo
`a
`—
`
`3
`
`Oo
`
`© 9L
`
`IPR2019-00614 Page 00018
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 16 of 104
`Sheet 16 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`FIG.6]
`
`wr
`CN
`CO
`
`
`
`s
`
`IPR2019-00614 Page 00019
`
`IPR2019-00614 Page 00019
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 17 of 104
`Sheet 17 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`©3— 6
`
`&
`104
`
`CO
`O
`led
`
`
`
`28
`
`IPR2019-00614 Page 00020
`
`IPR2019-00614 Page 00020
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 18 of 104
`Sheet 18 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`|
`
`||
`
`|
`
`|
`
`|(ZAejdsiq||@alisuas||yonol)||Zzdoyyseq!|{
`(zAeidsiq
`vyMOPUIAA
`BAISUBS
`BAO
`yono})
`|(zAejdsiq|BAINSUaS|yono})|©MOPUIAA:SA}oeuU]
`(ZAejdsiq
`yono{)ZMOPUIAA
`BAUSUSS
`(,Aejdsiq
`yono{)|MOPUIAA
`BAISUaS
`(1Aejdsiq
`yono])GMODULA,
`BAITSUaS
`SAHOBY]
`(,Aejdsiq
`yono|)QMOPUIAA
`sAIWSUaS
`aaAjoeu]
`
` ||IC,Aejdsiq|laayisues||yono)|I,doyysaq=||||
`
`AIO
`
`SAOY
`
`Vl‘Sia
`
`
`
`#7941
`OL
`
`O92
`
`.002
`
`IPR2019-00614 Page 00021
`
`IPR2019-00614 Page 00021
`
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 19 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`||7MOPUIM)sanisuagyoo]sajoy)--
`
`(aagoeu))||||!|GMOPUIN,(aayoeu})(z91Kejdsig
`7-¢_€mopuin
`_OOi-—eoe|maa|(eaqoeu))||||gmopui,!
`QgL7ZGd~o
`SAISUaSYON]--saijoy)S,|Bol
`
`Jo----4|
`
`(enjoeul),|MOpUY\
`
`|(@Ayjoeuy)
`
`ry
`wT
`+~
`Rete ete weit le ae
`
`
`
`ZMOpU\|
`
`— TT
`|
`
`srl
`
`
`
`.8cL
`
`GZ‘Sid
`
`(z9|Aeidsiq
`
`IPR2019-00614 Page 00022
`
`doyys3q
`
`
`
`-—S—oo—_——
`
`J
`
`IPR2019-00614 Page 00022
`
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 20 of 104
`Sheet 20 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`
`
`v9Ol(z9|Aeldsiqsanisuasyono])
`
`ple
`
`
`
`©MOPUAASAIOV
`
`BOL
`
`02.4.
`O22
`
`
`
`
`
`Aejdsigsysodwon
`
`2092
`
`
`
`
`
`gMOPUY\,,SANOYpMOPUIAASAIOY
`
`OZ‘Old
`
`IPR2019-00614 Page 00023
`
`IPR2019-00614 Page 00023
`
`
`
`
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 21 of 104
`Sheet 21 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`PLL
`
`O42
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`OL|ee991
`
`aezaremepua201
`Pid‘Does
`eS[anonid
`eRaus
`
`[Ewenous
`doyyseq|MopuPoemou
`
`
`
`
`
`
`
`4Z‘Dla
`
`GZ‘Ola
`
`
`
`
`
`.092
`
`Z82
`C82
`
`98/
`982
`
`IPR2019-00614 Page 00024
`
`IPR2019-00614 Page 00024
`
`
`
`
`
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 22 of 104
`Sheet 22 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`028
`
`9b8
`9 3,8
`
`cL8
`
`809
`808
`
`#708
`
`MOPUL\ 708
`
`Joyeoipuysayoy
`
`
`Jeynuep,Aejdsiq
`
`
`JaYHUSP|UONISOgYOB}S
`
`SUOISUBLIG
`soyUap]
`
`828
`
`8‘Old
`
`°-
`
`vc3
`
`IPR2019-00614 Page 00025
`
`()009
`.008
`
`IPR2019-00614 Page 00025
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 23 of 104
`
`US 9,703,468 B2
`
`900 Q
`
`904
`
`908
`
`
`
`912
`
`
`
`916
`
`920
`
`Receive activation of a window
`
`Determine associated display
`
`Determine position in stack
`
`
`
`
`
`Generate logic structure
`
`
`
`924
`
`FIG. 9
`
`IPR2019-00614 Page 00026
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 24 of 104
`
`US 9,703,468 B2
`
`1 OOO 2
`
`1004
`
`1008
`
`Execute (Phone) application
`
`1012
`
`1016
`
`Create manifest
`
`1020
`
`
`
`Determine application display mode
`
`1024
`
`
`
`Set display binding
`
`1028
`
`
`
`Provide display binding to the application
`
`1032
`
`
`
`
`
`Determine
`if configuration change
`has OCCurred?
`
`1036
`
`
`
`
`
`Determine
`if an application mode/event
`has OCCurred?
`
`1040
`
`NO
`
`End
`
`FIG 10
`
`IPR2019-00614 Page 00027
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 25 of 104
`Sheet 25 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`)4100
`
`Fig.11
`
`IPR2019-00614 Page 00028
`
`IPR2019-00614 Page 00028
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 26 of 104
`
`US 9,703,468 B2
`
`ou$
`
`Scch
`
`A?
`
`Sicl
`
`OLCL
`
`SO?L
`
`
`
`
`
`
`
`d??nduOOg
`Jayndwos
`
`abelo}s/ajqepeey
`Jopeoyeipay|
`
`(s)a0IAeg
`
`abei0jis
`
`yndino
`
`ynduj
`
`(s)80IA9qg
`(s)ad1IAeq
`(S)ndO
`(S)Ndd
`
`SSCL
`
`Bupyionn
`
`AIOWSI/\
`
`Buneisdo
`
`WayshS
`
`OSZL
`
`OveL
`
`
`
`SPZLBpodJOuUIO
`
`(suueiBold)
`
`Zp“bigs
`
`Hulsseo0!d
`
`udIesajs00V7
`
`uoneoiuNWLUOD
`
`SsWa}sAS
`
`IPR2019-00614 Page 00029
`
`IPR2019-00614 Page 00029
`
`
`
`
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 27 of 104
`Sheet 27 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`1300
`
`
`
`nm
`
`
`
`ru/
`
`1304C
`
`Fig.13
`
`IPR2019-00614 Page 00030
`
`IPR2019-00614 Page 00030
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 28 of 104
`Sheet 28 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`s
`1434
`
`
`
`s : S
`1430 1438
`1442
`
`1304\
`
`s
`1400
`
`Fig.14
`
`IPR2019-00614 Page 00031
`
`IPR2019-00614 Page 00031
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 29 of 104
`Sheet 29 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`S.
`3D2
`d
`va
`
`t y-
`
`r S.
`
`1308y
`
`
`
`:
`1500
`
`:/
`
`Fig.15
`
`IPR2019-00614 Page 00032
`
`IPR2019-00614 Page 00032
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 30 of 104
`
`US 9,703,468 B2
`
`1600
`
`1604
`
`1608
`
`1612
`
`1616
`
`1620
`
`Connect device and Computer system
`
`Generate unified desktop
`
`Determine Status indicators
`
`Provide status indicators together
`
`1624.
`
`FIG. 16
`
`IPR2019-00614 Page 00033
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 31 of 104
`
`US 9,703,468 B2
`
`1700
`
`1704
`
`1708
`
`1712
`
`1716
`
`1720
`
`Receive selection of status indicator
`
`Provide information/user interface device
`
`Receive selection of user interface device
`
`Provide menu for status indicator
`
`1724
`
`FIG. 17
`
`IPR2019-00614 Page 00034
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 32 of 104
`
`US 9,703.468 B2
`US 9,703,468 B2
`
`
`
`
`
`SBIGGSDEBENSIGEN.
`
`
`
`Se:SHOVESYaENS
`
`
`
`apday'eUREDBe
`
`nasose
`
`PAPMG
`
`
`
`OBL
`
`0081
`
`SRUBGATSME vOEt
`
`vay
`
`288HORN
`
`
`
` “OFBUOYJOINDOU
`
`8081
`808 ||
`
`gp“Bis
`ºp ‘61-1
`
`oLet
`
`IPR2019-00614 Page 00035
`
`MIORHanSaad37
`
`RepOER,
`
`sony
`
`Reh,
`
`Beret
`
`IPR2019-00614 Page 00035
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 33 of 104
`
`US 9,703,468 B2
`
`1900
`
`
`
`1904
`
`1908
`
`192
`
`:: Opera 5 killini (a hora e Beta}
`para Ceilijares pro rete. http:/f
`bit.yffi A. Curies: saia
`
`hate coincidence, http://bit,
`iy, SN.8xik BA BARACUS, likes
`38 islikes
`
`1808
`
`Every tire i tikirk right at
`
`388.
`
`196
`
`920
`
`1924
`
`1928
`
`Fig. 19
`
`IPR2019-00614 Page 00036
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 34 of 104
`
`US 9,703,468 B2
`
`2000
`
`2004
`
`2008
`
`2012
`
`2016
`
`Connect device and Computer system
`
`Generate unified desktop
`
`Execute device application
`
`2020
`
`Display application interface in freeform window
`
`2024
`
`End
`
`FIG. 20
`
`IPR2019-00614 Page 00037
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 35 of 104
`
`US 9,703,468 B2
`
`2104
`
`to
`
`21 O8
`
`Receive selection of device application
`
`Determine device application features and/or controls
`
`Provide a freeform window for display of device application
`
`Provide user interface device(s) in the freeform
`window to enable features and/or Controls
`
`2112
`
`2116
`
`2120
`
`2124
`
`End
`
`FIG 21
`
`IPR2019-00614 Page 00038
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 36 of 104
`Sheet 36 of 104
`
`US 9,703,468 B2
`US 9,703.468 B2
`
`a ,
`ru/
`:
`1304
`
`Fig.22 2208
`
`&
`
`2216
`
`
`
`N
`
`
`
`
`s
`2204
`
`1304
`
`N—
`N
`NS
`wa
`CN
`CN
`
`IPR2019-00614 Page 00039
`
`IPR2019-00614 Page 00039
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 37 of 104
`
`US 9,703,468 B2
`
`
`
`s
`
`ru/
`
`N
`vice
`ca
`CN
`
`IPR2019-00614 Page 00040
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 38 of 104
`
`US 9,703,468 B2
`
`
`
`ru/ru/
`
`Ns
`
`
`
`sru/
`
`sru/
`
`IPR2019-00614 Page 00041
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 39 of 104
`
`US 9,703,468 B2
`US 9,703.468 B2
`
`aA
`N
`a
`
`in
`AN
`.
`©
`
`©©
`iO
`“i
`
`
`
`st
`S
`-
`7
`Ce
`ra
`rw
`
`R
`ta
`N
`
`
`
`°a
`
`sl
`N
`
`aW
`
`1304v N“
`2504C
`
`IPR2019-00614 Page 00042
`
`NN
`
`
`
`IPR2019-00614 Page 00042
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 40 of 104
`Sheet 40 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`Ns
`D>2200
`
`
`
`>2604
`^,
`
`s
`2620
`
`1304c
`ru/
`
`Fig.26
`
`i
`2616
`
`
`
`N—
`
`NN
`
`IPR2019-00614 Page 00043
`
`
`
`2608v1304C
`ru/ru/
`
`
`
`IPR2019-00614 Page 00043
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 41 of 104
`Sheet 41 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`Ns
`>2200
`
`
`
`-N,s
`)2704
`
`s
`
`ru/
`
`2720 N—
`
`2708v1304v 2716
`sru/ru/
`
`s
`Fig.27
`
`IPR2019-00614 Page 00044
`
`CN
`re
`N
`N
`
`NN
`
`IPR2019-00614 Page 00044
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 42 of 104
`
`US 9,703,468 B2
`
`00ZZ
`
`
`
`
`
`gz '61-I
`
`93.82
`
`
`
`Z ?ZZ
`
`IPR2019-00614 Page 00045
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`
`
`9162
`
`VvO6TC
`
`
`
`
`
`PYdaaisyU8uMsjej1S
`
`Sheet 43 of 104
`Sheet 43 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`JEDBAIQOOy
`
`6z‘bis
`
`
`
`
`
`pueyoojunJoyoojupSORL9IU]SOIAEG
`
`S0BLe}Uu|
`
`
`
`
`
`BdIAEQgPukeOdSBM
`
`JNOYUMJEDMOY494}4PUBDdSEMIED
`
`JdulspoossedsAle0eyUsEINSauInbeyIdsjeaaeyyndu|Auy‘orem
`QdeLJa]U]BOIAEqJOSdIAeqUOYOO|UNBOBLS]U]BdIAEqpue
`
`
`
`
`
`
`
`
`
`
`0262
`
`VZBS
`
`8267
`
`IPR2019-00614 Page 00046
`
`IPR2019-00614 Page 00046
`
`
`
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 44 of 104
`
`US 9,703,468 B2
`
`3004
`
`3008
`
`3012
`
`3016
`
`
`
`3020
`
`
`
`
`
`
`
`3028
`
`3032
`
`3000
`
`System sleeps
`
`Receive event
`
`Determine state
`
`
`
`
`
`inform user
`of incorrect
`input
`
`Determine
`whether correct input
`received?
`
`
`
`
`
`Wake system
`
`FIG. 30
`
`IPR2019-00614 Page 00047
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 45 of 104
`Sheet 45 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`t
`D
`
`
`
`>
`
`ru/
`
`1304G
`
`
`
`ru/
`
`4308C
`
`3112
`
`3108
`
`Fig.31
`
`IPR2019-00614 Page 00048
`
`IPR2019-00614 Page 00048
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 46 of 104
`Sheet 46 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`s
`3200
`
`s
`3204
`
`s
`3212
`
`1308C
`
`3208
`
`&
`
`Fig.32
`
`IPR2019-00614 Page 00049
`
`IPR2019-00614 Page 00049
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 47 of 104
`Sheet 47 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`3112
`
`>3300
`
`3204
`
`3304
`
`809 j.
`
`Fig.33
`£8 "bl-i
`
`3108
`
`80 || 9
`
`IPR2019-00614 Page 00050
`
`1304c
`
`IPR2019-00614 Page 00050
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 48 of 104
`
`US 9,703,468 B2
`
`3400
`
`3404
`
`3408
`
`3412
`
`3416
`
`3420
`
`Provide a device and
`Computer system
`
`Present computer
`system desktop
`
`
`
`Determine if
`applications were visible
`On device?
`
`NO
`
`3428
`
`Move applications from device to
`Computer system display
`
`
`
`PrOVide
`desktop on
`device also
`
`End
`
`34.32
`
`FIG. 34
`
`IPR2019-00614 Page 00051
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 49 of 104
`Sheet 49 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`3500
`
`3504
`
`1304c
`
`s
`
`3508
`
`Fig.35
`
`IPR2019-00614 Page 00052
`
`IPR2019-00614 Page 00052
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 50 of 104
`Sheet 50 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`1308c 3504
`
`:ru/
`
`>3600
`N
`
`
`
`3604
`
`1304K
`
`Fig.36
`
`IPR2019-00614 Page 00053
`
`/
`
`IPR2019-00614 Page 00053
`
`
`
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 51 of 104
`
`US 9,703,468 B2
`
`3700
`
`3704
`
`
`
`3708
`
`3712
`
`
`
`Undock device
`
`Hide computer
`system desktop
`
`3716
`
`Determine if
`applications were visible
`On device?
`
`
`
`Provide
`desktop on
`device also
`
`372O
`
`Maintain applications from device
`on device display
`
`
`
`3728
`
`FIG. 37
`
`IPR2019-00614 Page 00054
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 52 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`vO8E
`
`
`
`
`
`88 ’61-I
`
` g¢‘bigs
`
`
`
`pafe|dsipurewalLua}sAsJa}INdWOD0}CBE
`
`
`
`
`suoneoyddepedeldsiqBAOWBICISIASUOneOIddy
`
`
`
`
`
`suoneoyddepakeldsiqBuiuunsAJSnoweidpuesuoneayddyepi
`
`
`
`
`
`uepplyalepeAejdsipaiesuoneayddedoyjsepAegjdsip
`
`VEE
`
`8c8e
`
`IPR2019-00614 Page 00055
`
`IPR2019-00614 Page 00055
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 53 of 104
`Sheet 53 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`0069^
`006E0
`
`SANISUBSYONO]
`
`
`SASUSSYONoL
`
`zAejdsiq
`
`|Aejdsiq
`
`
`
`6¢‘biz
`68 "61-I
`
`
`
`
`
`Agjdsiqwajshssajndwoy
`
`IPR2019-00614 Page 00056
`
`IPR2019-00614 Page 00056
`
`
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`2017
`Jul. 11
`
`Sheet 54 of 104
`Sheet 54 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`94.037
`+
`
`2O
`
`o
`
`©No
`
`O+
`
`wi
`O
`<
`
`2
`Op ‘61-I
`~~
`.
`=
`
`eo
`Oo
`
`©+
`
`IPR2019-00614 Page 00057
`
`N“_
`o
`
`—w
`
`wae
`ru/
`
`©o
`
`Oo_
`
`oO
`Q_
`o
`
`\
`
`
`
`A
`o
`
`NS
`
`Co
`o
`x
`(a9)
`
`
`
`<p
`
`Qo
`
`S+
`
`.
`
`=o
`
`2
`=
`
`N =5S
`
`S &
`
`st
`oS
`
`>—_
`
`IPR2019-00614 Page 00057
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 55 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`
`
`|MOPUIAAWaysksuajndwog
`
`
`
`
`
`ZMOPUIAALUS}SASJe;Ndwog
`
`(…
`cove
`
`VOL
`
`80LV
`
`OLLY
`
`doyyseq
`
`Vir‘bly
`
`IPR2019-00614 Page 00058
`
`IPR2019-00614 Page 00058
`
`
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 56 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`9ELVCOCELV
`
`OcLY
`
`
`
`SAHOBYU
`(zAejdsiq
`yono|)ZMOPUI\A
`(,Aejdsiq
`yono|)|MOPUIMA
`BAIUSUBS
`{—_——™
`(,Aeidsiq
`yono|)GMOPUIAA
`SAIISUBS
`BAHOCU]
`||(,Aejdsiq||sanisuag||yonoj)||gmopuiny||oajoeuy=|||
`
`—Yonol)jSAHOBUY|&MOPUIMA
`:(ZAeidsiq||SAmisuas,(ZAeidsiq; yono1)|eAqisuag|bMOpUIM,
`
`BAIISUSS
`
`SANOY
`
`annoy
`
`Gly‘Sila
`
`IPR2019-00614 Page 00059
`
`IPR2019-00614 Page 00059
`
`
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`
`
`Sheet 57 Of 104
`Sheet 57 of 104
`
`BOLE
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`ep‘big
`
`Z?y (61-)
`
`IPR2019-00614 Page 00060
`
`IPR2019-00614 Page 00060
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 58 of 104
`Sheet 58 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`Fig.43A
`
`IPR2019-00614 Page 00061
`
`=5o ==@ =St 4
`
`
`
`4300v
`
`4116
`
`
`
`ActiveWindow2
`
`120
`
`4304
`
`IPR2019-00614 Page 00061
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 59 of 104
`Sheet 59 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`|———eon~y|pooTTT|j(cAeidsiq|rSSSSS7|oArmisues,(ZAeidsiq|; yono1);2AIsUas|PMOPUIM;—yonoL)|(Z8|Kejdsiq|f SANOBUL|&MOPLIAA; SAOeU|
`9ELVC|COLY
`oO|
`
`
`SanIsuesYORO|eAHoy)|gmopuiyy|eaqoeu--
`dopjseq|
`||||aanisuag|yonoy)!|||
`|(,AejdsiqI(,Aejdsiq|aanisues
`yono,)|9MopulAA
`
`gév‘Ola
`
`BANOBU]
`
`IPR2019-00614 Page 00062
`
`IPR2019-00614 Page 00062
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`
`
`Sheet 60 of 104
`Sheet 60 of 104
`
`Fig.44
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`IPR2019-00614 Page 00063
`
`IPR2019-00614 Page 00063
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 61 of 104
`Sheet 61 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`<<
`
`CN
`s
`O
`oO
`O
`s
`C
`2
`as
`o
`CC
`
`&=© 2G
`
`
`
`Fig.45A
`
`IPR2019-00614 Page 00064
`
`N =5
`
`4500v
`ru/
`
`s
`4120
`
`4304
`
`IPR2019-00614 Page 00064
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 62 of 104
`Sheet 62 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`|||
`
`||||
`
`|yono|)
`
`SANSUAS|(ZAeidsiq|
`
`
`yMOPUlM; Yonoj)4eARIsUeseanisuag|yonoy)
`end
`(zAeidsiq|pTTTTqTTT
`
`BAI}OBU||€MOpUuIAA;=YONOLyono|)
`|||;eamsues,(2Aeidsiq(,Aeidsiq|aanisuag|yonoy)||||
`—CeeeLee_yt
`ZeLyZeb‘
`
`
`SANOBU|--BAHOY)pmopuiy|aanoeu
`iz | +
`doyjseqSAIOY:
`
`
`aSP‘Sls
`
`lcmopuiy|eagoeuy
`
`|9MOPUIAA
`
`|(,AejdsigI(,Aejdsiq|eanisues
`
`OLLY
`
`ELV
`
`‘yosy
`
`IPR2019-00614 Page 00065
`
`IPR2019-00614 Page 00065
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`
`
`Sheet 63 of 104
`Sheet 63 of 104
`
`Fig.46
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`IPR2019-00614 Page 00066
`
`IPR2019-00614 Page 00066
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 64 of 104
`Sheet 64 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`IPR2019-00614 Page 00067
`
`Ne
`w
`S
`L
`
`=L
`
`a
`=
`é
`Q
`
`2 5
`
`IPR2019-00614 Page 00067
`
`
`
`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 65 of 104
`Sheet 65 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`
`
`
`
`CLEVOLLY
`
`8cLyV
`
`‘yosy
`
`
`
`
`
`
`
`
`
`
`OZLYC_74;dopiseqannoyst||»)feeneee~~4eeee
`2Agoy)|mopulm|sanoeu||Yyonol)4eAmIsUaS yonol)eanisuag|yonoy)|gmopuy||sagoeul;gmopulyYONoL |———re——onn“|jbopo4|(2Aeidsiq,jb----4jossA||SARISUBS|(zAeidsiqpoOTTTTqTTTTa1(,Aeydsiq|}YOREL);ennisueg,(zAeidsiq|I(,Aedsiq|eanisueg||@MOPUIM,|;~eayisueg;(ZAeidsiq(,Aeidsiq|aanisuag|yonoy)=||SAHeUl|pymopUIM;,lomopuin,|eanoeu;=|aey|aaoeuyy ~yono1)
`
`
`
`
`9ElPHeeeee
`COLY4Svel
`
`GLP‘Old
`
`IPR2019-00614 Page 00068
`
`IPR2019-00614 Page 00068
`
`
`