(12) United States Patent
`Reeves et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 9.703,468 B2
`Jul. 11, 2017
`
`USOO9703468B2
`
`(54) UNIFIED DESKTOP INDEPENDENT FOCUS
`IN AN APPLICATION MANAGER
`
`(71) Applicant: Z124, George Town (KY)
`
`(72) Inventors: Paul E. Reeves, Oakville (CA); Sanjiv
`Sirpal, Oakville (CA); Martin Gimpl.
`Helsinki (FI)
`(73) Assignee: Z124, George Town (KY)
`(*) Notice:
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 983 days.
`(21) Appl. No.: 13/627,679
`(22) Filed:
`Sep. 26, 2012
`
`(65)
`
`Prior Publication Data
`US 2013/011 1371 A1
`May 2, 2013
`
`Related U.S. Application Data
`(63) Continuation-in-part of application No. 13/605,740,
`filed on Sep. 6, 2012, now Pat. No. 9,529,494, and a
`continuation-in-part of application No. 13/605,482,
`filed on Sep. 6, 2012, and a continuation-in-part of
`application No. 13/605,145, filed on Sep. 6, 2012,
`now Pat. No. 8,990.713, and a continuation-in-part of
`application No. 13/604,960, filed on Sep. 6, 2012,
`now abandoned, and a continuation-in-part of
`(Continued)
`
`(51) Int. Cl.
`G06F 3/048
`G06F 3/0486
`G06F 3/0488
`GO6F 3/14
`(52) U.S. Cl.
`CPC ........ G06F 3/0486 (2013.01); G06F 3/04883
`(2013.01); G06F 3/1423 (2013.01); G06F
`2203/04803 (2013.01)
`
`(2013.01)
`(2013.01)
`(2013.01)
`(2006.01)
`
`(58) Field of Classification Search
`None
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,757,371 A * 5/1998 Oran et al. .................... 71.5/779
`6,304.261 B1
`10/2001 Shields et al.
`(Continued)
`
`OTHER PUBLICATIONS
`
`Soper “Sams Teach Yourself Microsoft Windows(R 7 in 10 Min
`utes.’ Sams, 2010, Safari books, Web, Jul. 1, 2014 techbus.
`Safaribooksonline.com/book/operating-systems/
`9780132121897?bookview=overview 4 pages.
`(Continued)
`
`Primary Examiner — Ryan Barrett
`Assistant Examiner — Haimei Jiang
`(74) Attorney, Agent, or Firm — Sheridan Ross P.C.
`
`ABSTRACT
`(57)
`Methods and devices for selectively presenting a user inter
`face or “desktop' across two devices are provided. More
`particularly, a unified desktop is presented across a device
`and a computer system that comprise a unified system. The
`unified desktop acts as a single user interface that presents
`data and receives user interaction in a seamless environment
`that emulates a personal computing environment. To func
`tion within the personal computing environment, the unified
`desktop includes a process for docking and undocking the
`device with the computer system. The unified desktop
`presents a new user interface to allow access to functions of
`the unified desktop.
`
`20 Claims, 104 Drawing Sheets
`
`to
`
`4.
`
`
`
`324
`
`7328
`
`338
`
`744
`
`7332
`
`Window 8
`
`Apple Ex. 1019
`Apple Inc. v. Firstface Co., Ltd.
`IPR2019-00614
`Page 00001
`
`

`

`US 9,703.468 B2
`Page 2
`
`a
`
`T18, 1
`
`2008/0307350 A1 12/2008 Sabatelli et al.
`Related U.S. Application Data
`2008/0313632 A1 12/2008 Kumar et al.
`2009/0094523 A1* 4/2009 Treder et al. ................. 715.738
`application No. 13/604,384, filed on Sep. 5, 2012,
`2009/0164915 A1
`6/2009 Gasnet al.
`now Pat. No. 8,990,712, and a continuation-in-part of
`38885 A. 1939 Real
`application No. 13/603,136, filed on Sep. 4, 2012,
`ands
`catapagippi 2009/0328033 A1* 12/2009 Kohavi ................. GO6F 9/5027
`Ca10 TNO.
`CC. O. Va.
`OW
`s
`s
`s
`s
`Pat. No. 8,872,727, and a continuation-in-part of
`2010, 0037145 A1
`2/2010 Sides
`application No. 13/566,336, filed on Aug. 3, 2012,
`2010.0088598 A1
`4/2010 Lee et al.
`now Pat. No. 9,405.459, and a continuation-in-part of
`2010, 0138780 A1* 6, 2010 Marano ................. G06F 3.1415
`application No. 13/566,244, filed on Aug. 3, 2012,
`2011/0093836 A1
`4/2011 Galicia et all
`T15,804
`now abandoned, and a continuation-in-part of appli-
`2011 0138314 A1* 6, 2011 Mir et al. ...................... 71.5/779
`cation No. 13/566,168, filed on Aug. 3, 2012, and a
`2011 O197141 A1
`8, 2011 MaZZaferri
`continuation-in-part of application No. 13/566,103,
`2011/0225553 A1
`9, 2011 Abramson et al.
`filed on Aug. 3, 2012, now abandoned, and a con- S.S. A1
`3. Robert et al
`tinuation-in-part of application No. 13/543,678, filed
`2012/0081353 A1
`4/2012 Yusupov et al.
`on Jul. 6, 2012, now Pat. No. 9.268.518, and a
`2012,0081380 A1
`4/2012 Reeves et al.
`•
`Yus
`s
`•
`- s
`s
`s
`2012,0081383 A1
`4/2012 Reeves et al.
`continuation-in-part of application No. 13/543,635,
`2012/008 1396 A1
`4/2012 Yusupov et al.
`filed on Jul. 6, 2012, now abandoned, and a continu-
`2012/0084480 A1
`4/2012 Reeves et al.
`ation-in-part of application No. 13/408.530, filed on
`3.39. A. 38:
`s al
`G06F 1, 1616
`Feb. 29, 2012, now abandoned, and a continuation-
`2012,008471.0 A1* 4, 2012 SE C. a.
`in-part of application No. 13/410,958, filed on Mar. 2,
`"
`' " 715.783
`2012, now Pat. No. 9,122,441, and a continuation-
`4/2012 Gimpl et al.
`2012fOO84737 A1
`in-part of application No. 13/410.983, filed on Mar. 2,
`4/2012 Benedek et al.
`2012/0084791 A1
`2012, now Pat. No. 9,003.311, and a continuation-in-
`t38: Elek et al
`38:8.76 A.
`part of application No. 13/411,034, filed on Mar. 2,
`4, 2012 E. I.
`2012,0084.798 A1
`2012, OW Pat. No. 8,910,061, and a continuation-
`4/2012 Reeves et al.
`2012fOO8671.6 A1
`in-part of application No. 13/411,075, filed on Mar. 2,
`4, 2012 Liu
`2012,0086,717 A1
`2012, now abandoned, and a continuation-in-part of
`4/2012 Reeves et al.
`2012/008990.6 A1
`71.5/799
`application No. 13/436,593, filed on Mar. 30, 2012,
`3:39: A. 23: S. s al
`now Pat. No. 9,069,518, and a continuation-in-part of
`2012/O1242.45 A1
`5/2012 E. etal."
`application No. 13/436,823, filed on Mar. 30, 2012,
`2012/0143944 A1
`6, 2012 Reeves et al.
`now Pat. No. 9.213,516, and a continuation-in-part of
`2012fO166959 A1
`6, 2012 Hillerio et al.
`application No. 13/436,826, filed on Mar. 30, 2012,
`2012/0174021 A1, 7/2012 Dharawat
`now abandoned, and a continuation-in-part of appli-
`2012fO296959 A1* 11/2012 Momchilov .............. GO6F 9/54
`s
`TO9,203
`No.
`yed O ME R 2. 2012/0324365 A1 12/2012 Momchilov .............. G06F 3/14
`al. No. 8.8/4,894, and a conunuauon-1n-part o
`715.738
`application No. 13/485,743, filed on May 31, 2012,
`2013, OO19183 A1
`1/2013 Reeves
`now Pat. No. 8,904,165.
`2013,0021262 A1
`1/2013 Chen
`2013, OO24778 A1
`1/2013 Reeves
`(60) Provisional application No. 61/539,884, filed on Sep.
`2013, OO24812 A1
`1/2013 Reeves
`27, 2011.
`2013/0076592 A1
`3/2013 Reeves et al.
`2013/0076593 A1
`3/2013 Reeves et al.
`2013/0076594 A1
`3/2013 Sirpal et al.
`2013/0076664 A1
`3/2013 Reeves et al.
`2013/0076665 A1
`3/2013 Reeves et al.
`2013/0076780 A1
`3/2013 Reeves et al.
`2013,008O143 A1
`3/2013 Reeves et al.
`2013/0080759 A1
`3/2013 Reeves et al.
`2013/0080899 A1
`3/2013 Reeves et al.
`2013,0080909 A1
`3/2013 Reeves et al.
`2013/0080933 A1
`3/2013 Reeves et al.
`2013,0080934 A1
`3/2013 Reeves et al.
`2013/0080935 A1
`3/2013 Reeves et al.
`2013,0080936 A1
`3/2013 Reeves et al.
`2013/0080938 A1
`3/2013 Reeves et al.
`2013,0080939 A1
`3/2013 Reeves et al.
`2013/008094.0 A1
`3/2013 Reeves et al.
`2013,0080941 A1
`3/2013 Reeves et al.
`2013/0080942 A1
`3/2013 Reeves et al.
`2013,0080943 A1
`3/2013 Reeves et al.
`2013,0080944 A1
`3/2013 Reeves et al.
`2013,0080969 A1
`3/2013 Reeves et al.
`2013, O104051 A1
`4/2013 Reeves et al.
`2013,0104.062 A1
`4/2013 Reeves et al.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4/2005 Driskell
`6,883,143 B2
`386 SER's al
`2. R
`wk I
`7.987,432 B1* 7/2011 Grechishkin ......... Goog.
`
`ck
`
`ck
`8,291.344 B2 * 10/2012 Chaudhri ............ G06F s
`
`ck
`. 717/109
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`.
`3. R 1933; As a .
`8.62883 B2 12/2013 Louch ........o G06F 3.0481
`wk 4
`71.5/792
`3/2014 Runov et al.
`8,677.274 B2
`9,317,195 B1 * 4/2016 Grechishkin ......... G06F 3.0486
`2004/0172588 A1
`9/2004 Mattaway
`2004/0201628 A1 10, 2004 Johanson et al.
`2004/0267815 A1 12, 2004 De Mes
`2006/0230156 A1* 10/2006 Shappir ................. G06F 3/1454
`709,227
`2006/0288306 A1* 12/2006 Mahajan ............... G06F 9/4445
`T15,804
`2007/0011622 A1
`1/2007 Chae et al.
`2007/0022387 A1
`1/2007 Mayer et al.
`2007/0O83829 A1
`4/2007 Lauridsen et al.
`2007.0089064 A1
`4/2007 Facemire et al.
`
`OTHER PUBLICATIONS
`
`Official Action for U.S. Appl. No. 13/604,384, mailed Jun. 4, 2014
`11 pages.
`
`IPR2019-00614 Page 00002
`
`

`

`US 9,703.468 B2
`Page 3
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`Official Action for U.S. Appl. No. 13/604,960, mailed May 6, 2014
`26 pages.
`Official Action for U.S. Appl. No. 13/605,145, mailed Jun. 5, 2014
`13 pages.
`Official Action for U.S. Appl. No. 13/605,740, mailed Jul. 16, 2014
`27 pages.
`Zain "Pin Wesbites' bookmarks in Tasklist for Quickest Access
`Windows 7).” Archived Oct. 10, 2010, Accessed Web. Jan. 15,
`2015.
`http://www.tipsotricks.com/2010/10pin-wesbites-book
`marks-in-tasklist-for-quickest-access.html, 6 pages.
`Notice of Allowance for U.S. Appl. No. 13/604,384, mailed Oct. 7,
`2014.9 pages.
`Official Action for U.S. Appl. No. 13/604,960, mailed Sep. 23, 2014
`29 pages.
`Official Action for U.S. Appl. No. 13/604,960, mailed Mar. 26, 2015
`32 pages.
`Notice of Allowance for U.S. Appl. No. 13/605,145, mailed Oct. 15,
`2014 10 pages.
`Official Action for U.S. Appl. No. 13/605,740, mailed Jan. 29, 2015
`29 pages.
`U.S. Appl. No. 13/485,734, filed May 31, 2012, Reeves et al.
`U.S. Appl. No. 13/543,678, filed Jul. 6, 2012, Reeves et al.
`Google Image Result for Fujitsu Dual Screen Phone, published date
`unknown, retrieved Apr. 18, 2011, 1 page. Retrieved from: www.
`google.com/imgres?imgurl=http://www.computerriver.com/im
`ages/dual-screen-phone.jpg.
`Google Image Result for LG Dual Touch Screen Concept Phone by
`Eugene Kim, published date unknown, retrieved Apr. 18, 2011, 1
`page. Retrieved from: www.google.com/imgres?imgurl=http://
`fgadgets.com/wp-content/uploads/2010/08/Ig-dual-touch-screen
`phone-Eugene-Kim-01.jpg.
`Google Image Result for Fujitsu Dual Screen Phone, published date
`unknown, retrieved Apr. 18, 2011, 1 page. Retrieved from: www.
`google.com/imgres?imgurl=http://www.gSmdome.com/wp-con
`tent/uploads/2010/10/fujitsu-dual-screen-phone w2cP7 54.jpg.
`Google Image Result for Kyocera Echo, published date unknown,
`retrieved Apr. 18, 2011), 1 page. Retrieved from: www.google.
`
`com/imgres?imgurl=http://www.hardwaresphere.com/wp-content/
`uploads/2011/02/kyocera-echo-dual-screen-android-phone-for
`sprint-network.jpg.
`Google Image Result for HTC Triple Viper, published date
`unknown, retrieved Apr. 18, 2011), 1 page. Retrieved from:www.
`google.com/imgres?imgurl=http://www.santafemods.com/Forum/
`AndroidForums/htcTripleViper.png.
`Google Image Result for Dual-Screen Phone, retrieved Apr. 18.
`2011,
`1
`page.
`Retrieved
`from:
`www.google.com/
`imgres?imgurl=http://www.netshet.org/wp-content/uploads/2011/
`02/Dual-Scree .
`. . .
`Website entitled “LapdockTM for Motorola ATRIX.” Motorola
`Mobility, Inc., 2011, retrieved on Apr. 18, 2011), 1 page. Retrieved
`from: www.motorola.com/Consumers/US-EN/Consumer-Product
`and-Services/Mobile+Ph . . . .
`Website entitled “Motorola ATRIX 4G Laptop Dock Review.”
`phoneArena.com, posted Mar. 2, 2011, retrieved on Apr. 18, 2011).
`6 pages. Retrieved from: www.phonearena.com/reviews/Motorola
`ATRIX-4G-Laptop-Dock-Review id2667.
`Burns, C., “Motorola ATRIX 4G Laptop Dock Review.” Android
`Community, Feb. 20, 2011, retrieved on Apr. 18, 2011), 5 pages.
`Retrieved from: www.androidcommunity.com/motorola-atrix-4g
`laptop-dock-review-20110220/.
`Catacchio, “This Smartphone has two huge screens . . . that rotate.”
`The Next Web, Inc., Oct. 7, 2010, retrieved on Jul. 21, 2011, 2
`pages. Retrieved from: www.thenextweb.com/asia/2010/10/07/this
`Smartphone-has-two-huge-screens-that-rotate?.
`Posted by Harman03. “Kyocera Echo Dual-screen Android Phone.”
`posted 4 weeks from Apr. 18, 2011, retrieved on Apr. 18, 2011). 3
`pages. Retrieved from: www.unp.meff106/kyocera-echo-dual
`screen-android-phone-143800?.
`Stein, S., “How does the Motorola Atrix 4G Lapdock compare with
`a laptop?” Crave—CNET, Feb. 9, 2011 retrieved on Apr. 18, 2011).
`7 pages. Retrieved from: www.news.cnet.com/8301-17938 105
`20031251-1.html.
`Website entitled, “Kyocera Echo.” Kyocera Communications, Inc.,
`2011, retrieved on Aug. 27, 2012), 6 pages. Retrieved from:
`www.echobykyocera.com/.
`Website entitled, “Sony Tablet.” Sony Corporation, 2012, retrieved
`on Aug. 27, 2012, 3 pages. Retrieved from: www.store. Sony.com/
`webapp/wcs/stores/servlet/Category|Display?catalogId=10551
`&storeId=10151&langId=-1&categoryId=8198552921644795521.
`
`* cited by examiner
`
`IPR2019-00614 Page 00003
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 1 of 104
`Sheet 1 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`
`
`IPR2019-00614 Page 00004
`
`IPR2019-00614 Page 00004
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 2 of 104
`
`US 9,703,468 B2
`
`156
`
`1OO
`
`FIG. 1F
`
`100.
`
`
`
`44
`
`148
`
`52
`
`100
`
`32
`
`136
`
`140
`
`IPR2019-00614 Page 00005
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 3 of 104
`Sheet 3 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`5 to
`3100
`
`O o
`0 cm
`
`
`
`
`
`IPR2019-00614 Page 00006
`
`IPR2019-00614 Page 00006
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 4 of 104
`
`US 9,703,468 B2
`
`
`
`Screen 2
`
`Touch Sensitive
`Display
`
`Touch Sensitive
`
`Configurable Area
`
`Configurable Area
`
`216a
`
`208
`
`22
`
`204
`
`Display
`Controller
`
`Memory
`
`Data
`storage
`
`Processor
`
`Display
`Controller
`
`224
`
`228
`
`236 GPS
`
`Cellular
`Telephony
`Module
`
`Other Wireless
`Communication
`Module
`
`Power Source and
`Power control Module
`
`Port
`Interface
`
`integrated
`Audio if C)
`
`Hardware
`Buttons
`
`Position
`Sensor(s)
`
`Accelerometer(s)
`
`Audio f()
`interface
`
`FIG. 2
`
`IPR2019-00614 Page 00007
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet S of 104
`Sheet 5 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`100
`
`336
`
`
`
`IPR2019-00614 Page 00008
`
`IPR2019-00614 Page 00008
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 6 of 104
`
`US 9,703,468 B2
`
`998
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Z28
`
`999
`
`#799
`
`No.odi IV)
`
`IPR2019-00614 Page 00009
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 7 of 104
`
`US 9,703,468 B2
`
`Tap
`
`Long Press
`
`Drag
`
`Fick
`
`Pinch
`
`Spread
`
`432a
`
`428a
`
`428b
`
`428b
`
`428b
`
`--S 420
`
`FIG. 4A
`432b
`
`- S. 424
`
`FIG. 4B
`432
`
`436
`
`-S 400
`
`436
`- S. 404
`
`FIG. 4C
`432
`9
`
`FIG. 4D
`
`428a
`
`432a
`436a
`
`436b
`
`432b
`
`- S. 408
`
`428b
`
`FIG. 4E
`
`432a
`
`3:6a)
`
`432b
`
`436b
`--S 410
`
`428a
`
`FIG. 4F
`
`428b
`
`IPR2019-00614 Page 00010
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 8 of 104
`
`US 9,703,468 B2
`
`ty 428b.
`
`428a
`
`432b - 400
`2 -
`
`436
`
`FIG. 4G
`
`432a
`420 -
`
`432b
`400
`428b. -
`
`428a
`
`436
`
`FIG. 4H.
`
`IPR2019-00614 Page 00011
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 9 of 104
`
`US 9,703,468 B2
`
`
`
`commozan?‘
`
`“mmmcmé
`
`
`
`
`
`nvmmN533%
`r828%.?
`
`mvom
`
`98w858%“wa
`
`IIIJHE”LEE.WNvmL memcmfim.2322m$305.cosmufia<.LjmMcmEmmmcmEWL
`
`
`
`
`
`
`
`
`
`own
`
`*.WM
`
`
`
`flmtzmmEmi
`
`
`
`
`
`Emwwmmmcmfimao
`
`fiM.~
`
`
`
`
`
`
`
`
`
`mSUOEmxomomomtsm111W.“mmm
`
`xofiwxwmv
`
`
`
` WLocum:55m.[M2252EmEmmmamESac“
`
`
`
`hmzobcou@3mem
`
`m
`
`
`
`«wow
`
`.LwL625
`
`
`
`
`
`
`WmmsvofiLwcmEmmmcmE303E?»
`
`
`
`
`
`Wfimwm2623
`
`
`
`3me
`
`
`
`www
`
`
`
`wAlvfiommmooi_.
`W#15
`
`
`
`mmE
`
`3N5
`
`0N5
`
`66.GE
`
`IPR2019-00614 Page 00012
`
`IPR2019-00614 Page 00012
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 10 of 104
`
`US 9,703,468 B2
`
`524
`
`Multi-Display Management Module
`
`568
`
`------------------------------------------------------------------------------------------
`
`s Display Configuration Module
`
`5 7 2
`
`-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a-a---------------------------------
`S Preferences Module
`
`S Device State Module
`
`576 S -----------...------------------------------------------
`Gesture Module
`
`58O S on ------------
`Requirements Module
`
`584
`
`-------------------------
`
`armammadysmm was -----------N
`
`S Event Module
`
`FIG. 5B
`
`IPR2019-00614 Page 00013
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 11 of 104
`Sheet 11 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`‘Q'v"
`w
`‘—
`xer
`ve
`
`608
`
`
`
`FIG.GB
`
`
`
`110
`
`604
`
`FIG.6A
`
`IPR2019-00614 Page 00014
`
`IPR2019-00614 Page 00014
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 12 of 104
`
`US 9,703,468 B2
`
`
`
`O
`were
`w
`
`r
`O
`CO
`
`IPR2019-00614 Page 00015
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 13 of 104
`Sheet 13 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`FIG.6E
`FIG.6D
`
`
`
`IPR2019-00614 Page 00016
`
`IPR2019-00614 Page 00016
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 14 of 104
`
`US 9,703,468 B2
`
`s
`
`
`
`3
`
`c
`voir
`c
`
`IPR2019-00614 Page 00017
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 15 of 104
`Sheet 15 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`a
`<0
`
`S.
`
`:t
`T—
`
`3:
`‘0
`
`S2
`LL
`
`CD
`CD
`
`3
`
`(0
`0
`V"
`
`3
`
`
`
`ad'-
`O
`
`s
`
`
`LL
`
`(D
`
`m 9
`
`.
`
`IPR2019-00614 Page 00018
`
`IPR2019-00614 Page 00018
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 16 of 104
`Sheet 16 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`110
`
`FIG.6!
`
`VT
`wr
`CN
`D
`CO
`
`N(
`
`s
`104
`
`IPR2019-00614 Page 00019
`
`IPR2019-00614 Page 00019
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 17 of 104
`Sheet 17 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`&
`304
`
`
`
`CO
`CO
`0v-
`O
`led
`
`
`
`628
`
`IPR2019-00614 Page 00020
`
`IPR2019-00614 Page 00020
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`1021,1mJ
`
`Sheet 18 of 104
`
` gawcmw_m*NEa,«3852:68b352%@23me58b_t030030w_.m>som£.maov£>>””50mmusemmmags;_hlllll.wSmog“NU.>>w.0.>>m>wom£_sm:hIIIIIw9:2mega
`7N:CNN
`
`0K.“IIINIIIIMII
`
`
`
`
`
` imagemHm>wWhmeMm>szmw“AN$33035320HM_”.3mm.EEC_922%AN3332535
`
`_fi§§5_AWIIIIIIIIIIJ
`
`H”LIIIIJGR.GE_lllll.I
`
`3E35
`cosobw309:;
`m>Emcmw
`960mg“
`__55055__m>Em:mw_.conob_:aoEwmQ_.__
`
`
`
`#7941
`
`vwwooh
`
`JIcon
`
`US 9,703,468 B2
`2B0064.}307,9S
`
`Ullllll
`
`IPR2019-00614 Page 00021
`
`IPR2019-00614 Page 00021
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 19 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`omfi
`
`
`
`
`
`m3rIIIb.J.ER
`
` ___1----4L----rMH326chww_M__m2632,.328%:M_.826ch.MMm26353$239.5ANwvxmfiwmo$2523_«26252dwa*v2625,,m>Emcmw5038.Im>no<vN26.05;__I|IJ*mBows;__IIII_TIII.
`
`
`
`
`mk.mfll
`
`M
`
`MIIIIIIIIII
`
`NAmaw3035
`
`_mzmmcmwcoachImayo/é
`
`IPR2019-00614 Page 00022
`
`
`
`Jlwmn
`
`IPR2019-00614 Page 00022
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 20 of 104
`Sheet 20 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`
`
`vowANww>me5mztmcmw£030.:
`
`wt.
`
`
`
`m26352.,®>mo<
`
`wmh
`
`02.4.
`0t.
`
`w302.2,magv32255952
`
`Us.OE
`
`IPR2019-00614 Page 00023
`
`
`
`
`
`>m§m5mgmogEoo
`
`JIown
`
`IPR2019-00614 Page 00023
`
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 21 of 104
`Sheet 21 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Eg
`
`3k.
`
`0me
`
`
`
`M.own
`
`FE«Macaw
`
`QR.GE
`
`mggEE%ms
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`8&me
`
`wk.GE
`
`asgwe%E%E
`%%
`
`Z82
`Nwm
`
`98/
`wwn
`
`IPR2019-00614 Page 00024
`
`IPR2019-00614 Page 00024
`
`
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 22 of 104
`Sheet 22 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`omw
`
`wwm
`9 3,8
`
`Nww
`
`809
`wow
`
`#708
`
`262E, vow
`
`228:2:m>uo<
`
`5352Emma
`
`
`mafia:Samoaxofiw
`
`wcoficwEE
`5%:02
`
`wNw
`
`
`
`m..OE
`
`.ax
`
`vmw
`
`IPR2019-00614 Page 00025
`
`()009
`J.cow
`
`IPR2019-00614 Page 00025
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 23 of 104
`
`US 9,703,468 B2
`
`900 Q
`
`904
`
`908
`
`
`
`912
`
`
`
`916
`
`920
`
`Receive activation of a window
`
`Determine associated display
`
`Determine position in stack
`
`
`
`
`
`Generate logic structure
`
`
`
`924
`
`FIG. 9
`
`IPR2019-00614 Page 00026
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 24 of 104
`
`US 9,703,468 B2
`
`1 OOO 2
`
`1004
`
`1008
`
`Execute (Phone) application
`
`1012
`
`1016
`
`Create manifest
`
`1020
`
`
`
`Determine application display mode
`
`1024
`
`
`
`Set display binding
`
`1028
`
`
`
`Provide display binding to the application
`
`1032
`
`
`
`
`
`Determine
`if configuration change
`has OCCurred?
`
`1036
`
`
`
`
`
`Determine
`if an application mode/event
`has OCCurred?
`
`1040
`
`NO
`
`End
`
`FIG 10
`
`IPR2019-00614 Page 00027
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 25 of 104
`Sheet 25 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`21100
`
`Fig.11
`
`IPR2019-00614 Page 00028
`
`IPR2019-00614 Page 00028
`
`

`

`U.S. Patent
`U.S. Patent
`
`71021,1
`
`2
`
`9
`
`2BQ
`
`#0:“
`
`
`
`mNNrONNVmwmvormvmom?
`
`
`
`
`
`
`
`mEvmmm$va@8300$6250$3250
`
`
`
`mmEBmEEmummm@310
`
`(S)ndO
`
`d??nduOOg
`ESanO
`
`
`
`@92on58:059:
`
`m8N?
`
`7wovmw
`4.U~%Nh.m
`
`
`
` mVNrGUOOmewomEBm>wmmmrommwMmczmhmao/6_IIIIIIII.
`
`AmEEmoiv
`
`wEoEmE_22355004..mEQm>m%95:0;_mEmmmooi.cozmoEsEEoo_!!!!!!!!
`mmmr.
`
`IPR2019-00614 Page 00029
`
`IPR2019-00614 Page 00029
`
`
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 27 of 104
`Sheet 27 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`1300
`
`
`
`13081‘
`
`
`
`1304K
`
`ru/
`
`Fig.13
`
`IPR2019-00614 Page 00030
`
`IPR2019-00614 Page 00030
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 28 of 104
`Sheet 28 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`s
`1434
`
`
`
`s : S
`1430 1438
`1442
`
`s
`1400
`
`1304K
`
`Fig.14
`
`IPR2019-00614 Page 00031
`
`IPR2019-00614 Page 00031
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 29 of 104
`Sheet 29 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`:2“
`
`r S.
`
`2”
`
`S.
`3L0V.
`d
`va
`
`
`
`:
`1500
`
`1308K
`
`:/
`
`Fig.15
`
`IPR2019-00614 Page 00032
`
`IPR2019-00614 Page 00032
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 30 of 104
`
`US 9,703,468 B2
`
`1600
`
`1604
`
`1608
`
`1612
`
`1616
`
`1620
`
`Connect device and Computer system
`
`Generate unified desktop
`
`Determine Status indicators
`
`Provide status indicators together
`
`1624.
`
`FIG. 16
`
`IPR2019-00614 Page 00033
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 31 of 104
`
`US 9,703,468 B2
`
`1700
`
`1704
`
`1708
`
`1712
`
`1716
`
`1720
`
`Receive selection of status indicator
`
`Provide information/user interface device
`
`Receive selection of user interface device
`
`Provide menu for status indicator
`
`1724
`
`FIG. 17
`
`IPR2019-00614 Page 00034
`
`

`

`U.S. Patent
`U S. Patent
`
`Jul. 11, 2017
`
`Sheet 32 of 104
`
`US 9,703.468 B2
`US 9,703 468 B2
`
`
`
`
`
`mueafix.32£an3?:
`
`$33uvafis5:6
`
`Mmmmm
`
`.3.
`
`mm«mfivmaw:
`
`
`
`3uni?5335
`
`33
`
`.fla
`
`vow;
`
`
`
`comevome
`
`.w
`
`033ng
`
`Kw.
`we..mzuémmé3.329k.“.3,;
`
`
`m.a«E»,,33
`
`
`whym.»...,mammuya‘
`
`
`mowF
`808 ||
`
`2.5
`ºp ‘61-1
`
`N33
`
`IPR2019-00614 Page 00035
`
`
`
`
`
`ice,m?»mammuahm....$263,.
`
`IPR2019-00614 Page 00035
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 33 of 104
`
`US 9,703,468 B2
`
`1900
`
`
`
`1904
`
`1908
`
`192
`
`:: Opera 5 killini (a hora e Beta}
`para Ceilijares pro rete. http:/f
`bit.yffi A. Curies: saia
`
`hate coincidence, http://bit,
`iy, SN.8xik BA BARACUS, likes
`38 islikes
`
`1808
`
`Every tire i tikirk right at
`
`388.
`
`196
`
`920
`
`1924
`
`1928
`
`Fig. 19
`
`IPR2019-00614 Page 00036
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 34 of 104
`
`US 9,703,468 B2
`
`2000
`
`2004
`
`2008
`
`2012
`
`2016
`
`Connect device and Computer system
`
`Generate unified desktop
`
`Execute device application
`
`2020
`
`Display application interface in freeform window
`
`2024
`
`End
`
`FIG. 20
`
`IPR2019-00614 Page 00037
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 35 of 104
`
`US 9,703,468 B2
`
`2104
`
`to
`
`21 O8
`
`Receive selection of device application
`
`Determine device application features and/or controls
`
`Provide a freeform window for display of device application
`
`Provide user interface device(s) in the freeform
`window to enable features and/or Controls
`
`2112
`
`2116
`
`2120
`
`2124
`
`End
`
`FIG 21
`
`IPR2019-00614 Page 00038
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 36 of 104
`Sheet 36 of 104
`
`US 9,703.468 B2
`US 9,703,468 B2
`
`22200 K
`ru/
`:
`1304
`
`&
`2208
`
`
`
`Fig.22
`
`2216
`
`
`
`
`
`Nr.
`N
`wa
`CN
`CN
`
`NN
`
`
`
`s
`2204
`
`1304
`
`IPR2019-00614 Page 00039
`
`IPR2019-00614 Page 00039
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 37 of 104
`
`US 9,703,468 B2
`
`
`
`s
`
`ru/
`
`N
`vice
`ca
`CN
`
`IPR2019-00614 Page 00040
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 38 of 104
`
`US 9,703,468 B2
`
`
`
`ru/ru/
`
`Ns
`
`
`
`sru/
`
`sru/
`
`IPR2019-00614 Page 00041
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11,2017
`
`Sheet 39 of 104
`
`US 9,703.468 B2
`US 9,703,468 B2
`
`
`
`<1»
`8
`v'
`r\/
`
`CD
`
`8
`N
`
`q
`N
`a
`
`(0‘._.
`LON
`
`to
`N
`-
`i?
`
`8
`Lo
`
`N
`
`
`
`ooNN
`
`1304K N\--
`2504K
`
`NN
`
`
`
`IPR2019-00614 Page 00042
`
`IPR2019-00614 Page 00042
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 40 of 104
`Sheet 40 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`Ns
`2-2200
`
`
`
`
`
`ru/ru/
`2608K1304K
`
`Fig.26
`
`i
`2616
`
`1304K Nv
`
`
`IPR2019-00614 Page 00043
`
`NN
`
`2-2604
`^,
`
`s
`2620
`
`ru/
`
`IPR2019-00614 Page 00043
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 41 of 104
`Sheet 41 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`Ns
`
`A;2200
`
`
`
`sru/ru/
`2708K1304K 2716
`
`s
`Fig.27
`
`-N,s
`;2704
`
`s
`
`ru/
`
`2720 NT.
`
`IPR2019-00614 Page 00044
`
`CN
`re
`N
`N
`
`NN
`
`IPR2019-00614 Page 00044
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 42 of 104
`
`US 9,703,468 B2
`
`00ZZ
`
`
`
`
`
`gz '61-I
`
`93.82
`
`
`
`Z ?ZZ
`
`IPR2019-00614 Page 00045
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 43 of 104
`Sheet 43 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`
`
`
`
`01Emnoommma@2081.5me955me
`
`505E=8;o__<5:5Emon9:25
`
`@25095Ommxm>>
`
`
`
`momtBEwoSoQLooo_>on_coxooED
`
`oothE@250new
`
`onm_mm>wmSQE>c<
`
`
`
`
`
`Ucmx025LoxooE:momtBEoo_>mn_
`
`momtmE.
`
`
`
`__mom>_momm
`
`3.mt
`
`IPR2019-00614 Page 00046
`
`IPR2019-00614 Page 00046
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 44 of 104
`
`US 9,703,468 B2
`
`3004
`
`3008
`
`3012
`
`3016
`
`
`
`3020
`
`
`
`
`
`
`
`3028
`
`3032
`
`3000
`
`System sleeps
`
`Receive event
`
`Determine state
`
`
`
`
`
`inform user
`of incorrect
`input
`
`Determine
`whether correct input
`received?
`
`
`
`
`
`Wake system
`
`FIG. 30
`
`IPR2019-00614 Page 00047
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 45 of 104
`Sheet 45 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`t
`/3100
`
`
`
`
`
`ru/
`
`1308R
`
`3112
`
`3108
`
`23104
`
`1304K
`
`ru/
`
`Fig.31
`
`IPR2019-00614 Page 00048
`
`IPR2019-00614 Page 00048
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 46 of 104
`Sheet 46 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`s
`3200
`
`3208
`
`&
`
`s
`3204
`
`s
`3212
`
`Fig.32
`
`IPR2019-00614 Page 00049
`
`IPR2019-00614 Page 00049
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11,2017
`Jul. 11, 2017
`
`Sheet 47 of 104
`Sheet 47 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`3304
`
`809 j.
`
`2‘3300
`
`
`
`3112
`
`3204
`
`1304K
`
`Fig.33
`£8 "bl-i
`
`3108
`
`80 || 9
`
`IPR2019-00614 Page 00050
`
`IPR2019-00614 Page 00050
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 48 of 104
`
`US 9,703,468 B2
`
`3400
`
`3404
`
`3408
`
`3412
`
`3416
`
`3420
`
`Provide a device and
`Computer system
`
`Present computer
`system desktop
`
`
`
`Determine if
`applications were visible
`On device?
`
`NO
`
`3428
`
`Move applications from device to
`Computer system display
`
`
`
`PrOVide
`desktop on
`device also
`
`End
`
`34.32
`
`FIG. 34
`
`IPR2019-00614 Page 00051
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 49 of 104
`Sheet 49 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`3500
`
`3504
`
`3508
`
`Fig.35
`
`1304K
`
`s
`
`IPR2019-00614 Page 00052
`
`IPR2019-00614 Page 00052
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 50 of 104
`Sheet 50 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`‘2-3600
`
`
`N
`
`
`
`
`
`1308K 3504
`
`:ru/
`
`3604
`
`Fig.36 ”5304K
`
`/
`
`IPR2019-00614 Page 00053
`
`IPR2019-00614 Page 00053
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 51 of 104
`
`US 9,703,468 B2
`
`3700
`
`3704
`
`
`
`3708
`
`3712
`
`
`
`Undock device
`
`Hide computer
`system desktop
`
`3716
`
`Determine if
`applications were visible
`On device?
`
`
`
`Provide
`desktop on
`device also
`
`372O
`
`Maintain applications from device
`on device display
`
`
`
`3728
`
`FIG. 37
`
`IPR2019-00614 Page 00054
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 52 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`:32;96
`
`9200ch
`
`
`
`mcgmeagmUgmamfi
`
`
`
`vmbmawfiEmEQ
`
`80:8:an398320
`
`
`mcEca2923i
`
`
`
`
`
`vowm QonmmU>336
`m:o:mo__ga<
`
`
`
`
`
`UQEQEU9m.mcosmoiam
`
`mm.95
`88 ’61-I
`
`
`
`m>oEm_£m_>
`
`@0300
`
`
`
`£893ESQEooQ.
`
`newwco:mo__qa<2::
`
`.65an0
`
`EBQAm
`
`vmwm
`
`wNwm
`
`wam
`
`IPR2019-00614 Page 00055
`
`IPR2019-00614 Page 00055
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 53 of 104
`Sheet 53 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`0069^
`comm\\
`
`o>Emcmm50:0...
`
`
`m>Emcmm50:8.
`
`N3&5
`
`F@329
`
`
`
`am.mt
`68 "61-I
`
`
`
`
`
`$250899655an0
`
`IPR2019-00614 Page 00056
`
`IPR2019-00614 Page 00056
`
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11,2017
`2017
`Jul. 11
`
`Sheet 54 of 104
`Sheet 54 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`NY"
`T“
`(*3
`
`
`
`ru/
`[\/
`
`00
`')v"
`
`o0
`
`00
`o
`V“
`(""3
`
`
`
`‘-
`N
`C)
`
`oo\
`
`"
`
`«3
`
`\
`
`94.037
`$90
`v
`
`a
`V"
`.
`
`Op ‘61-I
`E
`
`o(
`
`\1
`1“
`
`0<
`
`a
`o
`Q-
`
`(I)
`
`oov
`
`IPR2019-00614 Page 00057
`
`<1.
`
`0ov
`
`<1-
`
`00
`
`’)‘—
`
`N 3o
`
`'C
`.9.
`
`F
`
`E0
`
`g
`
`E
`
`IPR2019-00614 Page 00057
`
`

`

`U.S. Patent
`U.S. Patent
`
`1mJ
`
`M
`
`5
`
`M1
`
`US 9,703,468 B2
`2B0064.}3079,SU
`
`1,we;
`
`
`
`(…
`Mg;
`
`
`
`
`
`7w269:;Em¥w>w53950
`
`Ma5H
`
`
`
`w9EV%N30v£>>E29653980
`
`we;
`
`5».5
`
`IPR2019-00614 Page 00058
`
`IPR2019-00614 Page 00058
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`1mJ
`
`US 9,703,468 B2
`0064.}3079,SU
`
`2R"
`
`7.IIIImmm;W”MNmrv
`
`M_AN>3qu_m.0>Emcmm.AN@320
`.m.v2,852,.Snobm_o>zom£_m26inS..@289:
`6_cozob_m>Ewcom
`_’’’’J._.._lI.InI.InJ
`
`m3.GE
`
`ON;
`
`or;
`
`Mg;
`
`9:2
`
`20:05N3852,
`
`m>Emcmm
`
`a5&5
`
`962
`
`88:V2,852,
`
`m>Emcmw
`
`:E35
`
`9:85_
`
`50305_o>>onE>>m26in_m>zom£
`
`m>Emcmm_50:05
`
`:bflawa_m>Ewcmw
`
`
`_tttttII.—
`:Emama
`
`VNEV
`
`_IIII
`
`mm;
`
`
`
`IPR2019-00614 Page 00059
`
`IPR2019-00614 Page 00059
`
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 57 Of 104
`Sheet 57 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`worm.
`
`EV5E
`Z?y (61-)
`
`
`IPR2019-00614 Page 00060
`
`IPR2019-00614 Page 00060
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11,2017
`Jul. 11, 2017
`
`Sheet 58 of 104
`Sheet 58 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`Fig.43A
`
`IPR2019-00614 Page 00061
`
`5<
`
`3o
`
`'o
`
`
`
`ActiveWindow2
`
`E E<
`
`1)
`.2
`
`4116
`
`4120
`
`4304
`
`
`
`4300K
`
`IPR2019-00614 Page 00061
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 59 of 104
`Sheet 59 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`mm;
`
`
`
`IIIIITIMIIIIMImNIS
`
`LVN;
`
`Mwomv
`
`
`
` .‘‘‘‘‘J_!!!!!J_.FIIIIJ_!!!!!‘J_.a$320..L3333333333J.:5&5__m>Emcmm.AN>335_.3>m_qw5_o>Emcmw_.cozob_m>Emcmw_m.m>Ewcmm.5020.:__352E,.68:_aw3,9ng.Ego:_©3852,_.grows_m26in_m>EmcmwcoaoF--m>zo<v.m>>o_oE>>.grows.__.m>zom£_onwma.@369:_“.NJ_mm;RV..
`
`vaGE
`
`IPR2019-00614 Page 00062
`
`IPR2019-00614 Page 00062
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 60 of 104
`Sheet 60 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`Fig.44
`
`IPR2019-00614 Page 00063
`
`IPR2019-00614 Page 00063
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 61 of 104
`Sheet 61 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`
`
`Fig.45A
`
`IPR2019-00614 Page 00064
`
`(\l
`CN
`s
`3o
`O
`"O
`O
`s
`)
`C
`.2
`2
`as
`‘63
`CC
`
`<
`
`E ia
`
`s
`4120
`
`4304
`
`ru/
`4500K
`
`IPR2019-00614 Page 00064
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11, 2017
`
`Sheet 62 of 104
`Sheet 62 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`AN>335"m>Emcmm.comet.350.05;.grows..
`I_IIIIII.
`
`or;
`
`.
`
`0.“le
`iz | +
`mmSNIII.E?w.
`
`AN3qu2«>22me_3Emma:5&5
`
`cozob5030.5*m>Emcmwm>EmcmmmBocE>>*coach
`
`m>zom£HI026$r>>OUE>>
`*LIIIIIIIIII
`
`Q0280m>zo<
`J_3>335
`.gnome._
`
`
` __.Cbmamé_m>_:mcmw_.m>Emcmm_£030.:_.2030.:5269:;_$2635;_$262.___
`.IIJIIIIIIMIWNS
`
`VNEV
`
`Vvomv
`
`J
`
`mnv.GI
`
`IPR2019-00614 Page 00065
`
`IPR2019-00614 Page 00065
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 63 of 104
`Sheet 63 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`Fig.46
`
`IPR2019-00614 Page 00066
`
`IPR2019-00614 Page 00066
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`Jul. 11,2017
`
`Sheet 64 of 104
`Sheet 64 of 104
`
`US 9,703,468 B2
`US 9,703,468 B2
`
`
`
`Fig.47A
`
`Desktop
`
`4110
`
`IPR2019-00614 Page 00067
`
`IPR2019-00614 Page 00067
`
`

`

`U.S. Patent
`U.S. Patent
`
`Jul. 11, 2017
`1mJ
`
`Sheet 65 of 104
`
`U
`
`US 9,703,468 B2
`2B864,30799
`
`1.$3$3$3
`7IIImom;IIIIIIIII.MI...mm;
`2VNEV
`
`.J.n.J28$:58chm@26chuI"IIommIIONIVIAI.NIJE00>:o<MIgosobJm>>oJch>>J930ch_sIIIIJ@25chJm>£wcmmJ2030.:J92,20ch_m_Jgrows.JmJsoJocJ>>Jcoachm>£wcmmJAm>mJQmJDJJ:>mJQmJQJm>JJJmcmw_5_N>>oJoE>>JcosotJm>JJJmcmwJAm>mJamJnJ3>235Jm>JJJmcmmJ5030.:_M_$26chJvBows;JcosobJm>JJJmcmw _'''''.J_JLIIIIJJlllllJ_ANJEJQmJQJJ.J.||||JJ|||||J_M_m>EmcmmJAm>335JJ...|||||||||JJS3:50_m_cosob
`
`
`
`
`
`
`
`
`
`
`
`SMkvAXE
`
`IPR2019-00614 Page 00068
`
`Mvomv
`
`IPR2019-00614 Page 00068
`
`

`

`U.S. Patent
`
`Jul. 11, 2017
`
`Sheet 66 of 104
`
`US 9,703,468 B2
`
`4804
`
`4808
`
`4812
`
`4816
`
`
`
`Hide application windows
`on Computer system
`
`4800
`
`Provide desktop on
`computer system display
`
`
`
`Determine
`active windows in Window
`Stack?
`
`NO
`
`4.820
`
`4824
`
`4,828
`
`4832
`
`4836
`
`Create windows on
`Computer system display
`
`Move active Windows to
`Created Windows
`
`
`
`
`
`Provide desktop on
`device displays
`
`Modify wido