Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 1 of 24 PageID #: 907
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 1 of 24 PagelD #: 907
`
`EXHIBIT 6
`EXHIBIT 6
`
`

`

`USOO8296.684B2
`
`(12) United States Patent
`Duarte et al.
`
`(10) Patent No.:
`(45) Date of Patent:
`
`US 8,296,684 B2
`Oct. 23, 2012
`
`(54) NAVIGATING AMONG ACTIVITIES INA
`COMPUTING DEVICE
`(75) Inventors: Matias Gonzalo Duarte, Sunnyvale, CA
`(US); Daniel Marc Gatan Shiplacoff,
`Los Angeles, CA (US); Jeremy Godfrey
`Lyon, Sunnyvale, CA (US); Paul
`Mercer, Palo Alto, CA (US); Ralph
`Thomas, Palo Alto, CA (US)
`
`(73) Assignee: Hewlett-Packard Development
`Company, L.P., Houston, TX (US)
`
`(*) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 1120 days.
`(21) Appl. No.: 12/126,145
`
`(22) Filed:
`
`May 23, 2008
`
`(65)
`
`Prior Publication Data
`US 2009/O293OO7 A1
`Nov. 26, 2009
`
`2006.O1
`(51) a'sM48
`(
`.01)
`(52) U.S. Cl. ........ grgrrr. 715/863; 715/864
`(58) Field of Classification Search .................. 715/767,
`715/792, 802, 803, 804-805, 797 798, 702,
`715/863, 853–855, 864, 817, 821, 818–820,
`715/822823,712,749, 781-784
`See application file for complete search history.
`Ref
`Cited
`eerees e
`
`(56)
`
`U.S. PATENT DOCUMENTS
`5,574,846 A 11/1996 Yoshimura et al.
`5,677,708 A 10/1997 Matthews, III et al.
`6,011,537 A *
`1/2000 Slotznick ...................... 71.5/733
`6,061,050 A
`5/2000 Allport et al.
`6,407,757 B1
`6, 2002 Ho
`6,441,811 B1
`8/2002 Sawada et al.
`
`9/2003 Miller
`6,613,100 B2
`T/2004 Hayakawa
`6,765,559 B2
`5/2006 Sciammarella et al.
`7,051.291 B2
`ck
`38. pillaietal. ............. 71.5/720
`7:303 E:
`7/2008 Wong et al.
`7.394.452 B2
`1/2009 JobS et al.
`7,479,949 B2
`1/2010 Allen et al.
`7,650,569 B1
`P98. S. 5/2010 Chaudhri
`8,001,479 B2
`8, 2011 Katsuranis et al. ........... 715,763
`(Continued)
`
`AU
`
`FOREIGN PATENT DOCUMENTS
`2008100003 A4
`2, 2008
`(Continued)
`
`OTHER PUBLICATIONS
`Non-Final Office Action issued on Oct. 3, 2011, in related U.S. Appl.
`No. 12/416.279, filed Apr. 1, 2009.
`(Continued)
`
`Primary Examiner — Steven Sax
`
`ABSTRACT
`(57)
`A computing device runs multiple activities concurrently and
`provides at least two modes for interacting with the activities.
`The user may toggle between the modes aS desired. In a
`full-screen mode, one activity occupies substantially an entire
`display screen. In a windowed mode, the activity is visible
`within a window, and a portion of at least one other window is
`also visible. In the windowed mode, the user can cause win
`dows to move, thereby changing focus from one activity to
`another. For example, the window having focus can be moved
`off the screen, to be replaced by a new window that is then
`given focus. The windows are ordered in a sequence and
`move in concert with one another, pushing one window off
`one edge of the screen causes a new window to appear at the
`opposite edge. A persistent positional relationship can be
`established among windows.
`20 Claims, 14 Drawing Sheets
`
`
`
`50ts
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 2 of 24 PageID #: 908
`
`30A
`
`greer
`
`Upots: HTemesting Hub
`
`301C
`
`too
`
`

`

`US 8,296,684 B2
`Page 2
`
`U.S. PATENT DOCUMENTS
`2002/0089536 A1* 7/2002 Dang ............................ 345,749
`2002/0109735 A1* 8/2002 Chang et al.
`345,853
`2002fO191013 A1* 12, 2002 Abrams ......
`345,730
`2005/002 1336 A1
`1/2005 Katsuranis .................... 704/246
`2005, 0149879 A1
`7, 2005 JobS et al.
`2005. O190280 A1
`9, 2005 H
`tal.
`2006, OO 10395 A1
`1, 2006 Atto
`2006/0015878 A1
`1/2006 Ritter ............................ T19,310
`2006.0075348 A1* 4, 2006 Xu et al. ..
`715,730
`2006.0125962 A1* 6, 2006 Shelton et al.
`348,588
`2006/0181548 A1* 8/2006 Hafey et al. .
`345,619
`2006/0218504 A1* 9, 2006 Hiroi et al. .....
`715,781
`2006/0224989 A1 * 10, 2006 Pettiross et al. .............. 75779
`2007/0220440 A1
`9/2007 Song et al.
`2007/0226647 A1* 9, 2007 Louch ........................... 715,788
`2007.0245263 A1 10, 2007 Hale et al.
`2008.0034317 A1
`2/2008 Fard et al. ..................... 715,781
`2008. O100593 A1
`5, 2008 Skillman et al.
`2008/0148149 A1* 6/2008 Singh et al. ................... 71.5/7OO
`2008. O168401 A1
`7/2008 Boule et al.
`2008/0281689 A1 : 11, 2008 Blinnikka et al. .............. TO5/14
`2009/009031 A1
`1/2009 Krovitz et al. ................. 29
`2009/0070691 A1
`3f2009 Jain ............................... 715,760
`2009/0183120 A1* 7/2009 Ording et al. ................. 71.5/823
`2009,0193364 A1
`7/2009 Jarrett et al.
`2009/0199241 A1* 8/2009 Unger et al. .................... 725/41
`2010/0081475 A1 * 4/2010 Chiang et al. ................. 455,564
`2010, 0211872 A1
`8, 2010 Rolston et al.
`2010/0214278 A1* 8, 2010 Miura ........................... 345,212
`
`
`
`FOREIGN PATENT DOCUMENTS
`O 548 646 A1
`6, 1993
`EP
`WO WO-2008/030976 A2
`3, 2008
`
`OTHER PUBLICATIONS
`iPhone User's Guide, Chapter 5, pp. 58-59, Apple Safari Browser,
`Opening Multiple Webpages at Once.” (2007).
`Extended European Search Report, European Application No.
`09751303.0, Date: Apr. 2, 2012, pp. 1-6.
`Applicati N
`Extended E
`S
`h R.
`E
`Xtended European Search Report, European Application No.
`09751304.8, Date: Apr. 3, 2012, pp. 1-6.
`GB Examination Report, Application No. GB1021636.4. Date: Mar.
`20, 2012, pp. 1-3.
`International Search Report mailed Oct. 30, 2009, issued in interna
`tional application No. PCT/US2009/044389
`pp
`y.
`...
`.
`International Preliminary Reporton Patentability issued on Nov.30,
`2010, in international application No. PCT/US2009/044389.
`International Search Report mailed Oct. 30, 2009, issued in interna
`tional application No. PCT/US2009/044390.
`International Preliminary Report on Patentability issued on Nov. 23,
`2010, in international application No. PCT/US2009/044390.
`United Kingdom Examination Report dated Jan. 24, 2012, in United
`Kingdom application No. GB1021630.7.
`* cited by examiner
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 3 of 24 PageID #: 909
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 1 of 14
`
`US 8,296,684 B2
`
`
`
`Home = Cords
`
`104
`
`104
`
`104
`
`AIM Calculator Photos
`
`Maps
`
`O is
`2
`
`Music
`
`Memo
`
`Yohoo
`
`104
`
`104
`
`104
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 4 of 24 PageID #: 910
`
`1OO
`
`FIG. f.
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 2 of 14
`
`US 8,296,684 B2
`
`
`
`Colendor
`
`Friday, April 20, 2007
`
`8 AM
`9 AM Updated: Weekly Developer Brown Bag
`10 AM (SV3.1.569 Operation (16)
`11 AM
`Noon
`1 PM
`2 PM
`3 PM
`4 PM
`5 PM
`6 PM
`
`Updated: HI Team Meeting (HI Lab
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 5 of 24 PageID #: 911
`
`1OO
`
`FIG 2
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 3 of 14
`
`US 8,296,684 B2
`
`
`
`301A
`
`301B
`
`Home = Cords
`
`5:37 2S
`
`Friday, April 20, 2007
`
`8 AM
`9 AM Updated: Weekly Developer Brown Bog
`10 AM (SV3.1.569 Operation 6)
`11 AM
`Noon
`1 PM
`Updated: HI Team Meeting (HI Lab
`2PM
`3 PM
`4 PM
`5 PM
`6 PM
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 6 of 24 PageID #: 912
`
`FIG 3
`
`301C
`
`1OO
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 4 of 14
`
`US 8,296,684 B2
`
`
`
`301C
`
`Home = Cords
`
`5:37 2s Hill
`
`I
`
`Inbox
`ge Cheryl Cicho
`Re: Great portfoliol
`Soro Chung
`Re: Opportunities
`
`Today
`11:30 PM
`
`222 PM
`Yesterday
`6:55 AM
`
`Ted Molone
`I think that design will work
`Mosakozu Tsuchiyo 1:44 AM
`RE: FW FW FW Hot
`Older
`Nov 12
`geSienna Word
`FW. That thing we talked about 9:31 PM
`£Lillion Simmons
`Now 12
`You con do it
`6:45 AM
`
`4-LOM Fon Club
`
`Nov 11
`
`106
`
`106
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 7 of 24 PageID #: 913
`
`1OO
`
`FIG. 4
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 5 of 14
`
`US 8,296,684 B2
`
`
`
`Inbox
`S.Chery Cicho
`Re: Great portfoliol
`() Sara Chung
`Re; Opportunities
`
`Ted Molone
`I think that design will work
`$Mask" Tsuchiya
`RE: FW: FW FW Humor
`
`5:37 2. Hill
`Today
`11:30 PM
`
`2:22 PM
`Yesterday
`6:55 AM
`
`1:44 AM
`Older
`
`NOV 12
`SSienna Ward
`FW. That thing we talked about 9:51 PM
`a Lillian Simmons
`Nov 12
`You Con do it
`6:43 AM
`
`4-LOM FOn Club
`
`NOV 11
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 8 of 24 PageID #: 914
`
`1OO
`
`FIG. 6
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 6 of 14
`
`US 8,296,684 B2
`
`
`
`Colendor
`
`Friday, April 20, 2007
`
`8 AM
`9 AM Updated: Weekly Developer Brown Bag
`10 AM (SV3.1.569 Operation (16)
`11 AM
`Noon
`1 PM
`2 PM
`3 PM
`4 PM
`5 PM
`6 PM
`
`Updated: HI Team Meeting (HI Lab
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 9 of 24 PageID #: 915
`
`100
`
`FIG. 6A
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 7 of 14
`
`US 8,296,684 B2
`
`
`
`301A
`
`301B
`
`Home = Cords
`
`5:37 12S
`
`Friday, April 20, 2007
`
`Updated: Weekly Developer Brown Bog
`(SV3,1,569 Operation (16)
`
`Updated: HI Team Meeting (HI Lob
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 10 of 24 PageID #: 916
`
`1OO
`
`FIG. 6B
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 8 of 14
`
`US 8,296,684 B2
`
`
`
`301A
`
`Home = Cords
`
`5:37 12S
`
`5O1B
`
`8) 617-1234 (X
`
`Friday, April 20, 2007
`
`Updated: Weekly Developer Brown
`(SV3.1.569 Operation 6)
`
`Updated: HI Team Meeting (HI Lo
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 11 of 24 PageID #: 917
`
`1OO
`
`FIG. 6G
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 9 of 14
`
`US 8,296,684 B2
`
`
`
`301A
`
`Friday, April 2
`
`Updated: Weekly De
`(SV3.1.569 Operatio
`
`Updated: HI Team
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 12 of 24 PageID #: 918
`
`1OO
`
`FIG. 6D
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 10 of 14
`
`US 8,296,684 B2
`
`
`
`5O1A
`
`Home = COrds
`
`5:37 2S
`
`(408) 617-1234 (X
`
`4
`
`5
`
`301B
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 13 of 24 PageID #: 919
`
`100
`
`FIG. 6E
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 11 of 14
`
`US 8,296,684 B2
`
`
`
`5:37 as Hill
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 14 of 24 PageID #: 920
`
`1OO
`
`FIG. 6F
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 12 of 14
`
`US 8,296,684 B2
`
`
`
`
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 15 of 24 PageID #: 921
`
`s
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 13 of 14
`
`US 8,296,684 B2
`
`
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 16 of 24 PageID #: 922
`
`

`

`U.S. Patent
`
`Oct. 23, 2012
`
`Sheet 14 of 14
`
`US 8,296,684 B2
`
`
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 17 of 24 PageID #: 923
`
`

`

`1.
`NAVIGATING AMONG ACTIVITIES INA
`COMPUTING DEVICE
`
`US 8,296,684 B2
`
`CROSS-REFERENCE TO RELATED
`APPLICATION
`
`The present application is related to U.S. patent application
`Ser. No. 12/115,992, filed May 6, 2008, for “Extended Touch
`Sensitive Control Area for Electronic Device', the disclosure
`of which is incorporated herein.
`The present application is related to U.S. patent application
`Ser. No. 1 1/379,552, filed Apr. 20, 2006, for “Keypad and
`Sensor Combination to Provide Detection Region that Over
`lays Keys', the disclosure of which is incorporated herein.
`
`10
`
`15
`
`FIELD OF THE INVENTION
`
`In various embodiments, the present invention relates to
`application management in computing devices, and more
`particularly to systems and methods for navigating among
`activities such as applications in Such devices.
`
`DESCRIPTION OF THE RELATED ART
`
`Many currently available computing devices run operating
`systems that offer users the opportunity to run several appli
`cations at the same time, and even to perform several activi
`ties simultaneously, within a single application and/or among
`two or more applications. For example, a user may open an
`email application, a word processing application, an
`on-screen calculator, and a web browser, so that all of the
`applications are open concurrently. The user may open sev
`eral documents within the word processing application, and
`may open several e-mail messages. Such an arrangement
`allows the user to easily move from one task to another by
`keeping these various applications and activities open at the
`same time.
`Conventionally, such an operating paradigm is accom
`plished by the use of multiple overlapping windows within a
`graphical user interface. A desktop metaphor is often
`employed, wherein the user can move and resize windows on
`a display Screen by direct manipulation. Thus, each applica
`tion may have a window or several windows; at any given
`time, one window has focus (usually indicated as Such by
`being situated on top of the other windows). Other windows
`may be visible, invisible, or partially visible (for example if
`they are partially or completely obscured by other windows).
`A user can Switch from one task to another by causing a
`different window to have focus; this is commonly accom
`plished by clicking on a visible portion of the window being
`activated, or by clicking on a button or icon representing the
`window or application in a task bar, dock, or similar con
`struct. In some operating systems, pop-up menus and/or key
`board shortcuts may be available for Switching among appli
`cations or documents.
`Overlapping windows area highly effective mechanism for
`application management. They exploit the user's spatial
`memory by associating a particular area of the screen with a
`particular task being performed. A user may find it easier to
`return to a previously opened window when he or she remem
`bers that the window was placed at a particular location on the
`screen, as compared with a list or menu of open windows that
`does not provide a model of spatial placement and stability.
`One issue with conventional window-based mechanisms
`for application management is that a large screen size is
`usually needed. Users faced with limited Screen space must
`choose between, on the one hand, making windows Smaller
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 18 of 24 PageID #: 924
`
`2
`and thus reducing available workspace within each applica
`tion, and, on the otherhand, stacking windows atop each other
`so that only one window (or very few) is visible at a time.
`Reducing workspace can make it very difficult to use an
`application, particularly for applications such as word pro
`cessing, photo editing, drawing, and the like. Stacking win
`dows reduces the ease with which the user can switch from
`one application or document to another, as it is more difficult
`to see what is currently open and to find the appropriate
`window to be activated. When windows are stacked, users
`usually resort to navigation via taskbar, dock, menu, key
`board shortcut, or the like, thereby reducing the advantages of
`the overlapping window paradigm.
`Some systems, such as the Mac OS operating system
`offered by Apple, Inc. of Cupertino, Calif., offer a mechanism
`for navigating among open applications by temporarily mov
`ing and shrinking open windows, moving the windows apart
`from one another so that they do not overlap. The user can
`then activate one of the windows; the original window posi
`tions and sizes are then restored, with the activated window on
`top. This feature is effective in allowing users to quickly
`Switch among open applications and documents, but still
`requires a relatively large amount of Screen space so as to
`effectively show the temporarily shrunk windows when the
`user is to select among them.
`Mobile devices such as Smartphones, personal digital
`assistants, music players, handheld computers, and the like
`are becoming increasingly powerful. Many are now able to
`run several applications concurrently, and to perform Sophis
`ticated functions that rival traditional computing devices.
`However, most such devices have extremely small screens,
`when compared to laptop or desktop computers. Thus, the
`conventional window-based techniques for navigating
`among open applications and documents do not function very
`well on mobile devices. There is insufficient screen space to
`display multiple overlapping windows. In fact, many Such
`devices do not even have enough space to display a taskbar or
`dock. Rather, the entire screen is often devoted to a single
`application, document, message, task, or activity, so as to
`make the most effective use of the extremely limited amount
`of space available.
`What is needed is a system and method for application
`management that provides the advantages of multiple over
`lapping windows but is effective for a device having a small
`screen. What is further needed is a system and method that
`allows users to Switch easily among activities, including
`applications, documents, and tasks, in a device having limited
`screen space. What is further needed is a system and method
`that is scalable to different screen sizes, and that provides
`Solutions for all application and activity management, includ
`ing starting activities, ending activities, and Switching from
`one activity to another.
`
`SUMMARY OF THE INVENTION
`
`According to various embodiments of the present inven
`tion, a computing device runs two or more activities concur
`rently and provides at least two modes for interacting with the
`activities. The user may toggle between the modes as desired.
`A button or other control is provided for switching between
`full-screen mode and windowed mode.
`In one embodiment, in a full-screen mode, one activity
`occupies Substantially an entire display screen.
`In one embodiment, in a windowed mode, the activity is
`visible within a window, and a portion of at least one other
`window is also visible. Thus, the window that has focus is
`visible infull, while at least one other window is only partially
`
`

`

`3
`visible. The window occupied by the activity is referred to as
`having focus. In the windowed mode, the user can cause
`windows to move on the screen, so as to change focus from
`one activity to another. For example, the window having
`focus can be moved off the screen, to be replaced by a new
`window that is then given focus. In one aspect, the activities
`are ordered in a sequence and the windows appear in a cor
`responding sequence. In one aspect, the windows move in
`concert with one another, pushing one window off one edge
`of the screen causes a new window to appear at the opposite
`edge. A persistent positional relationship can be established
`among windows.
`In one embodiment, in response to a user command, the
`windows shift position on the screen, so that the window that
`currently has focus becomes only partially visible and one of
`the other windows becomes fully visible and has focus. The
`windows move in concert with each other, in response to user
`commands. Thus, for example, if the user indicates that the
`central window should move in a rightward direction, then the
`entire display shifts to the right, as follows:
`The central window (which has focus) moves to the right,
`So that it is only partially visible along the right hand side
`of the display.
`If any window was partially visible to the right of the
`window that has focus, it moves off the right edge of the
`Screen so that it is no longer visible.
`If any window was partially visible to the left of the win
`dow that has focus, it moves to the right so that it is now
`fully visible and has focus.
`In one embodiment, the user indicates such movement, for
`example, by direct manipulation of the displayed windows.
`This can be performed on a touch screen, for example, by
`dragging the central window to the left or to the right on the
`screen or by tapping on a window that is partially displayed.
`Alternatively, a trackball, touch-sensitive pad, or other input
`device can be provided for facilitating such direct manipula
`tion.
`In one embodiment, the window that currently has focus is
`always fully visible and displayed in a substantially central
`location on the screen with respect to partially displayed
`windows.
`In various embodiments, window motion can be con
`strained to a single axis, for example horizontal or vertical but
`45
`not both, so as to simplify the positional relationship among
`windows. Alternatively, two or more axes of movements can
`be made available.
`In one embodiment, once the user has moved the desired
`window to the central position so that it has focus, he or she
`can indicate that the display should return to full-screen
`mode, so that the activity having focus occupies Substantially
`the entire screen. Alternatively, the device can return to full
`screen mode automatically after a period of time elapses
`where no window movement takes place, or if the user starts
`to interact with the activity that has focus.
`Thus, the full-screen display mode may be used for inter
`acting with the activity, and the windowed mode may be used
`for switching from one activity to another. However, in one
`aspect the inventionallows full interaction with the activity in
`windowed mode as well.
`In one embodiment, a persistent positional relationship can
`be established among windows. The positional relationship
`can be a one-dimensional sequence or some more complex
`two-dimensional relationship. The positional relationship is
`persistent in the sense that it does not change unless the user
`indicates that it should be changed, or some other event takes
`
`25
`
`30
`
`35
`
`40
`
`50
`
`55
`
`60
`
`65
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 19 of 24 PageID #: 925
`
`US 8,296,684 B2
`
`10
`
`15
`
`4
`place that indicates a change is warranted (such as non-use of
`an application, or an application crashing or being dis
`missed).
`Additional features and advantages will become apparent
`in the description provided below.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`The accompanying drawings illustrate several embodi
`ments of the invention and, together with the description,
`serve to explain the principles of the invention. One skilled in
`the art will recognize that the particular embodiments illus
`trated in the drawings are merely exemplary, and are not
`intended to limit the scope of the present invention.
`FIG. 1 depicts a display screen showing a launcher for
`initiating an activity Such as an application.
`FIG. 2 depicts a display screen in full-screen mode,
`wherein an activity occupies Substantially the entire display
`screen, according to one embodiment of the present inven
`tion.
`FIG. 3 depicts the display screen in windowed mode,
`including a window having focus and two partially displayed
`windows, according to one embodiment of the present inven
`tion.
`FIG. 4 depicts the display screen in windowed mode after
`the user has moved the windows, according to one embodi
`ment of the present invention.
`FIG.5 depicts the display screen in full-screen mode after
`the user has designated a new activity as having focus, accord
`ing to one embodiment of the present invention.
`FIGS. 6A through 6F depict a sequence for switching from
`one activity to another according to one embodiment of the
`present invention.
`FIG. 7 is a conceptual depiction of a sequence Switching
`from one activity to another according to one embodiment of
`the present invention.
`FIGS. 8A and 8B depict a sequence for dismissing an
`activity according to one embodiment of the present inven
`tion.
`FIGS. 9A through 9D depict a sequence for rearranging
`activities according to one embodiment of the present inven
`tion.
`
`DETAILED DESCRIPTION OF THE
`EMBODIMENTS
`
`In the following description, reference is made herein to
`“activities”. In the context of the present invention, an “activ
`ity' is intended to include a software application, a task, a
`document, a page, and/or any other activity that can be per
`formed in connection with an electronic device. As described
`herein, the present invention provides techniques for starting
`and ending activities, and for Switching among activities.
`System Architecture
`In various embodiments, the present invention can be
`implemented on any electronic device. Such as a handheld
`computer, personal digital assistant (PDA), personal com
`puter, kiosk, cellular telephone, and the like. For example, the
`invention can be implemented as a feature of an application
`management paradigm for a Software application or operat
`ing system running on Such a device. Accordingly, the present
`invention can be implemented as part of a graphical user
`interface for controlling software on Such a device.
`In various embodiments, the invention is particularly well
`Suited to devices Such as Smartphones, handheld computers,
`and PDAs, which have limited screen space and which are
`capable of running several Software applications concur
`
`

`

`US 8,296,684 B2
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`45
`
`5
`rently. One skilled in the art will recognize, however, that the
`invention can be practiced in many other contexts, including
`any environment in which it is useful to Switch easily and
`Smoothly from one activity to another. Accordingly, the fol
`lowing description is intended to illustrate the invention by
`way of example, rather than to limit the scope of the claimed
`invention.
`Referring now to FIG. 1, there is shown an example of an
`example of a device 100 including a display screen 101 show
`ing a launcher including several icons 104 representing appli
`cations that can be opened by the user, according to one
`embodiment. A dock 105 is also shown, including additional
`icons 106 for launching commonly used applications and
`other functions. Dock 105 is not necessary for the present
`invention, but is shown for illustrative purposes only.
`In one embodiment, screen 101 is touch-sensitive, so that a
`user can activate an application or function by touching a
`displayed icon 104,106. In one embodiment, device 100 also
`includes a touch-sensitive gesture area 102 for entering ges
`ture-based commands, as described in the above-referenced
`related application. In another embodiment, screen 101 and/
`orgesture area 102 is sensitive to user motion in proximity to
`the Surface, so as to detect gestures and commands performed
`near the Surface but without necessarily contacting the Sur
`face.
`For illustrative purposes, device 100 as shown in FIG. 1 is
`a personal digital assistant or Smartphone. Such devices com
`monly have telephone, email, and text messaging capability,
`and may perform other functions including, for example,
`playing music and/or video, Surfing the web, running produc
`tivity applications, and the like. The present invention can be
`implemented, according to various embodiments, in any type
`of device having a touch-sensitive screen, and is not limited to
`devices having the listed functionality. In addition, the par
`ticular layout shown in FIG. 1 is merely exemplary and is not
`intended to be restrictive of the scope of the claimed inven
`tion.
`In various embodiments, touch-sensitive screen 101 and
`gesture area 102 can be implemented using any technology
`that is capable of detecting a location of contact and/or user
`motion proximate to the Surface. Alternatively, the present
`invention can be implemented with other user input mecha
`nisms, such as a keyboard, trackball, stylus, or the like. One
`skilled in the art will recognize that the techniques of the
`present invention are well Suited to direct manipulation, but
`that any input technique can be used. In one embodiment,
`gesture area 102 provides a touch-sensitive control area
`extending beyond the edges of touch-sensitive screen 101, as
`described in related application Ser. No. 12/115,992, filed
`May 6, 2008, for “Extended Touch-Sensitive Control Area for
`Electronic Device', the disclosure of which is incorporated
`herein.
`In one embodiment, device 101 as shown in FIG. 1 also has
`a physical button 103. In one embodiment, physical button
`103 can be used to toggle between full-screen mode and
`windowed mode, as described in more detail below. Physical
`button 103 is not needed for the present invention, and is
`shown for illustrative purposes only.
`As described herein, in one embodimentat least two modes
`are available for interacting with device 101: a full-screen
`mode in which an application or other activity occupies Sub
`stantially the entire display screen 101, and a windowed mode
`in which at least two windows are presented, at least one of
`which is only partially visible, with an application or other
`activity occupying each window. The full-screen mode is
`designed to devote a greater amount of Screen space to the
`active activity, while the windowed mode provides a mecha
`
`Case 2:23-cv-00083-RWS-RSP Document 76-7 Filed 07/12/24 Page 20 of 24 PageID #: 926
`
`50
`
`55
`
`60
`
`65
`
`6
`nism for navigating among activities and for rearranging,
`initiating, and terminating activities.
`Referring now to FIG. 2, there is shown display screen 101
`in full-screen mode according to one embodiment. In the
`example, a calendar application occupies Substantially the
`entire display screen 101; however, one skilled in the art will
`recognize that any activity can be presented in this manner. As
`shown in FIG. 2, even in full-screen mode, certain portions of
`display screen 101 may be reserved for a title bar, battery
`indicator, clock, signal strength indicator, and the like.
`Accordingly, the term “full-screen mode” as used herein is
`intended to refer to any arrangement wherein the primary
`focus of the screen 101 is a single activity, even if other,
`smaller areas of screen 101 are reserved for other functions.
`The user interacts with the active activity (such as the
`calendar application shown in FIG. 2) by conventional user
`interface methods, including manipulating on-screen ele
`ments, entering text, and the like. Such techniques are well
`known in the art.
`Referring now to FIG. 3, there is shown an example of
`display Screen 101 in windowed mode according to one
`embodiment. In one embodiment, the user can toggle
`between full-screen mode and windowed mode by pressing
`physical button 103. In another embodiment, the user can
`touch or double-tap an activity 301B in windowed mode to
`initiate a switch to full-screen mode. In yet another embodi
`ment, device 100 switches from windowed mode to full
`screen mode after some period of inactivity. Other mecha
`nisms can also be provided for toggling between the modes.
`As can be seen in FIG.3, in one embodiment in windowed
`mode, window 301B having focus is fully visible. Other
`windows 301A, 301C are only partially visible and do not
`have focus. Usually, window 301B having focus represents
`the same activity that was displayed in full-screen mode
`immediately before the switch to windowed mode. Any num
`ber of partially displayed windows 301A, 301C can be pre
`sented. In the example of FIG. 3, two such windows 301A,
`301C are shown, one on either side of window 301B having
`focus. Typically, in an arrangement where windows 301 are
`presented along a linear axis, one or two partially displayed
`window(s) 301 can be displayed adjacent to the window 301
`that has focus. Also, as shown in FIG.3, in one embodiment,
`partially displayed windows 301A, 301C are shown slightly
`smaller than window 301B having focus, so as to further
`emphasize the fact that window 301B has focus.
`In one embodiment, partially displayed windows 301A,
`301C provide a positional context for window 301B, and
`provide a mechanism for navigating to other activities. In one
`embodiment, the user can designate a window 301A, 301C to
`have focus by touching any area within the window; this
`causes the designated window 301 to move to the central
`portion of display screen 101, and causes other windows to
`move as well, so that the same positional sequence is main
`tained. In one embodiment, the user can designate a window
`301A, 301C to have focus by dragging any displayed window
`301 to cause the desired window 301 to move to the central
`portion of display screen 101; again, other windows 301
`move as well, so that the same positional sequence is main
`tained. In one embodiment, the user can move windows 301
`left and right by dragging a finger along gesture area 102. In
`one embodiment, Such a gesture can be performed even in
`full-screen mode, causing windows 301 to move left and right
`in the same manner as described above for windowed mode.
`As described in more detail below, in one embodiment,
`when the user drags a window 301 to the left or right within
`display screen 100, other windows 301 move in concert with
`the dragged window 301. Thus, for example, if the user drags
`
`

`

`US 8,296,684 B2
`
`10
`
`15
`
`25
`
`30
`
`35
`
`40
`
`7
`wi