as) United States
`a2) Patent Application Publication (0) Pub. No.: US 2010/0095240 Al
`(43) Pub. Date: Apr. 15, 2010
`
`Shiplacoffet al.
`
`US 20100095240A1
`
`(54) CARD METAPHORFORACTIVITIES IN A
`COMPUTING DEVICE
`
`(75)
`
`Inventors:
`
`Daniel Mare Gatan Shiplacoff,
`Los Angeles, CA (US); Matias
`Gonzalo Duarte, Sunnyvale, CA
`(US); Jeremy Godfrey Lyon,
`Sunnyvale, CA (US)
`
`Correspondence Address:
`RAUBVOGEL LAW OFFICE
`820 LAKEVIEW WAY
`REDWOODCITY, CA 94062 (US)
`
`(73) Assignee:
`
`PALM,INC., Sunnyvale, CA (US)
`
`(21) Appl. No.:
`
`12/416,279
`
`(22)
`
`Filed:
`
`Apr. 1, 2009
`
`Related U.S. Application Data
`
`(63) Continuation-in-part of application No. 12/126,145,
`filed on May 23, 2008.
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`GO6F 3/048
`GO6F 3/033
`
`(2006.01)
`(2006.01)
`
`(52) U.S. Ch wa 715/784: 715/792; 715/802: 345/157:
`715/863
`
`(57)
`
`ABSTRACT
`
`In various embodiments, a card metaphoris established, in
`which each activity can be represented within an area of the
`screen referred to as a card. In various embodiments, any of
`several display modesare available for viewing, interacting
`with, manipulating, initiating, and dismissing cards. A per-
`sistent positional relationship can be established among
`cards, represented by a one-dimensional sequence. Newly
`opened cards are generally placedat the end of the sequence,
`although a new card that bears a relationship to an already
`open card may, in some embodiments, be placed adjacent to
`the already open card. In various embodiments, cards may be
`grouped, with such groups being represented as stacks of
`cards or by other visually distinctive means.
`
`
`
`301G
`
`301H
`
`APPLE 1109
`
`APPLE 1109
`
`1
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 1 of 24
`
`US 2010/0095240 Al
`
`Home = Cards
`
`5:37 =>
`
`“G=)
`
`AIM
`
`Calculator Photos
`
`Maps
`
`100
`
`Ba
`
`Music
`
`Memo
`
`Yahoo
`
`104
`
`104
`
`104
`
`FIG.
`
`1
`
`2
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 2 of 24
`
`US 2010/0095240 Al
`
`Calendar
`
`5:37 &S
`
`Friday, April 20, 2007
`
`Updated: Weekly Developer Brown Bag
`(SV3.1.569 Operation [16])
`
`100
`
`Updated: HI Team Meeting
`
`(HI Lab
`
`FIG. 2
`
`3
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 3 of 24
`
`US 2010/0095240 Al
`
`J301B
`
`5:37 =>
`
`Friday, April 20, 2007
`
`Home = Cards
`
`100
`
`301A
`
`re
`
`301C
`
`FIG. 3
`
`4
`
`

`

`Patent Application Publication
`
`Apr. 15, 2010 Sheet 4 of 24
`
`US 2010/0095240 Al
`
`J01C
`
`Home = Cards
`
`5:37 & [Hull] @
`
`Inbox
`
`fiCheryl Cicha
`Re: Great portfolio!
`@ Sora Chung
`Re: Opportunities
`
`J01B
`
`Today
`
`11:30 PM
`
`2:22 PM
`Yesterday
`6:35 AM
`
`Nov 11
`
`Ted Malone
`I think that design wil work
`} Masakazu Tsuchiya=1:44 AM
`RE: FW FW FW: Humor
`Older
`
`Nov 12
`Sienna Ward
`FW: That thing we tolked about 9:31 PM
`
`galillian Simmons
`You can do it!
`
`Nov 12
`6:43 AM
`
`4—LOM Fan Club
`
`FIG. 4
`
`5
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 5 of 24
`
`US 2010/0095240 Al
`
`5:37 & Aull @
`
`100
`
`Inbox
`
`62)Cheryl Cicha
`Re: Great portfolio!
`
`eC Sara Chung
`
`Re: Opportunities
`
`Ted Malone
`I think that design will work
`
`6 Mosokazu Tsuchiya
`
`RE: FW: FW: FW: Humor
`
`Today
`
`11:30 PM
`
`2:22 PM
`
`Yesterday
`
`6:35 AM
`
`1:44 AM
`
`Older
`
`Nov 12
`6)Sienna Ward
`FW: That
`thing we talked about 9:31 PM
`
`62) Lillian Simmons
`You can do it!
`
`Nov 12
`6:45 AM
`
`4—LOM Fan Club
`
`Nov 11
`
`FIG. 5
`
`6
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 6 of 24
`
`US 2010/0095240 Al
`
`Calendar
`
`5:37 S&S
`
`Friday, April 20, 2007
`
`100
`
`Updated: Weekly Developer Brown Bag
`(Sv3.1.569 Operation [16])
`
`Updated: HI Team Meeting
`
`(HI Lab
`
`8 AM
`
`9 AM
`10 AM!
`11 AM
`
`Noon
`
`1 PM
`
`2 PM
`
`3 PM
`
`4 PM
`
`5 PM
`
`6 PM
`
`
`
`FIG. 6A
`
`7
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 7 of 24
`
`US 2010/0095240 Al
`
`J01B
`
`Home = Cards
`
`5:37 =>
`
`Friday, April 20, 2007
`
`100
`
`JOTA
`
`FIG. 6B
`
`8
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 8 of 24
`
`US 2010/0095240 Al
`
`JOIB
`
`Home = Cards
`
`5:37 =>
`
`B) 617-1234a
`
`3
`
`2 PM
`3 PM
`4 PM
`5 PM
`6 PM
`
`9 AM Updated: Weekly Developer Brown
`10 AM!
`(Sv3.1.569 Operation [16]
`11 AM
`Noon
`
`100
`
`FIG. 6C
`
`9
`
`

`

`Patent Application Publication
`
`Apr. 15, 2010 Sheet 9 of 24
`
`US 2010/0095240 Al
`
`5:37 &Full@
`Home = Cards
`
`4 PM
`
`(408) 617-1234.
`
`JOIA
`
`aie{s
`
`Friday, April 2)
`
`Updated: Weekly De
`(SV3.1.569 Operatio
`
`10 AM!
`11 AM
`
`1 PM Gedated: HI Team
`2 PM
`3PM
`
`|5S PM
`6 py|____
`
`100
`
`FIG. 6D
`
`10
`
`10
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 10 of 24
`
`US 2010/0095240 Al
`
`100
`
`JOTA
`
`Home = Cards
`
`FIG. GE
`
`11
`
`11
`
`

`

`5:37 Sf] @
`
`(408) 617-1234 @
`
`8
`
`Patent Application Publication
`
`Apr. 15,2010 Sheet 11 of 24
`
`US 2010/0095240 Al
`
`100
`
`FIG. 6F
`
`12
`
`12
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 12 of 24
`
`US 2010/0095240 Al
`
`
`
`FIG. 7
`
`13
`
`13
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 13 of 24
`
`US 2010/0095240 Al
`
`
`
`FIG. 8A
`
`FIG. 8B
`
`14
`
`14
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 14 of 24
`
`US 2010/0095240 Al
`
`301A
`
`301B
`
`301¢
`
`101
`
`FIG. 9A
`
`FIG. 9B
`
`
` 301D
`
`
`FIG. 9C
`
`FIG. 9D
`
`15
`
`15
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 15 of 24
`
`US 2010/0095240 Al
`
`
`| 7 |
`
`
`3010||301B ee 301G
`
`100
`
`i10
`
`FIG. 10A
`
`
`
`FIG. 10D
`
`101
`
`
`301
`
`FIG. 10E
`
`FIG. 10F
`
`FIG. 10G
`
`16
`
`16
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 16 of 24
`
`US 2010/0095240 Al
`
`
`
`
`
`
`
`
`
`
`
`107
`
`
`
`A 3
`
`01A ||501B
`
`A
`
`B
`
`A
`
`C
`
`107
`
`107
`
`FIG. 11A
`
`FIG. 11B
`
`FIG. 110
`
`301D||3O1E
`
`"FIG. 11D
`
`17
`
`17
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 17 of 24
`
`US 2010/0095240 Al
`
`
`301A||3018 }|301¢|| sop
`JOIE|| JOIF||3OIG
`
`
`ws vale ;
`
`E
`
`F
`
`G
`
`
`
`
`100
`
`A
`
`OIA
`
`FIG. 12A
`
`107
`
`107
`
`E
`
`F
`
`De Jo1E)|_JOIF
`
`G
`
`}|_301G
`
`FIG. 12B
`
`A
`B
`E
`F
`G
`
`301A||3018 3010'}| 301E}|3OIF}|3016D
`
`
`
`J01D
`a
`
`FIG. 12C
`
`SOIA}|3018}|301 }|501C_}\3010"}|3O1E}|3OIF}|3016
`
`A
`
`B
`
`D
`
`C
`
`E
`
`F
`
`G
`
`D
`
`
`
`FIG. 12D
`
`18
`
`18
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 18 of 24
`
`US 2010/0095240 Al
`
`A
`
`B
`
`C
`
`C’
`
`C"
`
`Cc"
`
`D
`
`F
`
`
`
`501C'|| 301D||3O1E301C"|| 301C"||
`JOIA }\S0IB)|
` 301¢
`
`
`
`
`
`100
`
`107
`
`FIG. 13A
`
`ai
`
`301C"
`
`B
`
`C
`
`D
`
`E
`
`A
`
`
`
`
`
`a4) 301C'
`
`
`
`
`100
`(07
`
`301A ||501B||\\3OIC||||301D)| JOE FIG. 13B
`
`
`
`FIG. 13D 100
`
`301E
`
`SOIC’)
`
`301p
`
`13018
`
`19
`
`19
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 19 of 24
`
`US 2010/0095240 Al
`
`SOE
`
` FIG. 13E
`J01B 301A
`100
`
`101
`
`100
`
`13018
`
`FIG. 13F
`
`FIG. 13G
`
`20
`
`20
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 20 of 24
`
`US 2010/0095240 Al
`
`FIG. 13H
`
`301E
`
`301F
`
`Parl LLson
`-
`3016
`
`
`
`
`FIG. 13/
`
`FIG. 13K
`
`FIG. 13J3
`
`21
`
`21
`
`

`

`Patent Application Publication
`
`Apr. 15, 2010 Sheet 21 of 24
`
`US 2010/0095240 Al
`
`1400
`Start
`
`
`
`
`1401
`Initiate grid mode
`
`a
`
`1402
`Determine numberof
`open cards
`
`
`
`
`1410
` 1404
`
`1403
`
`
`Scale cards to
`Determine appropriate
`Too manyto display
`
`minimum acceptable
`scaling factor to
`simultaneously?
`size
`maximize card size
`
`
`
`
`
`
`
`
`1409
`
`Scale cards according
`to scaling factor
`
`
`
`1407
`1405
` 1408
`
`Receive scroll
`
`
`Scroll cards
`Display all open cards
`ommand?
`
`
`
`
`
`
`
`
`1406
`
`Display subset of open
`cards at minimum
`acceptable size
`
`
`
`FIG. 14
`
`22
`
`22
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 22 of 24
`
`US 2010/0095240 Al
`
`1501
`Userlaunchesactivity
`
`
`
`1507
`
`1503
`1502
`
`
`1505
`Movecorresponding card
`Add card at rightmost
`Is card for activity already
`
`
`Auto-rearrange?
`to rightmostposition in
`open?
`position in sequence
`
`sequence
`
`1504
`Shift focus to new card
`
`1506
`Shift focus to card
`corresponding to launched
`activity
`
`FIG. 15
`
`23
`
`23
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 23 of 24
`
`US 2010/0095240 Al
`
`30i1c"
`
`1301B
`
`101
`
`FIG. 16A
`
`FIG. 16B
`
`
`
`
`
`
`
`
`
`FIG. 16C
`
`101
`
`FIG. 16D
`
`24
`
`24
`
`

`

`Patent Application Publication
`
`Apr. 15,2010 Sheet 24 of 24
`
`US 2010/0095240 Al
`
`104
`
`FIG. 17A
`
` FIG. 17B
`
`
`101
`
`25
`
`25
`
`

`

`US 2010/0095240 Al
`
`Apr. 15, 2010
`
`CARD METAPHORFOR ACTIVITIES IN A
`COMPUTING DEVICE
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] The present application claimspriority as a continu-
`ation-in-part of U.S. patent application Ser. No. 12/126,145,
`filed May 23, 2008, for “Navigating Among Activities in a
`Computing Device”, Atty. Docket No. PLM5729,the disclo-
`sure of which is incorporated herein by reference.
`[0002] The present application is related to U.S. patent
`application Ser. No. 12/115,992, filed May 6, 2008, for
`“Extended Touch-Sensitive Control Area for Electronic
`Device”, Atty Docket No. PLM5728,the disclosure of which
`is incorporated herein by reference.
`[0003] The present application is related to U.S. patent
`application Ser. No. 11/379,552, filed Apr. 20, 2006, for
`“Keypad and Sensor Combination to Provide Detection
`Region that Overlays Keys”, the disclosure of whichis incor-
`porated herein by reference.
`
`FIELD OF THE INVENTION
`
`invention
`the present
`In various embodiments,
`[0004]
`relates to application managementin computing devices, and
`moreparticularly to systems and methods for implementing a
`card metaphorfor activities such as software applications in
`such devices.
`
`DESCRIPTION OF THE RELATED ART
`
`[0005] Many currently available computing devices run
`operating systems that offer users the opportunity to run
`several applications at the same time, and even to perform
`several activities simultaneously, within a single application
`and/or among two or more applications. For example, a user
`may open an e-mail application, a word processing applica-
`tion, an on-screen calculator, and a web browser, so thatall of
`the applications are open concurrently. The user may open
`several documents within the word processing application,
`and may openseveral e-mail messages. Such an arrangement
`allows the user to move from onetask to another by keeping
`these various applications and activities open at the same
`time.
`
`with a particular task being performed. A user mayfind it
`easier to return to a previously opened window whenhe or she
`remembersthat the window wasplacedat a particular loca-
`tion on the screen, as compared with a list or menu of open
`windowsthat does not provide a modelof spatial placement
`and stability.
`[0008] One issue with conventional window-based mecha-
`nisms for application managementis that a large screensize is
`usually needed. Users faced with limited screen space must
`choose between, on the one hand, making windows smaller
`and thus reducing available workspace within each applica-
`tion, and, on the other hand, stacking windowsatop each other
`so that only one window(or very few) is visible at a time.
`Reducing workspace can make it very difficult to use an
`application, particularly for applications such as word pro-
`cessing, photo editing, drawing, and the like. Stacking win-
`dows reduces the ease with which the user can switch from
`one application or documentto another, as it is more difficult
`to see what is currently open and to find the appropriate
`window to be activated. When windowsare stacked, users
`usually resort to navigation via taskbar, quick-launch area,
`menu, keyboard shortcut, or the like, thereby reducing the
`advantages of the overlapping window paradigm.
`[0009]
`Somesystems, such as the Mac OSoperating sys-
`tem offered by Apple, Inc. ofCupertino, Calif., offer a mecha-
`nism for navigating among open applications by temporarily
`moving and shrinking open windows, moving the windows
`apart from one anotherso that they do not overlap. The user
`can then activate one of the windows; the original window
`positions and sizes are then restored, with the activated win-
`dow on top. This feature is effective in allowing users to
`quickly switch among open applications and documents, but
`still requires a relatively large amount of screen space soas to
`effectively show the temporarily shrunk windows when the
`useris to select among them.
`[0010] Mobile devices such as smartphones, personal digi-
`tal assistants, music players, handheld computers, andthelike
`are becoming increasingly powerful. Many are now able to
`run several applications concurrently, and to perform sophis-
`ticated functions that rival traditional computing devices.
`However, most such devices have extremely small screens,
`when compared to laptop or desktop computers. Thus, the
`conventional window-based techniques
`for navigating
`among open applications and documents do notfunction very
`well on mobile devices. There is insufficient screen space to
`display multiple overlapping windows. In fact, many such
`devices do not even have enough spaceto displaya task baror
`quick-launch area. Rather, the entire screen is often devoted
`to a single application, document, message,task, or activity,
`so as to make the most effective use of the extremely limited
`amountof space available.
`
`[0006] Conventionally, such an operating paradigm is
`accomplished by the use of multiple overlapping windows
`within a graphical user interface. A desk-top metaphor is
`often employed, wherein the user can moveandresize win-
`dowson a display screen by direct manipulation. Thus, each
`application may have a windowor several windows; at any
`given time, one windowhas focus (usually indicated as such
`by being situated on top of the other windows). Other win-
`dows may be visible,
`invisible, or partially visible (for
`exampleif they are partially or completely obscured by other
`[0011] Related U.S. patent application Ser. No. 12/126,
`windows). A user can switch from one task to another by
`145, filed May 23, 2008, for “Navigating Among Activities in
`causing a different window to have focus; this is commonly
`a Computing Device”, Atty. Docket No. PLM5729, the dis-
`accomplished by clicking on a visible portion of the window
`closure of which is incorporated herein, describes various
`being activated, or by clicking on a button oricon represent-
`embodiments for running two or moreactivities concurrently
`ing the windowor application ina task bar, quick-launch area,
`on a computing device, and provides at least two modes for
`or similar construct. In some operating systems, pop-up
`interacting with the activities. The user may toggle between
`menus and/or keyboard shortcuts may be available for
`switching among applications or documents.
`the modesas desired. A button or other control is provided for
`switching between full-screen mode and card mode.
`[0007] Overlapping windowsareahighly effective mecha-
`nism for application management. They exploit the user’s
`[0012]
`In various embodiments, a card metaphoris estab-
`spatial memory by associating a particular area of the screen
`lished, in which each activity can be represented within an
`
`SUMMARY
`
`26
`
`26
`
`

`

`US 2010/0095240 Al
`
`Apr. 15, 2010
`
`area of the screen. For purposes of the description herein,
`these areas of the screen are referred to as “cards”. Although
`in some wayscards resemble windowsas are knownin theart
`of desktop userinterfaces, in various embodiments cards can
`be manipulatedin particular waysthat are not generally avail-
`able to conventional window-basedgraphicaluser interfaces;
`such manipulations are described in more detail herein. One
`skilled in the art will recognize that the term “card” is used
`herein merely as a convenient term for referring to an area of
`the screen that contains informationrelated to or generated by
`an activity such as a software application.
`[0013]
`In various embodiments, any of several display
`modesare available for viewing, interacting with, manipulat-
`ing, initiating, and dismissing cards.
`[0014]
`In one embodiment,
`in a full-screen mode, one
`activity occupies substantially an entire display screen. The
`card thusfills substantially the entire display screen, although
`in some embodiments some areas of the screen may be
`reserved for status indicators, alerts, messages, and the like.
`[0015]
`In one embodiment, a second modeis available,
`referred to as “card mode”. In card mode, oneactivity is
`visible within a card, and a portion ofat least one other card
`is also visible. Thus, a card that has focus(i.e., that the useris
`interacting with)is visible in full, while at least one other card
`is only partially visible. In the card mode, the user can cause
`cards to move onthe screen, so as to change focus from one
`card to another. For example, the card having focus can be
`movedoffthe screen, to be replaced by a new cardthatis then
`given focus.
`In one aspect,
`the cards are ordered in a
`sequence. In one aspect, the cards move in concert with one
`another; pushing one card off one edge of the screen causes a
`newcard to appear at the opposite edge. A persistent posi-
`tional relationship can be established amongcards, based on
`the established sequence (althoughthe user can rearrange the
`sequence if desired).
`[0016]
`In one embodiment, a third mode is available,
`referred to as “shuffle mode”. In shuffle mode, two or more
`cards are shownin full. The size of the cards may be reduced
`so that more cards can be shown simultaneously.In addition,
`portions of one or more other cards may be visible. For
`example, in one embodiment, three cards can be shownin full
`in a horizontal row, with portions oftwo other cards shown to
`the left and right of the fully displayed cards. In one embodi-
`ment, shuffle modefacilitates easier reordering and manipu-
`lation of cards, and is associated with certain behaviors (de-
`scribed below)
`to optimize such operations.
`In one
`embodiment, shuffle mode resembles a zoomed out view of
`the cards presentedin card view. In one embodiment, the user
`can zoom out to various degrees, so that several different
`varieties of shuffle mode can be presented, for example with
`different numbersof cards on the screen. In one embodiment,
`when more cards are displayed,they are displayed at a smaller
`size. In one embodiment, cards are presented in a linear
`arrangement in shuffle mode, preserving the linear sequence
`used in card mode.
`
`In one embodiment, a fourth mode is available,
`[0017]
`referred to as “grid mode”. In grid mode, a larger numberof
`cards are shownin full. In one embodiment, cards are scaled
`downin size so thatall available cards are displayed simul-
`taneously. In another embodiment,all cards are displayed to
`a predetermined maximum numberof cards; if more than the
`predetermined maximum areavailable for display, scrolling
`
`is implementedto allow access to non-displayed cards. In one
`embodiment, cards are presentedin a grid arrangementin grid
`mode.
`
`In one embodiment, a user can manipulate cards in
`[0018]
`different ways depending on which modeis currently active.
`In one embodiment, different interactions are available in
`different modes, and/or certain user actions can be interpreted
`differently depending on which modeis currently active. The
`particularities of such differences are described below for
`various embodiments of the invention.
`
`In one embodiment, cards are active, regardless of
`[0019]
`the current display mode, so that the information represented
`in a card is substantially current and is updated substantially
`in real-time. In one embodiment, the user can interact with
`cards regardless of display mode, so that user interface ele-
`ments within cards are active regardless ofthe display mode.
`In another embodiment, in some display modes, someorall
`cards maynot beactive, so that the data showntherein can be
`“frozen” while in a particular mode; such an embodiment
`maybe useful, for example, when available system resources
`preclude real-time updating ofall cards without undesirably
`degrading system performance. Similarly, “frozen” cards
`may be temporarily inhibited from accepting user input in
`some embodiments.
`
`In one embodiment, a persistent positional relation-
`[0020]
`ship is established and maintained among cards. The posi-
`tional relationship can be a one-dimensional sequence or
`some more complex two-dimensional relationship. The posi-
`tional relationship is persistent in the sense that it does not
`change unless the user indicates that it should be changed,or
`some other event takes place that indicates a change is war-
`ranted (such as non-use of an application, or an application
`crashing or being dismissed).
`[0021]
`In one embodiment, cards are initially positioned
`according to the order in which the correspondingactivities
`(such as applications) were launched. New cards can be
`launched, for example, when a new application or activity is
`launched, or in some cases for an application that is already
`running (for example if a new message is being composedin
`an email application). Thus, in an embodiment where a one-
`dimensional sequence of cards is implemented, a newly-ac-
`tivated card would be placed at the end of the sequence; for
`example, if a horizontal row is used, the newly-activated card
`could be placed to the right of the right-most card in the
`sequence. A user can, of course, reposition cards as desired.
`[0022]
`Inone embodiment, if a user launchesa new activity
`(such as an application), a card (or more than onecard) for the
`activityis created, with a position at the end of the sequence.
`If the user attempts to launch an activity that is already run-
`ning, in one embodimentthe card is not moved within the
`sequence of cards, but the current view of the sequence is
`shifted so that the card for the activity is given focus and
`presented in a central location on the screen. Alternatively, in
`another embodiment,ifthe user attempts to launch an activity
`that is already running,the card for thatactivity is moved to
`the end of the sequence.
`in one embodiment, newly
`[0023] As described above,
`opened cards are initially positioned at
`the end of the
`sequence. In another embodiment, some newly opened cards
`may be placed at locations other than at the end of the
`sequence. For example, any new cardsfor an already-running
`activity are placed adjacent to previously existing card(s) for
`that application. These cards, referred to as “sibling cards”,
`are therefore positioned so that cards for a given activity are
`
`27
`
`27
`
`

`

`US 2010/0095240 Al
`
`Apr. 15, 2010
`
`located adjacent to one another in the overall card sequence.
`For example, a new card for an email application may appear
`when a user initiates a reply to an email message; the new
`sibling card for the reply can be positioned adjacent to the
`existing card for the original message.
`[0024]
`In one embodiment,the useris free to move sibling
`cards so that they are no longer adjacent to one another; in
`another embodiment, sibling cards cannot be separated from
`one another, although they can be moved as a group.
`[0025]
`In one embodiment, a visual paradigm can be
`employed to indicate groups of cards. For example, in one
`embodiment, card groups can be denoted by stacks; all cards
`within a particular group are displayed in a mannerthat
`resembles a stack of cards. Alternatively, card groups can be
`indicated in other ways that distinguish them from non-
`grouped cards: for example, card groups can be shownvia a
`distinctive color scheme, different sizes, different vertical or
`horizontal positioning, bracketing, highlighting, spacing, or
`any other mechanism.In various embodiments as described
`below, a user can interact with groups, separating their con-
`stituent cards as desired, creating newgroups, changing the
`order of groups, and the like. In one embodiment, where
`stacking is used to indicate groups, cards can be “unstacked”
`at times, even while preserving their group relationship,
`either automatically or manually to facilitate certain types of
`interactions and viewing of constituent cards. While cards are
`unstacked, in some embodiments, an alternative mechanism,
`such as bracketing or distinctive coloring, is used to remind
`the user that the cards are still members of a group.
`[0026] The various features described above and herein can
`be implemented singly or in any combination, as will be
`apparent to one skilled in the art. Additional features and
`advantages will become apparentin the description provided
`below.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`illustrate several
`[0027] The accompanying drawings
`embodiments of the invention and, together with the descrip-
`tion, serve to explain the principles of the invention. One
`skilled in the art will recognize that the particular embodi-
`ments illustrated in the drawings are merely exemplary, and
`are not intended to limit the scope of the present invention.
`[0028]
`FIG. 1 depicts a display screen showing a launcher
`for initiating an activity such as an application.
`[0029]
`FIG. 2 depicts the display screen in full-screen
`mode, wherein an activity occupies substantially the entire
`display screen, according to one embodimentof the present
`invention.
`
`FIG. 3 depicts the display screen in card mode,
`[0030]
`including a card having focus and twopartially displayed
`cards, according to one embodimentofthe present invention.
`[0031]
`FIG. 4 depicts the display screen in card modeafter
`the user has movedthe cards, according to one embodiment of
`the present invention.
`[0032] FIG.5 depicts the display screen in full-screen mode
`after the user has designated a new card as having focus,
`according to one embodimentofthe present invention.
`[0033]
`FIGS. 6A through 6F depict a sequence for switch-
`ing from one card to another according to one embodiment of
`the present invention.
`[0034]
`FIG. 7 is a conceptual depiction of a sequence for
`switching from one card to another according to one embodi-
`mentof the present invention.
`
`FIGS. 8A and 8B depict a sequence for dismissing a
`[0035]
`card according to one embodimentof the present invention.
`[0036]
`FIGS. 9A through 9D depict a sequence for rear-
`ranging cards according to one embodimentof the present
`invention.
`
`FIG. 10A depicts the display screen in card mode
`[0037]
`according to one embodimentofthe present invention.
`[0038]
`FIG. 10B depicts the display screen in shuffle mode
`according to one embodimentofthe present invention.
`[0039] FIG.10C depicts dismissal ofa card in shuffle mode
`according to one embodimentofthe present invention.
`[0040]
`FIG. 10D depicts reordering of a card in shuffle
`mode according to one embodimentof the present invention.
`[0041]
`FIGS. 10E, F, and G depict various examples of grid
`mode according to embodiments of the present invention.
`[0042]
`FIG. 11A depicts the display screen in full-screen
`mode wherein four cards are open, one of which has focus,
`according to one embodimentofthe present invention.
`[0043]
`FIG. 11B depicts introduction of a new card in full-
`screen mode, in responseto launch of a new activity, accord-
`ing to one embodimentof the present invention.
`[0044]
`FIG. 11C depicts rearranging of a card sequence in
`full-screen mode, in response to launch of an activity thatis
`already open, according to one embodiment of the present
`invention.
`
`FIG. 11D depicts a focus shift without card reorder-
`[0045]
`ing, in full-screen mode, in response to launch ofan activity
`that is already open, according to one embodiment of the
`present invention.
`[0046]
`FIG. 12A depicts the display screen in full-screen
`mode wherein seven cards are open, one of which has focus,
`according to one embodimentofthe present invention.
`[0047]
`FIG. 12B depicts introduction of a sibling card for
`an open activity in full-screen mode, according to one
`embodimentof the present invention.
`[0048]
`FIGS. 12C and 12D depict reordering of card to
`separate sibling cards in response to user input, according to
`one embodimentof the present invention.
`[0049]
`FIG. 13A depicts the display screen in full-screen
`mode wherein eight cards are open, one of which has focus,
`according to one embodimentofthe present invention.
`[0050]
`FIG. 13B depicts the display screen in card mode
`wherein eight cards are open, including four cards forming a
`group, according to one embodimentofthe present invention
`wherein the groupedcards are depicted in a stack.
`[0051]
`FIG. 13C depicts the display screen of FIG. 13B,
`wherein the cards forming the group have been reordered,
`according to one embodimentofthe present invention.
`[0052]
`FIG. 13D depicts the display screen in card mode
`wherein eight cards are open, including four cards forming a
`group, according to one embodimentofthe present invention
`wherein the grouped cards are depicted using a distinctive
`vertical offset and size.
`
`
`
`FIG. 13E depicts the display screen in shuffle mode
`[0053]
`wherein eight cards are open, including four cards forming a
`group, according to one embodimentofthe present invention
`wherein the grouped cards are depicted using a distinctive
`vertical offset.
`
`FIGS. 13F and 13G depict an example ofa transition
`[0054]
`from view in which one of the membersof a group has focus
`to a view in which the card having focusis not part ofa group,
`according to one embodimentofthe present invention.
`
`28
`
`28
`
`

`

`US 2010/0095240 Al
`
`Apr. 15, 2010
`
`FIGS. 13H through 13K depict an example ofcre-
`[0055]
`ation of a new card group and adding cards to the group,
`according to one embodiment.
`[0056]
`FIG. 14 is a flow diagram depicting a method for
`presenting cards in grid mode according to one embodiment.
`[0057]
`FIG. 15 is a flow diagram depicting a method for
`card rearrangementaccording to one embodiment.
`[0058]
`FIGS. 16A through 16D depict a sequence for add-
`ing a card to a group according to one embodimentof the
`present invention.
`[0059]
`FIGS. 17A through 17D depict a sequence for
`removing a card from a group according to one embodiment
`of the present invention.
`
`DETAILED DESCRIPTION OF THE
`EMBODIMENTS
`
`In the following description, reference is made
`[0060]
`herein to “activities”. In the context of the present invention,
`an “activity” is intended to include a software application, a
`task, a document, a page, and/or any otheractivity that can be
`performed in connection with an electronic device. As
`described herein, the present invention provides techniques
`for displaying and manipulating representationsofactivities
`on an electronic device, using a card metaphor. Thus, activi-
`ties are represented by “cards”, which is a term used herein to
`refer to areasofthe screen that can be moved and manipulated
`by the user. Users interact with cards to launch, terminate, and
`reorderactivities, as well as to navigate amongactivities and
`perform other operations, as described in more detail below.
`
`System Architecture
`
`In various embodiments, the present invention can
`[0061]
`be implemented on any electronic device, such as a handheld
`computer, personal digital assistant (PDA), personal com-
`puter, kiosk, cellular telephone,andthe like. For example, the
`invention can be implemented as a feature of an application
`management paradigm for a software application or operat-
`ing system running on sucha device. Accordingly,the present
`invention can be implemented as part of a graphical user
`interface for controlling software on such a device.
`[0062]
`In various embodiments, the invention is particu-
`larly well-suited to devices such as smartphones, handheld
`computers, and PDAs, which have limited screen space and
`which are capable of running several software applications
`concurrently. One skilled in the art will recognize, however,
`that the invention can be practiced in many other contexts,
`including any environment in which it is useful to switch
`easily and smoothly from one activity to another. Accord-
`ingly, the following description is intendedto illustrate the
`invention by way of example, rather than to limit the scope of
`the claimed invention.
`
`[0063] Referring now to FIG.1, there is shown an example
`of an example of a device 100 including a display screen 101
`showing a launcherincluding several icons 104 representing
`applications that can be openedbythe user, according to one
`embodiment. A quick-launch area 105 is also shown,includ-
`ing additional icons 106 for launching commonly usedappli-
`cations and other functions. Quick-launch area 105 is not
`necessary for the present invention, but is shownforillustra-
`tive purposesonly.
`[0064]
`In one embodiment, screen 101 is touch-sensitive,
`so that a user can activate an application or function by touch-
`ing a displayed icon 104, 106. In one embodiment, device 100
`
`also includes a touch-sensitive gesture area 102 for entering
`gesture-based commands, as described in the above-refer-
`enced related application. In another embodiment, screen 101
`and/or gesture area 102 is sensitive to user motion in proxim-
`ity to the surface, so as to detect gestures and commands
`performednearthe surface but without necessarily contacting
`the surface.
`
`For illustrative purposes, device 100 as shownin
`[0065]
`FIG. 1 is a personal digital assistant or smartphone. Such
`devices commonly havetelephone, email, and text messaging
`capability, and may perform other functions including, for
`example, playing music and/or video, surfing the web, run-
`ning productivity applications, and the like. The present
`invention can be implemented, according to various embodi-
`ments, in any type of device having a touch-sensitive screen,
`and is not limited to devices having thelisted functionality. In
`addition, the particular layout shown in FIG. 1 is merely
`exemplary andis not inten