as) United States
`a2) Patent Application Publication co) Pub. No.: US 2011/0167382 Al
`(43) Pub. Date: Jul. 7, 2011
`
`van Os
`
`US 20110167382A1
`
`(54)
`
`DEVICE, METHOD, AND GRAPHICAL USER
`INTERFACE FOR MANIPULATING
`SELECTABLE USER INTERFACE OBJECTS
`
`(76)
`
`Inventor:
`
`Marcel van Os, San Francisco, CA
`(US)
`
`(21)
`
`Appl. No.:
`
`12/788,280
`
`(22)
`
`Filed:
`
`May26, 2010
`
`Related U.S. Application Data
`
`(60)
`
`Provisional application No. 61/292,687, filed on Jan.
`6, 2010.
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`
`GO6F 3/048
`
`(2006.01)
`
`(52) US. Ch. oe ceeeseneteneees 715/800; 715/810
`
`(57)
`
`ABSTRACT
`
`A multifunction device displays a plurality of selectable user
`interface objects. Each respective selectable user interface
`object has a respective activation region. The device detects a
`first input; and, in response to detecting the first input, the
`device selects the first selectable user interface object and the
`device additionally: deactivates the activation region of the
`first selectable user interface object, or reduces the activation
`region ofthe first selectable user interface object to a smaller
`area than the default activation region. The device also
`enlarges an activation region of a selectable user interface
`object that is adjacent to the first selectable user interface
`object such that the enlarged activation region ofthe adjacent
`selectable user interface object occupiesat least a portion of
`an area previously occupied by the default activation region
`of the first selectable user interface object.
`
`
`
`
`
`
`November 2009
`
`(Nov)Deo[2070] @&
`
`
`
`
`4 [2008] 2009
`
`Jan
`
`Feb Mar Apr May
`
`Jun
`
`Jul Aug Sep Oct
`
`112
`
`NO Multifunction Device 300
`
`APPLE-1007
`
`1
`
`APPLE-1007
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 1 of 44
`
`US 2011/0167382 Al
`
`Memory
`102
`Opera
`
`Portable Multifunction Device
`100
`126 —
`———
`
`Applications (continued)
`
`128
`
`136
`148
`
`
`
`139|[widget Modules 149-1
`
`149.2
`
`to
`
`Dictionary Widget Contacts Module
`
`134
`I3e
` 137
`438
`38
`User-Created Widget(s)
`440
`Widget Creator Module
`144
`Search Module
`442
`:
`:
`143
`444 Device/Global Internal State
`145
`162
`146
`m
`
`Alarm Clock Widget
`
`Power
`System
`
`External
`Port
`
`124
`
`Telephone Module
`Video Conference Module
`E-mail Client Module
`Instant Messaging Module
`Workout Support Module
`Camera Module
`Image Management Module
`Video Player Module
`Music Player Module
`rowser Module
`
`104
`
`122
`
`120
`
`106
`
`156
`
`112
`
`103
`
`118
`
`103
`10
`yy 103
`5
`
`
`:
`
`Peripherals
`Interface
`
`103
`
`Controller[i
`
`
`403
`
`RFCircuitry
`108
`
`Kuidio —Circuitry
`110 =)
`
`Proximity
`Sensor
`
`Microphone
`113
`166
`
`
`
`Processor(s)
`Accelerometer(s)
`
`——*
`103
`188
`
`/O Subsystem
`
`
`
`
`Optical sensor(s)
`Display
`Other Input
`Controller
`Controller(s)
`Controller
`
`
`
`
`
`103
`103
`
`164
`
`Optical
`Sensor(s)
`
`Other Input
`Control Devices
`
`Touch-Sensitive
`Display System
`
`Figure 1A
`
`103
`
`Me
`ues
`449-5
`
`149-6
`450
`451
`
`457
`
`Speaker
`111
`
`160
`
`116
`
`2
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 2 of 44
`
`US 2011/0167382 Al
`
`Memory 102
`Operating System
`Communication Module
`Contact/Motion Module
`Graphics Module
`Text Input Module
`GPS Module
`
`Contacts Module
`Telephone Module
`Video Conference Module
`E-mail Client Module
`instant Messaging Module
`Workout Support Module
`Camera Module
`Image Management Module
`Video & Music Player Module
`Notes Module
`
`Map Module
`Browser Module
`
`Portable Multifunction Device 100
`
`126 Applications (continued)
`Calendar Module
`128
`Widget Modules
`a9
`
`
`
`Weaiher Widget(s)
`Stocks Widget
`te
`136
`Calculator Widget
`137
`Alarm Clock Widget
`
`
`138
`Dictionary Widget
`139
`440
`User-Created Widget(s)
`
`
`444
`Widget Creator Module
`442
`Search Module
`143
`Online Video Module
`
`
`:
`144
`.
`152 Device/GlobalInternal State
`153
`Power
`162
`154
`System
`
`4136
`448
`449
`449-1
`449-2
`440.3
`449-4
`449-5
`
`149-6
`450
`154
`155
`
`157
`
`147
`
`External
`Port
`
`124
`
`118
`103
`103
`/;-— Cy
`
`Controller
`Peripherals
`
`interface
`
`
`Processor(s)
`
` — Accelerometer(s)
`103
`168
`
`I/O Subsystem
`
`
`
`
`103
`
`
`Display
`Controller
`
`Optical sensor(s)
`Controller
`
`103
`
`103
`
`403
`
`
`
`104
`422
`
`120
`
`106
`
`156
`
`112
`
`Speaker
`
`4
`
`160
`
`116
`
`RFCircuitry
`108
`-—nGaIS ||
`Circuitry
`110 +)
`Microphone
`113
`166
`
`Sensor
`
`58
`
`1
`
`Other Input
`
`Controller(s) |
`Control Devices
`
`103
`
`103
`
`
`
`Touch-Sensitive
`Display System
`
`Optical
`Sensor(s)
`164
`
`Figure 1B
`
`103
`
`Other Input
`
`3
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 3 of 44
`
`US 2011/0167382 Al
`
`LALHUOWJUSAZ
`
`
`
`JO}UOPJUBA
`
`
`
`JOOSJUBAQ
`
`OL
`
`
`eyepejoy|ptBITJe1epdnIn
`
`AJ@Al|aqJUsARO61
`
`
`JaziUBooeYUSARO08}seziuBooeyjUSAg
`
`|yU@AZZZJeyepdryalqo
`
`
`
`
`ainpoyyJeyoyedsiqjUaAyquoneoddy
`
`ZLUONBUILU9}9qMIAYH
`
`S|NpoW
`
`
`
`
`
`SulJeziuBooey1UeAqsAOy
`
`
`
`SUONUegJUeAy
`
`
`
`Joyesedwogyusaq
`
`
`
`JAAIB09YJUSAZ
`
`bl
`
`
`
`gINPOWYUONeUILUIE]Eq
`
`
`
`L-9€)uonealddy
`
`Ber
`
`eet
`
`
`
`
`
`Jo|pueyyueAg
`
`OLaunbi4
`
`6Laye1S
`
`
`
`jeuss}u]Uoneoyddy
`
`4
`
`
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 4 of 44
`
`US 2011/0167382 Al
`
`Portable Multifunction Device 100
`210
`
`22
`
`Speaker 111
`
`200
`
`.
`S|
`
`wo
`oO
`
`N
`
`Optical
`Sensor 164
`
`Proximity
`Sensor 166
`
` 210 is SIM card slot
`
`212 is headphone jack
`
`
`Touch Screen 11
`
`i)Ooi)|
`
`203
`
`Microphone
`113
`
`( Home \
`. 204 |
`
`Accelerometer(s)
`168
`
`External Port 124
`Figure 2
`
`5
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 5 of 44
`
`US 2011/0167382 Al
`
`Memory 370
`Operating System
`Communication Module
`
`Contact/Motion Module
`
`126
`128
`
`a0
`
`Graphics Module
`134
`436
`TextInput Module
`137
`Applications
`138
`Contacts Module
`139
`Telephone Module
`440
`Video Conference Module
`444
`E-mail Client Module
`442
`Instant Messaging Module
`443
`Workout Support Module
`144
`Camera Module
`
`310mageManagementModuie_|
`Image Management Module
`445
`CPU(s)
`Video Player Module
`146
`Music Player Module
`447
`Browser Module
`148
`330 \
`Calendar Module
`149
`Widget Modules
`449-1
`(/O Interface
`Weather Widget
`449-2
`:
`aos
`
`DisplayHL340 tao
`tos
`
`[KeyboardiMouse360
`[__Touehpad!_}-— 355
`
`
`
`Device 300
`\
`
`320
`
`
`
`
`
`
`PE nag,
`we
`
`380
`360|Communications
`interface
`es
`ee
`
`Disk Authoring Module
`Spreadsheet Module
`
`Device/GlobalInternal State
`
`88
`390
`
`157
`
`Figure 3
`
`6
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 6 of 44
`
`US 2011/0167382 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Camera
`Photos
`143
`144
`
`
`Videos
`145
`
`SY ‘Jan S
`
`15
`Calendar
`148
`
`/
`
`a
`
`S - = o
`J \ /
`;
`75°
`Workout
`Stocks
`Weather
`Support
`149-2
`149-1
`142
`‘S
`Ny
`éy
`
`168
`
`| +-X+ |
`
`Ss
`
`-
`
`ABC
`
`\
`
`~.
`
`2
`
`~
`
`Calculator
`149-3
`
`Alarm
`149-4
`
`Dictionary
`149-5
`
`~ “ User-
`
`| Created
`
`\
`™~.
`
`Widget_/
`Widget
`149-6
`
`
`
`- S410
`( 6 ;
`/
`|
`NS Ke
`
`\
`
`/
`
`A
`
`vi
`
`i/
`sS
`
`q
`
`NI
`Z)
`
`»
`
`\
`
`}v
`
`Music
`Browser
`146
`147
`40
`
`Touch Screen 112
`
`Microphone
`
`113
`
`( Home \ Accelerometer(s)
`
`. 204 |
`
`Figure 4A
`
`7
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 7 of 44
`
`US 2011/0167382 Al
`
`!
`
`Speaker 111
`
`Optical
`Sensor 164
`
`Proximity
`Sensor 166
`
`Portable Multifunction Device
`100
`
`400B Calendar
`
`148
`
`“Photos
`144
`
`Stocks
`149-2
`
`Caiculator
`149-3
`
`Notes
`153
`
`
`
`Settings
`412
`
`
`
`413
`
`co
`( Home \
`, 204 |
`
`Figure 4B
`
`Accelerometer(s)
`168
`
`8
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 8 of 44
`
`US 2011/0167382 Al
`
`450
`
`468
`
`470
`
`453
`
` Figure 4C
`
`9
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 9 of 44
`
`US 2011/0167382 Al
`
`
`
`00€891A9qUOHoUNHINW
`‘NYvseunbi4
`
`obl
`
`
`
`uer6002[eooz]>(Aepo1)
`
`
`
`600ZJaquieAoN
`
`
`+)qor0z|290[ronPOdesBnynrunrAewsdysewgel
`
`91+--vO0SSI
`
`My
`
`oo
`
`(ec$8219Uldg@zz
`
`10
`
`10
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 10 of 44
`
`US 2011/0167382 Al
`
`Css)aEenasence
`+)Q(ov0e]200[ron~OdegBnyinpunrAewsdysewgeyuerg600Z's00c|(Aepo1)
`
`
`
`adralIlolusfemewwfemfemme
`
`
`
`
`
`O€BDIARGUOUN}N
`
`(2188)WdS9}WdO0€¢MelASY90qOF
`
`
`
`|MalAay50M]O
`
`€-v00g
`
`-008800
`
`(e128)WY§OW2$8219
`
`LLOLINOLIED
`
`L-v00S
`
`11
`
`
`
`6002JOQUISAON
`
`11
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 11 of 44
`
`US 2011/0167382 Al
`
`
`
`OO0EedIAaqUOHOUNHINA
`NN9geunBi4
`
`cobb
`4){or0z]280[non]podesBnyincunrAewsudysewge4uer6002‘sooz|p>
`
`
`
`Cees)aEE
`
`12
`
`12
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 12 of 44
`
`US 2011/0167382 Al
`
`SeedA|eam|ssepusjeQue]
`
`Ces)
`
`
`
`600ZJaquiaAoN
`
`
`
`
`
`peaseiddyuyor/mjeQsoueseJUOyD
`
`WOOJPJeOgISBBYLON:u0je007
`
`
`
`
`
`00€SdIASqUOHSUNHINASY
`
`
`asaunbi4ebb
`
`
`
`
`
`©dela(on]oosaw
`
`ingunrAew
`
`
`
`idyJewqe4uer6002|go0z|P
`
`<WYLL
`WYOL€¢AONUO
`
`13
`
`13
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 13 of 44
`
`US 2011/0167382 Al
`
`
`00SDIAGGUO!OUNI}IINA_~
`(ees$0)
`
`iii)
`
`eA
`
`suepue|ec
`
`
`
`6002JSQWSAON
`
`14
`
`dgainbi4
`
`CLL
`
`14
`
`

`

`
`
`
`
`uer600z|sooz]>(Aepo1)
`
`15
`
`Patent Application Publication
`
`Jul. 7,2011 Sheet 14 of 44
`
`US 2011/0167382 Al
`
`
`
`00€891AeqUOKOUNINIA~,
`
`4ga1nb1
`
`d
`
`c
`
`|L
`
`eeeA
`
`
`
`SJEPUS|ED|g
`
`
`
`600ZJBQUISAON
`
`15
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 15 of 44
`
`US 2011/0167382 Al
`
`
`
`
`
`00€221AaqUOHSUNyHNW>,
`
`9¢aunbi4
`
`AepidSZ
`
`
`
`
`
`Aepsinu|¢z
`Aepsaupann£7
`
` BAAN
`
`Aepsen|zz NV6
`
`
`
`
`
`600ZA9qwis00q
`
`
`
`|yuang
`
`
`
`Aepuow||ZKep-ity
`
`16
`
`16
`
`
`

`

`sd1Aeg
`
`Patent Application Publication
`
`Jul. 7,2011 Sheet 16 of 44
`
`
`
`
`
`
`
`AepuSZAepsinuL77Aepseupan€ZAepsan]72Aepuow||Z
`
`
`
`6002A9QuUI900q
`
`
`
`a|JUBAZ
`
`
`
`
`
`
`
`
`
`17
`
`US 2011/0167382 Al
`
`
`
`
`
`UOHOUNHINQ0€991AEqUOH}OUNJI]"Hsounbi4clb
`
`17
`
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 17 of 44
`
`US 2011/0167382 Al
`
`Aepli4SZ
`
`
`
`AepsinupZABpSOUupaM€Z
`
`
`
`e-9205\i
`
`00€e2!A9qUOHOUNZHINW
`
`
`oNIgaunBi4
`
`cll
`
`J9squis090q
`
`
`
`
`Aeq
`
`6002
`
`Aepsen|ZZ
`
`
`
`Aepuoy1Z
`Aep-llv
`
`pJUsSAR
`
`WYOL
`
`WVLL
`
`UCON
`
`Wd|
`
`18
`
`18
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 18 of 44
`
`US 2011/0167382 Al
`
`Aepsoupana¢ZAepsen|7ZAepuoyLz WYLL
`
`
`
` ;
`
`TT
`
`
`
`6002JA9QuUI900q
`
`
`
`€JUBA
`
`©-8c0S|JUSAQ
`
`
`
`Aep-lV
`
`WvOL
`
`19
`
`
`
`
`
`AepligSZ
`
`Aepsunyyz
`
`€-v20S
`
`
`
`
`
`
`00ad1!A9qUOHOUNHINW
`
`NY
`
`rgeunbi4cll
`
`19
`
`
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 19 of 44
`
`US 2011/0167382 Al
`
`
`
`JA9qQuUI900qg
`
`
`
`
`00€89!A9qgUOROUNyHINW
`
`€-pZ0S—|
`ABPSOUPS/AAFZAepson]|ZZAepuoy|1Z
`€JUSAZ|}JUSA"
`geunbiycht
`
`
`_ y
`
`
`
`AepuySz
`
`Aepsinupz
`
`
`
`6002
`
`Aep-ily
`
`WYOL
`
`WVLE
`
`UOON
`
`Wd
`
`20
`
`20
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 20 of 44
`
`US 2011/0167382 Al
`
` 6002
`
`
`
` 7e-960G~~
`
`
`
`
`
`Aepu4SZ
`
`
`
`Aepsinul72
`
`c-¥c0S
`
`Aepseupan7Aepsen|ZZ
`
`
`
`Aepuow12
`Aep-ll¥
`
`|JUsAg
`
`WV6
`
`WYOL
`
`WV|L
`
`UCON
`
`Wd|
`
`Wd
`
`Wd
`
`J9quis20q
`
`
`
`
`
`
`
`00€89!A9qUOOUNyHINIA
`
`(NY
`
`1saunbBi4
`
`clb
`
`21
`
`21
`
`
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 21 of 44
`
`
`
`
`
`AepudSzAepsunu.vzAepsaupean€ZAepsanZZAepuow12
`
`
`
`
`
`
`
`Aep-ilV
`
`WV6
`
`IYO01
`
`WYLE
`
`UuOON
`
`Wd|
`
`Wd
`
`Wd€&
`
`22
`
`
`
`600ZJ9quisz20q
`
`
`
`
`
`
`
`US 2011/0167382 Al
`
`9dIA9q
`
`UO}OUNHN00€89!A9qUOOUNYI|w—~WseunBi4ZhL
`
`22
`
`
`

`

`Jul. 7,2011 Sheet 22 of 44
`
`US 2011/0167382 Al
`
`
`
`
`
`O0€951A9qYOHSUNJHINA
`
`Patent Application Publication
`
`€zAepsenZzAepuow|LZ 600ZA9qwi9s09q
`(Ny Ngaunbi4cbt
`
` avoL_2s
`
` AepsinupzAepseupea,
`
`
`
`Aepu-]SZ
`
`80S
`
`usr
`
`H
`
`23
`
`23
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 23 of 44
`
`US 2011/0167382 Al
`
`
`
`GJUSA
`
`Q)
`
`Aepli4SZ
`
`AepsinuLpz
`
`J8eqWi9859q
`
`
` a
`
`
` WY6Aepsaupan€ZAepsan|ZZAepuow||ZKep-ty
`€JuaAgA€-v20S|JUaAq
`1WYOL
`
`6002
`
`WVLL
`
`24
`
`
`
`
`
`00€BdIA0qUOFoUNSHINA
`
`~
`
`Oseunbi4ohh
`
`24
`
`
`
`
`

`

`Patent Application Publication 00€
`Sd/ANqUOHoUnjHINA_~dsain6biya
`
`
`
`
`
`WV6Aepsen|2ZAepuns02Kep-iiy
`
`
`
`600ZJequieseq
`
`|yUueAg
`
`WVOL
`
`WVLL
`
`Jul. 7,2011 Sheet 24 of 44
`
`US 2011/0167382 Al
`
`
`
`
`
`UOON
`
`25
`
`25
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 25 of 44
`
`US 2011/0167382 Al
`
`sdIAeg
`
`
`
`Jequiasaq
`UuOoHOUNnjHN00€ad!AaqUOHSUNYI|vwDSanbi4cht
` perscea]er-vees[oveuerJocveverfecuver]ororuer]ecuerTevzosclfeeceosalpre:ceq[z-occa])(4ero.)
`
`
`
`
`
`
`
`
` Aepinyes92Aepsaupana€¢|Aepsenlzz
`KEsssAepuoy|LZAepung0z
`
`
`
`
`
`
`»)
`
`26
`
`600Z
`
`26
`
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 26 of 44
`
`US 2011/0167382 Al
`
`
`
`
`
`QG)Zwooy:u01e9007gjUeAq
`
`q-940S
`
`uoou<WVOLSé298dHH
`
`
`
`€ Jaaenyeaday
`
`€9u0oNyoy
`
`
`
`
`
`sorddnsSutig0}JOqUIDUIDY:Sa}ON
`
`
`
`00E991AaqUOHOUNINW>
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`27
`
`27
`
`
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 27 of 44
`
`US 2011/0167382 Al
`
`Aepinyes9ZAepliSZAepsinu7Z
`
`Ceeg>;
`
`‘|
`
`FIny
`
` sdIAIGg
`UOI}OUNJIN00¢e9}AeqUOHOUNSHw—~SsaunBi4ebb
`
`
`
`ce
`
`28
`
`28
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 28 of 44
`
`US 2011/0167382 Al
`
`q-870S
`
`
`
`JS1Zwooy:u0e007gJUaAg
`
`uooUu
`
`WVOL$299dH4
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`<SUONHey<JOABN
`yeaday
`
`
`
`
`
`sorddnsSuliq0}Ioquiswlay:Se}ON
`
`sdjANq
`
`YUOor}OUNjHN00€891AaqUOH}DUN}N}|wo1gainbi4
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`cll
`
`29
`
`29
`
`
`
`
`

`

`Jul. 7,2011 Sheet 29 of 44
`
`US 2011/0167382 Al
`
`L-vSOS
`~y
`
`GJUsAq
`
`
`
`2-505”OYQG1ZWooy:u0}}2909GJUSAQ
`
`
`
`
`G-~z0S|/
`<uoeU
`WYOLsz2equd
`
`
`
`Patent Application Publication VdIAVg
`UOHoUNHN00€e91!AaqUOHOUNYH|WNNgaunbi4cll
`
`
`
`
`
`
`
`
`)€[srees[orcuerfooseverfecuverfororseverTevzcaalbececoafhreiceazracea] (epex) ver]
`
`Aepinyes9ZAepiudSZAepuow|LZAepuns02
`
`
`
`
`
`600ZJaquiaseq
`
`30
`
`30
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 30 of 44
`
`US 2011/0167382 Al
`
`
`
`
`
`SSIAIG
`
`
`
`UO!}OUNnoo€1A9Q1}4H“—\ASainBi4ZLL
`
`
`GE)€[orcs[orcuerJocreuerecurverfororuer]coverTevzcodlpececoaffiescea]zraca] (Aepex)
`
`
`
`
`
`
`
`
` WY6Aepinyes9ZAepusSZAepsinylpz|Aepseupera€z|AepsenyZZAepuow|LZAepuns02fep-iy
`
`.uoo
`eSWYLL|Jueag
`=Wd|Rss*sCoreriesinrieetiurnesheninrnennsiesingin
`[cura]~
`
`
`
`
`SS
`
`ZJUeAy
`
`6002J9qQuIZD0q
`
`31
`
`
`
`
`
`Wdz
`
`Wd€
`
`31
`
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 31 of 44
`
`US 2011/0167382 Al
`
`
`
`
`
`
`esJLeeLives
`
`
`
` @)4[alienRewfenmrom]oom[exadfcoconranaferena])(rai)
`
`Aepinyes9ZKepii4SZAepsinylpz|Aepsoupan,€z|AepsantZZAepuoy|LZAepuns02
`
`00€BDIA0qgUONOUNNINW>
`
`
`
`Msenbi4cht
`
`
`
`6002Jequisseq
`
`
`
`32
`
`32
`
`
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 32 of 44
`
`US 2011/0167382 Al
`
`c-¥S0
`
`
`
`€yUeAg
`
`|JUsAg
`
`OO8d1AeqUOHUNH/NW_~
`
`XSainbi4
`
`cbl
`
`
`
`SEEIeyViYAeqg
` Aepinyes92
`
`
`
`
`CE)¢[evvees[orcuerfocrcuer|eeuer
`
`
` Aepiui4SZAepsiny|pe|Aepseupany,€z|Aepsen,ZZ|Aepuow1zZ
`
`
`
`
`6007Jequiaseq
`
`
`
`Aepuns0z
`Aep-liv
`
`WY6
`
`WYOL
`
`WYLL
`
`ucoN
`
`33
`
`33
`
`

`

`Jul. 7,2011 Sheet 33 of 44
`
`US 2011/0167382 Al
`
`£|
`
`
`
`
`
`OO€BDIA9GUOHSIUN}JNW—\
`
`Patent Application Publication ASainbi4
`w=
` CG)€[srucea]oreverfocszrerfecusverforarue]cover[evzoealfrececcaffreicea]zracca]p(Heros) },seneneenneeeenteenentoenemnetn|L-7S0SUASE,|Cainininininteinatninintatn™A
`
`
`
`
`
`
`Aepinyes9ZAepuGZAepsiny|pz|Aepsoupeyyez]Aepsen|2Z
`
`——
`
`
`
`i S-v20S
`
`
`
`GusAg€WUsAg
`
`
`
`
`LeSS
`
`
`
`Aepuoyp1ZAepuns02
`
`
`
`600ZA9qQwuis00q
`
`Aep-lv
`
`ehh
`
`34
`
`34
`
`

`

`
`@)¢[pei|res[eeeenero]com[axedfeccon)prarmaferera]>(ver)
`
`
`
`
`Kepines9z(ae12q)AepuowLZKepuns02
`
`
`
`
`
`
`
`c-vS0GGJU8AQ
`
`
`
`
`
`6002J9qwuis090q
`
`Patent Application Publication
`
`Jul. 7,2011 Sheet 34 of 44
`
`US 2011/0167382 Al
`
`
`
`
`
`8g91A9gUOT}OUNjN
`
`
`
`NGLZwooy:uonHes07
`
`
`<WdS12
`WVOL$¢98QHo
`
`},JueAa
`
`
`
`
`
`35
`
`35
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 35 of 44
`
`US 2011/0167382 Al
`
`Aepinjes92
`gyang
`Aepugoz
`
`
`
`
`
`keq AepuowLZAepuns0Z
` GH)€[eves]oreverJoorzuerfousverfovorver]cover[euzcnalficceceal}i-icea[zrocea]](Keren)
`
`
`
`
`
`
`
`
`
`
`
`oN
`
`vvsainbi4
`
`SLL
`
` Aepsuny,pz|Aepseauparaez|Aepsanyzz
`
`
`O0E891A8qUOHOUNIHINWN
`
`
`6002A9QUI99D0q
`
`
`
`|arg
`
`36
`
`36
`
`
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 36 of 44
`
`US 2011/0167382 Al
`
`Aepunyes9%
`gyang
`
`
`
`A9qQui999q
`@¢[aesomRemfeawpowcom[ezadfewdpand
`
`
`<WdSb:b
`WV69299d18S
`
`|JU8AZ
`
`
`
`
`
`
`
`
`
`satjddnsSutig0}IOQUIDWIaY:Sa}0N
`
`
`
`
`
`
`
`
`
`
`
`00€891!AaqUoHOUNYHIN
`
`~
`
`gasainbi
`
`clb
`
`
`
`
`
`OSLCWOON-uohVe307gJUaAg
`Aepsen]Zz
`Aepuoyy1Z
`Aepuns0z
`Aep-iy¥
`
`
`
`6002
`
`NV6
`
`WYOL
`
`WVLL
`
`UOON
`
`WdL
`
`WdZ
`
`Wde
`
`37
`
`37
`
`
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 37 of 44
`
`US 2011/0167382 Al
`
`Gea)
`
`sjueaaAep-je
`
`GUSA
`
`00¢e91AeqUoROUNyHINWty
`
`Cams0)
`luer[Le06628¢ZZ
`
`6002‘92JaquiadeqAepinyes
`
`BULIQ0}JAQUISWIAX]:S8}ON
`
`OSl¢éWooy:uoleso)
`UOOUO}WIVOL|JUSAQ
`$7Jaquissag-Aepsaupap,
`LZJoquiesag-Aepuoj
`
`keqsjepuagjeEe
`
`
`Gg}UaAg
`
`600ZJequiesaq
`
`99¢aunBbiy
`
`cll
`
`>Gee
`
`sorddns
`WYOLO}WV6
`
`wAcyZyuaag
`
`UOOU0}IYOL€}U9Aq
`
`WdSbbOW6gUSA"
`
`9ZJequiecagq-Aepinyes
`
`Wid69}Nd99JUaAg
`
`ZZJaquiesag-Aepung
`
`38
`
`38
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 38 of 44
`
`US 2011/0167382 Al
`
`December 2009
`
`Event 5
`Saturday Dec. 26, 2009
`
`Location: Room 215C
`Notes: Rememberto bring
`supplics
`
`
`5062-2
`
`all-day events
`
`Event 5
`
`5062-3
`
`
`Gym
`to 8 AM
`
`Conference
`Call
`Document
`Review
`
`‘10AM to
`11 AM
`3:30 PM
`to5 PM
`
`Monday - December 21
`© Event 1
`10 AM
`Wednesday - December 23
`
`to noon
`
`O Event 2
`Gym
`
`O Event 3
`
`9 AM
`to 10 AM
`10 AM
`
`to noon
`
`Thursday — December17
`Spin Class
`7AM
`O Gym
`to 8 AM
`Friday - December18
`O Spin Class
`7AM
`
`(feescronnereamesaE)
`
`Saturday - December 26
`9 AM
`
`@ Event 5
`
`to 1:15PM
`
`6 PM to
`9PM
`O Event 6
`Sunday — December27
`
`© Event7
`
`all-day
`
`Monday — December 28
`
`5062-1
`
`112
`
`Figure 5DD XN Multifunction Device 300
`
`39
`
`39
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 39 of 44
`
`US 2011/0167382 Al
`
`
`
`
`Deactivating the activation region ofthe first selectable user interface
`object, and
`
`Reducing the activation region ofthe first selectable user interface
`object to a smaller area than the default activation region
`
`is adjacentto the first selectable user interface object, such that the
`enlarged activation region of the adjacent selectable user interface
`object occupies at least a portion of an area that was previously
`occupied by the default activation region of the first selectable user
`interface object
`
`t@
`
`)
`
`Figure 6A
`
`40
`
`
`
`616 Select the first selectable user interface object
`- 618 Perform an operation selected from the group consisting of:
`_}- 620 Enlarge an activation region of a selectable user interface objectthat
`
`600
`
`Display a plurality of selectable user interface objects
`
`_;- 602
`
`+— 604
`
`Each respective selectable user interface object has a respective
`activation region
`
`~>~
`
`__}- 610
`
`|J
`
`The selectable user interface objects are calendar events in a
`calendar
`
`|
`
`-- 612
`
`Detect a first input with the touch-sensitive surface at a location that
`correspondsto a default activation region for a first selectable user interface
`object
`
`In response to detecting thefirst input:
`
`614
`
`|
`
`40
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 40 of 44
`
`US 2011/0167382 Al
`
`
`7-614
`|- 622
`
`In responseto detecting thefirst input:
`The plurality of selectable user interface objects are a plurality of items|
`in alist. A selectable user interface object that is adjacentto thefirst
`selectable userinterface object is an item in thelist that is immediately
`| above or immediately below thefirst selectable user interface objectin |
`thelist.
`bee ee ee ee ee EE Ee EE Ee Ee Ee Ee Ee EE Ee EE EE EE EE EE EE EE EE
`
`
`Update an internal state of the multifunction device to record
`information corresponding to current activation regions ofthefirst
`selectable user interface object and the adjacent selectable user
`interface object
`
`Display a visualindication thatthe first selectable userinterface objectt~
`has been selected
`I
`Poorrri 7 828
`| Displaying the visual indication includes displaying a notification |
`| area that includes additional information aboutthefirst selectable !
`|
`userinterface object
`J
`we
`
`;
`
`1
`
`rllllllllll(L
`
`_- 630
`
`While the first selectable user interface object is selected, detect a second
`input with the touch-sensitive surface at a location that correspondsto both
`the enlarged activation region of the adjacent selectable userinterface
`object and the default activation region of the first selectable user interface
`object
`
`
`'
`In response to detecting the secondinput, select the adjacent selectable
`userinterface object.
`
`
`4.
`
`- 632
`
`penne eee eee eeeeee, 634
`In responseto detecting the second input, update an internal state of the
`multifunction device to record information corresponding to the selection of
`the adjacent selectable user interface object.
`
`Figure 6B
`
`41
`
`
`
`-- 624
`
`°
`
`+ 626
`
`----HKee
`
`
`41
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 41 of 44
`
`US 2011/0167382 Al
`
`The selectable user interface objects are calendar events in a calendar.
`While the first selectable user interface object is selected:
`
`—
`
`Detect a second input on the touch-sensitive surface at a location that|
`corresponds to a representation of a day in the calendar that does not
`include the first selectable user interface object.
`
`|
`
`|
`
`636
`
`a 638
`
`| 640
`
`oeWy
`
`In response to detecting the second input, deselect thefirst selectable
`|
`user interface object
`
`Figure 6C
`
`42
`
`42
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 42 of 44
`
`US 2011/0167382 Al
`
`£00
`
`
`- 102
`
`Display a plurality of selectable user interface objects. Each respective
`
`selectable user interface object has a respective activation region.
`
`
`
`'
`
`_- 704
`
`
`
`~
`
`
`Detecta first input
`
`' y 106
`
`In response to detecting the first input, display an editing area. The editing
`area includes a plurality of editable fields for modifying the user-modifiable
`properties of the user interface object.
`
`Detect a second input that includes:
`
`|
`
`_- 708
`
` J-- 710
`
`Detecting a contactat a location on the touch-sensitive surface that
`corresponds to a location on the display of an activation region for an
`object manipulation handle of the user interface object
`
`Detecting movementof the contact along the touch-sensitive surface
`
`|
`
`- 712
`
`Figure 7A
`
`43
`
`43
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 43 of 44
`
`US 2011/0167382 Al
`
` -714
`
`In responseto detecting the second input:
`
`
`j— 716
`
`
`
` 4
`
`
`
`Ceaseto display the editing area
`-------------—--~~ee -t~ 718
`Ceasing to display the editing area includes replacing the editing| _
`area with a read-only area
`
`;
`y
`_|- 720a
`Replacing the editing area with the read-only area includes|
`displaying an animation of the editing area transforming into
`|
`the read-only area
`
`
`t+ 722
`
`The userinterface object is an event in a calendar.
`
`The editing area includesfields for editing information about
`the event.
`
`The object manipulation handle is an object resizing handle
`associated with an end time of the event.
`
`Modifying the userinterface object includes changing the
`end time of the event.
`
`The read-only area includes a current end time for the
`event, and is located proximate to an end of the event.
`
`Pat
`~T
`---
`The userinterface object is aneventinacalendar.
`
`~~1
`
`L—+
`
`724
`
`The editing area includesfields for editing information about
`the event.
`
`The object manipulation handle is an object resizing handle
`associated with a start time of the event.
`
`Modifying the userinterface object includes changing the
`start time of the event.
`
`The read-only area includes a current start time for the
`event, and is located proximate to a beginning of the event.
`
`Figure 7B
`
`44
`
`44
`
`

`

`Patent Application Publication
`
`Jul. 7,2011 Sheet 44 of 44
`
`US 2011/0167382 Al
`
`
`
`- 714
`
`the editing area
`
`
`
`
`
`7 796
`In responseto detecting the second input:
`Modify the userinterface object in accordance with the movementof | ~
`the contact
`
`~~
`~~
`~~ sm
`~
`“
`~~ LO [ 128
`The object manipulation handle is an object resizing handle.
`|
`| Modifying the user interface object includes resizing the user
`|
`interface object.
`
`
`crc
`
`|
`| The object manipulation handle is an object movement handle.
`Modifying the user interface object includes moving the user
`interface object.
`
`= _b--
`| ~
`
`730
`
`!
`
`~-----+--+, 782
`Update an internal state of the multifunction device to reflect the
`|
`modified user interface object and the ceased display state of the
`|
`editing area
`;
`
`
`
`
`'
`
`Detect an end of the second input
`
`
`
`
`i
`
`- 134
`
`yr 136
`
`In response to detecting the end of the second input, redisplay the editing
`area
`
`-
`a _
`—
`~
`-1_4~ 738
`Redisplaying the editing area includes replacing the read-only area
`with the editing area
`
`~~
`~ ~ ~
`coo
`-
`~
`:“ee 740
`|
`Replacing the read-only area with the editing area includes
`“|
`|!
`| displaying an animation of the read-only area transforming into
`the editing area
`
`!
`
`proc cc cc rc rcrcee eee ene _}-742
`Update an internal state of the device to reflect the displayed state of 4
`
`Figure 7C
`
`45
`
`45
`
`

`

`US 2011/0167382 Al
`
`Jul. 7, 2011
`
`DEVICE, METHOD, AND GRAPHICAL USER
`INTERFACE FOR MANIPULATING
`SELECTABLE USER INTERFACE OBJECTS
`
`take longer than necessary, thereby wasting energy. This lat-
`ter considerationis particularly importantin battery-operated
`devices.
`
`RELATED APPLICATIONS
`
`SUMMARY
`
`[0001] This application claimspriority to U.S. Provisional
`Application No. 61/292,687, filed Jan. 6, 2010, entitled
`“Device, Method, and Graphical User Interface for Manipu-
`lating Selectable User Interface Objects,” which is incorpo-
`rated by reference hereinin its entirety.
`[0002]
`Thisis related to Ser. No. 11/969,786 “System and
`Method for Viewing and Managing Calendar Entries”filed
`Jan. 4, 2008; Ser. No. 12/242,856 “Portable Multifunction
`Device, Method, and Graphical User Interface for Viewing
`and Managing Electronic Calendars”filed Sep. 30, 2008; and
`Ser. No. 12/567,697 “Device, Method, and Graphical User
`Interface for Manipulation of User Interface Objects with
`Activation Regions”filed Sep. 25, 2009, which are hereby
`incorporated by reference in their entireties.
`
`TECHNICAL FIELD
`
`[0003] This relates generally to electronic devices with
`touch-sensitive surfaces, including but not limited to elec-
`tronic devices with touch-sensitive surfaces that are used to
`interact with selectable user interface objects.
`
`BACKGROUND
`
`[0004] The use of touch-sensitive surfaces as input devices
`for computers and other electronic computing devices has
`increased significantly in recent years. Exemplary touch-sen-
`sitive surfaces include touch pads and touch screen displays.
`Such surfaces are widely used to manipulate user interface
`objects on a display.
`[0005] Exemplary manipulations include adjusting the
`position and/or size of one or moreuserinterface objects, as
`well as associating metadata with one or more userinterface
`objects. Exemplary user interface objects include digital
`images, representations of calendarevents, video, text, icons,
`and other graphics. A user may need to perform such manipu-
`lations on user interface objects in a calendar application
`(e.g., iCal from Apple Inc. of Cupertino, Calif.), a file man-
`agement program (e.g., Finder from Apple Inc. of Cupertino,
`Calif.), an image managementapplication (e.g., Aperture or
`iPhoto from Apple Inc. of Cupertino, Calif.), a digital content
`(e.g., videos and music) management application (e.g.,
`iTunes from Apple Inc. of Cupertino, Calif.), a drawing appli-
`cation, a presentation application (e.g., Keynote from Apple
`Inc. of Cupertino, Calif.), a word processing application(e.g.,
`Pages from Apple Inc. of Cupertino, Calif.), a website cre-
`ation application (e.g., iWeb from Apple Inc. of Cupertino,
`Calif.), a disk authoring application (e.g., iDVD from Apple
`Inc. of Cupertino, Calif.), or a spreadsheet application (e.g.,
`Numbers from Apple Inc. of Cupertino, Calif.).
`[0006] But existing methods for performing these manipu-
`lations are cumbersomeandinefficient. For example, using a
`sequence of mouse-based inputs to select one or more user
`interface objects and perform one or more actions on the
`selected user interface objects is tedious and createsa signifi-
`cant cognitive burden on a user.In addition, existing methods
`
`[0007] Accordingly, there is a need for computing devices
`with faster, more efficient methods andinterfaces for manipu-
`lating selectable user interface objects. Such methods and
`interfaces may complementor replace conventional methods
`for manipulating selectable user interface objects. Such meth-
`ods and interfaces reduce the cognitive burden on a user and
`produce a more efficient human-machineinterface. For bat-
`tery-operated computing devices, such methods and inter-
`faces conserve powerandincrease the time between battery
`charges.
`[0008] The above deficiencies and other problemsassoci-
`ated with user interfaces for computing devices with touch-
`sensitive surfaces are reduced or eliminated by the disclosed
`devices. In some embodiments, the device is a desktop com-
`puter. In some embodiments, the device is portable (e.g., a
`notebook computer, tablet computer, or handheld device). In
`some embodiments,
`the device has a touchpad. In some
`embodiments, the device has a touch-sensitive display (also
`known as a “touch screen” or “touch screen display”). In
`some embodiments, the device has a graphical user interface
`(GUD, one or more processors, memory and one or more
`modules, programs or sets of instructions stored in the
`memory for performing multiple functions. In some embodi-
`ments, the user interacts with the GUI primarily through
`finger contacts and gestures on the touch-sensitive surface. In
`some embodiments, the functions may include imageediting,
`drawing, presenting, word processing, website creating, disk
`authoring, spreadsheet making, gameplaying, telephoning,
`video conferencing, e-mailing, instant messaging, workout
`support, digital photographing, digital videoing, web brows-
`ing, digital music playing, and/or digital video playing.
`Executable instructions for performing these functions may
`be included in a computer readable storage medium or other
`computer program product configured for execution by one or
`more processors.
`[0009]
`In accordance with some embodiments, a methodis
`performed at a multifunction device with a display and a
`touch-sensitive surface. The method includes: displaying a
`plurality of selectable user interface objects. Each respective
`selectable user interface object has a respective activation
`region. The method further includes detecting a first input
`with the touch-sensitive surface at a location that corresponds
`to a default activation region for a first selectable user inter-
`face object. The methodalso includes, in response to detect-
`ing the first input: selecting thefirst selectable user interface
`object; performing an operation selected from the group con-
`sisting of: deactivating the activation region ofthefirst select-
`able user interface object, and reducing the activation region
`of the first selectable user interface object to a smaller area
`thanthe default activation region; and enlarging an activation
`region of a selectable user interface object that is adjacent to
`the first selectable user interface object such that the enlarged
`activation region of the adjacent selectable user interface
`object occupies at least a portion of an area that was previ-
`ously occupied by the default activation region ofthe first
`selectable user interface object.
`[0010]
`In accordance with some embodiments, a methodis
`performed at a multifunction device with a display and a
`touch-sensitive surface. The method includes: displaying a
`
`46
`
`46
`
`

`

`US 2011/0167382 Al
`
`Jul. 7, 2011
`
`user interface object having a position on the display and a
`plurality ofuser-modifiable properties; detecting a first input;
`and in response to detecting the first input, displaying an
`editing area. The editing area includesa plurality of editable
`fields for modifying the user-modifiable properties ofthe user
`interface object. The method further includes detecting a
`second input thatincludes: detecting a contactat a location on
`the touch-sensitive surface that corresponds to a location on
`the display of an activation region for an object manipulation
`handle of the user interface object, and detecting movement
`of the contact along the touch-sensitive surface; and in
`response to detecting the second input: ceasing to display the
`editing area; and modifying the userinterface objectin accor-
`dance with the movement of the contact. The method also
`
`includesdetecting an end ofthe second input; and in response
`to detecting the end of the second input, redisplaying the
`editing area.
`[0011]
`In accordance with some embodiments, a multi-
`function device includes a display, a touch-sensitive surface,
`one or more processors, memory, and one or more programs;
`the one or more programs are stored in the memory and
`configured to be executed by the one or more processors and
`the one or more programsincludeinstructions for performing
`the operations of any of the methods described above. In
`accordance with some embodiments, a graphical user inter-
`face on a multifunction device with a display, a touch-sensi-
`tive surface, a memory, and one or moreprocessors to execute
`one or more programsstored in the memory includes one or
`more of the elements displayed in any of the methods
`described above, which are updated in responseto inputs, as
`described in any of the methods above. In accordance with
`some embodiments, a computer readable storage medium has
`stored therein instructions which when executed by a multi-
`function device with a display and a touch-sensitive surface,
`cause the device to