as) United States
`a2) Patent Application Publication (0) Pub. No.: US 2008/0122796 A1
`(43) Pub. Date: May29, 2008
`
`Jobs et al.
`
`US 20080122796A1
`
`(54)
`
`TOUCH SCREEN DEVICE, METHOD, AND
`GRAPHICAL USER INTERFACE FOR
`DETERMINING COMMANDSBY APPLYING
`HEURISTICS
`
`(76)
`
`Inventors:
`
`Steven P. Jobs, Palo Alto, CA (US);
`Scott Forstall, Mountain View, CA
`(US); Greg Christie, San Jose, CA
`(US); Stephen O. Lemay, San
`Francisco, CA (US); Scott Herz,
`Santa Clara, CA (US); Marcel Van
`Os, San Francisco, CA (US); Bas
`Ording, San Francisco, CA (US);
`Gregory Novick, Santa Clara, CA
`(US); Wayne C. Westerman, San
`Francisco, CA (US); Imran
`Chaudhri, San Francisco, CA (US);
`Patrick Lee Coffman, Menlo Park,
`CA (US); Kenneth Kocienda,
`Sunnyvale, CA (US); Nitin K.
`Ganatra, San Jose, CA (US);
`Freddy Allen Anzures, San
`Francisco, CA (US); Jeremy A.
`Wyld, San Jose, CA (US); Jeffrey
`Bush,San Jose, CA (US); Michael
`Matas, San Francisco, CA (US);
`Paul D. Marcos, Los Altos, CA
`(US); Charles J. Pisula, San Jose,
`CA (US); Virgil Scott King,
`Mountain View, CA (US); Chris
`Blumenberg,San Francisco, CA
`(US); Francisco Ryan Tolmasky,
`Cupertino, CA (US); Richard
`Williamson, Los Gatos, CA (US);
`Andre M.J. Boule, Sunnyvale, CA
`(US); Henri C. Lamiraux, San
`Carlos, CA (US)
`
`Correspondence Address:
`MORGAN LEWIS & BOCKIUS LLP/ APPLE
`COMPUTERINC.
`2 PALO ALTO SQUARE, 3000 EL CAMINO
`REAL
`PALO ALTO, CA 94306
`
`(21)
`
`Appl. No.:
`
`11/850,635
`
`(22)
`
`Filed:
`
`Sep. 5, 2007
`
`Related U.S. Application Data
`
`Provisional application No. 60/937,991, filed on Jun.
`29, 2007, provisional application No. 60/937,993,
`filed on Jun. 29, 2007, provisional application No.
`60/879,469, filed on Jan. 8, 2007, provisional applica-
`tion No. 60/879,253, filed on Jan. 7, 2007, provisional
`application No. 60/824,769,filed on Sep. 6, 2006.
`Publication Classification
`
`Int. Cl.
`
`(2006.01)
`GO6F 3/041
`US. Cl]. icc cece cece cneneensesenscnsensenies 345/173
`
`ABSTRACT
`
`(60)
`
`61)
`
`(52)
`
`(57)
`
`Acomputer-implemented methodfor use in conjunction with
`a computing device with a touch screen display comprises:
`detecting one or more finger contacts with the touch screen
`display, applying one or more heuristics to the one or more
`finger contacts to determine a commandfor the device, and
`processing the command. The one or more heuristics com-
`prise: a heuristic for determining that the one or morefinger
`contacts correspond to a one-dimensional vertical screen
`scrolling command,a heuristic for determining that the one or
`morefinger contacts correspond to a two-dimensional screen
`translation command,and a heuristic for determining that the
`one or more finger contacts correspond to a command to
`transition from displaying a respective item ina set ofitemsto
`displaying a next item in the set of items.
`
` Widget Creator Module
`
`Memory
`Portable Multifunction Device
`100
`2
`136
`148
`126 [Applications (continued)
`[Operating System
`[Communication Module
`La
`Calendar Module
`
`
`
`
`ve. 1
`Le 3 Widget Modules
`Contact/Motion Module
`
`
`
`1492
`Weather Widget
`[Graphics Module
`
`
`
`
`Lo aos
`stocks Widget
`Text Input Module
`i“
`
`
`1 445
`Calculator widget
`[GPS Module
`136
`
`
`437
`[Applications
`Alarm Clock Widget
`Lo 1495
`
`
`
`
`
`138
`.
`Contacts Module
`Dictionary whiget_—[-~
`Telephone Module
`138ft—__]_ ss0.6
`
`lUser-Creaied Widgets) -~ 160
`Video Conference Module
`
`
`E-mail Client Module
`151
`Search Modula
`
`
`
`
`Instant Messaging Module
`Blogging Module
`
`[CameraModule
`image Management Module
`
`
`
`
`
`
`Display System VO Subsystem
`
`
`
`
`
`
`Display
`Controller
`
`
`
`‘Optical
`sensor(s)
`Controller
`
`188
`
`
`
`
`Other Input
`Touch-Sensitve
`Contral
`
`112
`
` Devices
`
`
`
`APPLE 1009
`
`APPLE 1009
`
`1
`
`

`

`Patent Application Publication May 29, 2008 Sheet 1 of 302
`
`US 2008/0122796 Al
`
`Memory
`102
`
`F
`
`126 Applications (continued)
`Operating System
`128
`Calendar Module
`Communication Module
`32
`Widget Modules
`Contact/Motion Module
`Weather Widget
`Graphics Module
`fas
`Stocks Widget
`Text Input Module
`136
`Calculator Widget
`GPS Module
`
`137
`Alarm Clock Widget
`438
`Dictionary Widget
`Contacts Module
`
`Telephone Module we}|LE|sao6
`Video Conference Module
`440
`User-Created Widget(s)
`450
`E-mail Client Module
`444
`Widget Creator Module
`454
`Instant Messaging Module
`442
`Search Module
`Blogging Module
`443
`lCameraModulesiModule
`Image Management Module
`144
`Power
`102
`nag
`9
`145
`System
`Video Player Module
`-
`146
`Music Player Module
`147
`-
`Browsing Module
`
`Portable Multifunction Device
`100
`
`
`
`External
`Port
`
`124
`
`136
`
`448
`449
`149-1
`449-2
`149.3
`449-4
`449-5
`
`Speaker
`111
`
`4160
`
`116
`
`104
`
`122
`
`106
`
`103
`Controller
`on
`
`118
`
`103
`
`u
`
`|
`Peripherals
`Interface
`
`RF Circuitry
`408
`swale =a(
`Circuitry
`110 LO)
`Microphone
`113
`166
`
`Proximity
`Sensor
`
`Accelerometer(s)
`168
`
`lO Subsystem
`-
`
`
`
`
`
`Display
`sencor(s)
`Other Input
`
`
`
`
`
`
`Controller
`Controller
`Controller(s)
`156—“"|
`
`103
`
`Devices
`
`
`Touch-Sensitive
`Display System
`
`112
`
`Other Input
`Control
`
`Optical
`Sensor(s)
`164
`
`Figure 1A
`
`103
`
`2
`
`

`

`Patent Application Publication
`
`May 29, 2008 Sheet 2 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device 100 136
`Memory 102
`126 Applications (continued)
`148
`Operating System
`
`
`Communication Module 128||calendar Module 4149
`Contact/Motion Module
`32
`Widget Modules
`449-1
`
`
`
`User-Created Widget(s)
`Widget Creator Module
`Search Module
`Online Video Module
`:
`
`40.5
`
`149-6
`450
`454
`155
`
`Weather Widget(s)
`Graphics Module
`149-2
`-
`134
`449-3
`tocks Widget
`136
`Text Input Module
`
`IGPSModule==sid[CalculatorWidget—|Widget
`GPS Module
`136
`=
`= as ,
`449-4
`
`137
`Contacts Module
`438
`Dictionary Widget
`Telephone Module
`139
`Video Conference Module
`440
`E-mail Client Module
`444
`Instant Messaging Module
`442
`Blogging Module
`443
`Camera Module
`144
`Image Management Module
`4152
`rower1162
`153
`System
`154
`147
`
`124
`
`RF Circuitry
`
`111
`
`Rudio =a
`Circuitry
`1410
`K+)
`Microphone
`113
`166
`
`Proximity
`Sensor
`
`Accelerometer(s)
`168
`—
`
`Notes Mcdule
`Map Module
`Browsing Module
`
`118
`
`Port
`103
`
`104
`122
`
`Control
`ontromer
`
`Vy 103
`5
`
`
`
`
`Peripherals
`Interface
`
`103
`
`103
`
`120
`
`Processor(s)
`
`106
`
`
`r—"
`103
`
`
`158
`0 Subsystem
`Optical
`
`
`
`Display
`senco,(s)
`OtherInput
`Controller
`
`
`156—|
`
`Controller
`
`
`
`Controller(s)
`
`
`
`
`103
`
`103
`
`Touch-Sensitive
`
`Sensors)
`
`Display System 164
`
`103
`
`orperInput
`
`Devices
`
`112
`
`Figure 1B
`
`160
`
`1-116
`
`3
`
`

`

`Patent Application Publication May 29, 2008 Sheet 3 of 302
`
`US 2008/0122796 Al
`
`-
`o
`
`co
`“l
`
`
`
`Portable Multifunction Device 100
`
`Ze
`
`Speaker 111
`
`Optical
`Sensor 164
`
`Proximity
`Sensor 166
`
`206
`
`200
`
`210 is SIM card slot
`212 is headphonejack
`
`NooO No
`
`Touch Screen 11
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`External Port 124
`Figure 2
`
`4
`
`

`

`Patent Application Publication May 29, 2008 Sheet 4 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Current Time ~ 308
`310 Day and Date~ 312
`
`
`
`Wallpaper image
`314
`
`Slide to unlock
`
`Touch Screen 11
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 3A
`
`5
`
`

`

`Patent Application Publication May 29, 2008 Sheet 5 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Current Time » 308
`310 ~ Day and Date» 312
`
`
`
`Slide to unlock
`
`Touch Screen 11
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 3B
`
`6
`
`

`

`Patent Application Publication May 29, 2008 Sheet 6 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`Enter Passcode
`
`
`
`
`
`
`
`
`
`Current Time 404
`
`
`
`
`
`
`
`
`
`
`
`Emergency
`Call
`
`+
`
`Cancel
`
`Microphone
`4113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 3C
`
`7
`
`

`

`Figure 4A
`
` 4
`
`Videos
`145
`
`
`
`x 15
`Lo}
`Jan
`
`
`
`Weather
`149-1
`
`Stocks
`149-2
`
`Blog
`142
`
`Calendar
`148
`
`ABC
`
`User-
`Created
`Widget
`
`Calculator
`149-3
`
`Alarm
`149-4
`
`Dictionary
`149-5
`
`Browser
`147
`
`Music
`146
`
`Touch Screen 112
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Patent Application Publication May 29, 2008 Sheet 7 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`100
`
`
`
`Text
`141
`
`75°
`XY
`
`
`
` OOO
`
`Photos
`144
`
`Camera
`143
`
`ee
`
`
`
`8
`
`

`

`9
`
`iPod
`Browser
`Mail
`152
`147
`140
`
`08
`
`Ep an 406
`405
`
`
`
`
`
`
`
` QOO®O
`
`
`
`Calendar
`148
`
`Photos
`144
`
`Stocks
`149-2
`
`Calculator
`149-3
`
`Settings
`412
`
`
`
`A14
`
`ef”
`
`Touch Screen 11
`
`4113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 4B
`
`Patent Application Publication May 29, 2008 Sheet 8 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`
`
`
`
`
`
`Jan
`15
`
`
`
`9
`
`

`

`Patent Application Publication May 29, 2008 Sheet 9 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Current Time 404
`
`@> 406
`
`514-1
`
`
`908-1
`510-1
`Jane Doe ~ 504-1
`;
`Hola ~ 506-1
`Today
`
`908-2
`510-2
`John Smith 504-2
`pn 506-2
`Are you going tonight?
`January 38, 2006 3
`
`508-3
`510-3
`408-123-4567~ 504-3
`Bye ~ 506-3
`January 27, 2006 3
`
`Bob Adams ™ 504-4
`508-4
`CU later ~ 506-4
`January 35, 2006 3
`
`
`
`512
`
`Instant Messages ~ 502
`
`3
`
`
`
`
`
`
`
`
`
`
`Touch Screen 11
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 5
`
`10
`
`10
`
`

`

`Patent Application Publication May 29, 2008 Sheet 10 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`Current Time 404
`
`
`
`
`
`
`Instant Messages|~~ 602 Jane Doe» 504-1
`
`
`
`
`
`604-1
`
`January 29, 2006
`
`January 30, 2006
`8:30 AM
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 6A
`
`11
`
`11
`
`

`

`Patent Application Publication May 29, 2008 Sheet 11 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Jane Doe ~ 504-1
`
`
`
`
`Instant Messages kw 692
`
`Current Time 404
`
`604-2
`
`January 30, 2006
`8:30
`
`608-2
`
`
`(How was your vacal|
`
`
`
`
`
`
`
`
`
`GUGOUGOCCG
`als[olelstulalale
`z{xtelyalnjm,
`
`
`
`
`
`
`
`616
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 6B
`
`12
`
`12
`
`

`

`Patent Application Publication May 29, 2008 Sheet 12 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`
`
`
`
` “eo2
`Jane Doe 504-1
`
`
`606-1
`
`Current Time 404
`
`
`
`604-2
`
`January 30, 2006
`8:30 AM
`
`608-2
`
`(How wasyourvacat
`12
`
`
`
`
`
`
`Gebel
`“EEL.)
`OAOG
`
`
`
`ABC
`626
`
`
`{Mewrnone|Home(Accelerometers){Mewrnone|13
`
`204(Accelerometers)68
`
`Figure 6C
`
`13
`
`13
`
`

`

`Patent Application Publication May 29, 2008 Sheet 13 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Current Time 404
`
`
`
`Instant Messages ~ gq9 Jane Doe ~ 504-1
`
`
`
`
`January 30, 2006
`8:30 AM
`
`608-2
`
`
`(How was your vacat|
`et
`
`614
`
`
`622
`) (vacate) (vacation)
`(vacant
`
`
` HL
`
`ae
`
`
`
`Microphone
`4113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 6D
`
`14
`
`14
`
`

`

`Patent Application Publication May 29, 2008 Sheet 14 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Current Time 404
`
`
`
`Instant Messages ~~ 602
`
`Jane Doe
`
`504-1
`
`
`
`January 30, 2006
`8:30 AM
`
`608-2
`
`606-3
`
`5
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 6E
`
`15
`
`15
`
`

`

`Patent Application Publication May 29, 2008 Sheet 15 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`636
`
`New Message
`
`
`
`
`
`
`
`
`
`
`
`(Text box Q ( Send M44 612
`
`alienreer
`sCGECG
`Oaeevenn @
`
`
`
`A;|S|D
`
`16
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 6F
`
`16
`
`16
`
`

`

`Patent Application Publication May 29, 2008 Sheet 16 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`Speaker 111
`
`Optical
`Sensor 164
`
`Proximity
`Sensor 166
`
`600G
`
`Z) 402
`
`Current Time 404
`
`@> 406
`
`
`
`New Message
`636 ~_ Cancel }
`To:vl 64“+)822
`
`
`
`
`
`
`
`
`
`650-123-2332
`38
`Mike Van Os
`
`
`712-666-3466
`Venu
`
`
`872-739-2322
`Vick Tom
`
`
`712-342-3455
`Vivan
`
`
`
`Selene
`IecuGoRaKC
`elvieln(y) (a
`2423
`Space
`/
`
`
`
`
`
`
`
`Microphone
`13
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 6G
`
`17
`
`17
`
`

`

`Patent Application Publication May 29, 2008 Sheet 17 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`
`
`Current Time 404
`
`New Message
`
`e636
`
`To: Mike Van Os©632
`
`
`
`
`
`
`
`
`dinner }* 644
`Can you make dinl» 656
`
`
`
`
`
`SOGOUE
`
`
`
`alslolele New
`
`
`
`ooo!
`2123 |
`dinner
`
`
`
`
`618
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 6H
`
`18
`
`18
`
`

`

`Patent Application Publication May 29, 2008 Sheet 18 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`Current Time 404
`
`636
`
`New Message
`
`
`
`To: Mike Van Os 32
`
`
`
`
`656
`
`
`ikyou makedint?will
`
`pick Dan from the day care. 612
`
`
`Q;wWw;E;RIT)
`
`
`Y>Usie
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure61
`
`19
`
`19
`
`

`

`Patent Application Publication May 29, 2008 Sheet 19 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`Current Time 404
`
`
`
`636
`
`New Message
`
`To: Mike Van Os
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`16
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 6J
`
`20
`
`20
`
`

`

`Patent Application Publication May 29, 2008 Sheet 20 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`
`
`Current Time 404
`
`New Message
`
`636
`
`To: Mike Van Os_—632
`
`
`
`
`
`
`
`
`
`
`
`it you makedinner?| will
`pick Danlirom the day care. 612 (Send,
`SUGCOUCOCG
`aelelteliisise
`
`
`
`
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 6K
`
`21
`
`21
`
`

`

`Patent Application Publication May 29, 2008 Sheet 21 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`402
`
`Current Time 404
`
`
`
`
`‘Done7 Instant Messages~502
`{371 Jane Doe ~ 504-1
`oe
`Hola ~» 506-1
`Today
`
`702-2 John Smith ~ 504-2 og. 08?5
`Are you going tonight?January 28, 2006
`(* 408-123-4567 ~ 504-3
`von
`Bye ~~ 506-3
`January 27, 2006
`
`* Bob Adams ~ 504-4 508-4
`Delete
`5
`CU later
`January 25, 2006
`
`
`
`
`704
`
`
`
`
`
`Touch Screen 11
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 7
`
`22
`
`22
`
`

`

`
`
`V N
`
`Patent Application Publication May 29, 2008 Sheet 22 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Current Time 494
`
`
`
`All Contacts
`804
`806
`
`802
`
`( First Name { Last Name}
`
`
`Bob Adams
`
`
`<x<S<CHMDOVOZEC-AC—-LoOmmMv0OUWr
`
`
`
` Darin Adler A
`
`Darin Amon
`814
`
`Kim Brook
`
`
`
`By2
`Other Number
`
`
`Touch Screen 11
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 8A
`
`23
`
`23
`
`

`

`
`
`Patent Application Publication May 29, 2008 Sheet 23 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Current Time 404
`
`All Contacts
`802804
`806
`
`Fa
`co
`( First Name { Last Name }
`
`
`AD
`
`
`
`Aaron Jones
`
`
`4 a
`
`ta
`
`Arlene Bascom
`
`N<*S<CHMNOVOZZr-AC—LTOMmMIOU>S
`
`
`
`v
`
`
`
`Bob Adams
`
`Bruce Walker
`
`
`812
`
`Cancel
`
`Other Number
`
`
`
`Touch Screen 11
`
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 8B
`
`24
`
`24
`
`

`

`Patent Application Publication May 29, 2008 Sheet 24 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`
`
`Instant Messages|~602 Jane Doe ~ 504-1
`
`Current Time 404
`
`
`
`
`©canes!| oterProne Sate
`
`
`
`
`902
`904
`
`
`
`
`
`
`
`(408) 234-56|
`
`
`
`
`
`Telstelslelrele
`TTDLee
`CSiSQGc
`
`
`
`ABC
`
`
`Microphone
`413
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 9
`
`25
`
`25
`
`

`

`Patent Application Publication May 29, 2008 Sheet 25 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Viewfinder
`
`Image
`
`
`
`
`
`Cameraroll
`1004
`
`Shutter
`1006
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 10
`
`26
`
`26
`
`

`

`
`
`Camera Roll (32) Done|
`
`1110~>
`
`
`
`Patent Application Publication May 29, 2008 Sheet 26 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`@> 406
`
`168
`
`
`
`
`
`
`
`
`
`Thumbnail
`1102-01
`
`Thumbnail
`1102-02
`
`Thumbnail
`1102-03
`
`Thumbnail
`1102-04
`
`
`
`
`Thumbnail
`1102-05
`
`Thumbnail
`
`1102-06 A
`
`Thumbnail
`1102-07
`
`Thumbnail
`1102-08
`
`‘
`1112%
`
`
`Thumbnail
`1102-09
`
`Thumbnail
`1102-10
`
`Thumbnail
`1102-11
`ene
`011083
`
`= a?
`
`Thumbnail
`1102-12
`
`Thumbnail
`1102-13
`
`Thumbnail
`1102-14
`
`Thumbnail
`1102-15
`
`Thumbnail
`1102-16
`
`Camera
`1104
`
`Microphone
`113
`
`Home
`
`204
`
`Accelerometer(s)
`
`Figure 11
`
`27
`
`27
`
`

`

`Patent Application Publication May 29, 2008 Sheet 27 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Z) 402
`
`Current Time 404
`
`
`
`Camera Roll
`
`1202
`11 of 29
`
`
`
`
`
`
`
`{Merpprone|Home (“ores{Merpprone|13 204 (“ores68
`
`
`
`Figure 12A
`
`28
`
`28
`
`

`

`Patent Application Publication May 29, 2008 Sheet 28 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`@> 406
`
`
`
`
`
`Camera Roll
`
`1202
`
`11 of 29
`
`‘110{Done)
`
`Cancel
`
`Camera
`1104
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 12B
`
`29
`
`29
`
`

`

`Patent Application Publication May 29, 2008 Sheet 29 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`@> 406
`
`
`
`
`
`Camera Roll 1110Done|11 of 29
`
`
`
`
`
`
`m~-1202
`
`
`
`
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 12C
`
`30
`
`30
`
`

`

`Patent Application Publication May 29, 2008 Sheet 30 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`
`
`
`
`Saeme
`
`
`
`
`Graphi
`
`1304.2
`
`
`
`
`Photo Albums
`
`Album Name 1306-1
`
`Album Name 1306-2
`
`Album Name 1306-3
`
`1312
`
`
`
`
`
`
`
`Graphi
`
`1304.3
`
`
`
`
`Graphic
`1304-4
`
`
`
`
`Album Name1306-4
`
`Album Name 1306-5
`
`Album Name 1306-6
`
`Graphic
`
`1304-5
`
`
`
`
`Graphic
`1304-6
`Ci) ™ 1310
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 13A
`
`31
`
`31
`
`

`

`168
`
`
`
`V
`
`4>v
`
`= w = nt
`
`V
`
`Camera Roll 1306-8
`
`Last 12 Months 1306-9
`
`Wallpaper 1306-10
`
`Beach Fun 1306-11
`
`Camping 1306-12
`
`Christmas 1306-13
`
`Graphic
`1304-9
`
`
`Graphic
`1304-10
`
`
`
`Graphic
`1304-11
`
`
`
`Graphic
`1304-12
`
`
`
`
`
`
`
`Graphic
`1304-13
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`
`Figure 13B
`
`32
`
`Patent Application Publication May 29, 2008 Sheet 31 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`
`
`Photo Albums
`
`
`Current Time 404
`
`
`
`Photo Library 1306-7 >
`
`08
`
`Graphic
`1304-7
`
`
`
`
`
`
`
`
`
` O
`
`
`
`
`32
`
`

`

`
`
`Settings
`
`Music:»1402
`
`Patent Application Publication May 29, 2008 Sheet 32 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`Now Playing
`Repeat» 1404
`
`
`
`Shuffle:~1406
`
`
`
`Time Per Slide:~~1408
`2 seconds
`
`
`Transition: 1410
`
`Wipe across
`
`TV Out..1412
`On
`
`
`TV signal:..1414
`NTSC
`
`
`Auto Rotate.~1416
`On
`
`
`Done~1418
`
`
`
`
`
`
`
`
`
`{Micwrnone|Home (“orrgee®)){Micwrnone|13 204 (“orrgee®))68
`
`
`
`Figure 14
`
`33
`
`33
`
`

`

`Patent Application Publication May 29, 2008 Sheet 33 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`4500
`
`Speaker 111
`
`Optical
`
`Sensor 164
`
`Proximity
`
`Sensor 166
`
`Z| 402
`
`Current Time 404
`
`
`
`Photo Albums|Album Name (32)
`“1502
`
`
`
`
`
`
`
`
`
`
`
`
`Thumbnail
`1506-01
`
`Thumbnail
`1506-02
`
`Thumbnail
`1506-03
`
`Thumbnail
`1506-04
`
`
`
`
`Thumbnail
`
`1506-05
`
`Thumbnail
`
`1506-06 A
`
`Thumbnail
`
`1506-07
`
`Thumbnail
`
`1506-08
`
`e 1
`
`a
`
`514“
`
`Thumbnail
`
`1506-09
`
`Thumbnail
`
`1506-10
`
`Thumbnail
`
`1506-11
`
`Thumbnail
`
`1506-12
`
`615123
`
`“ao?
`
`
`Thumbnail
`1506-13
`
`Thumbnail
`1506-14
`
`Thumbnail
`1506-15
`
`Thumbnail
`1506-16
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 15
`
`34
`
`34
`
`

`

`Patent Application Publication May 29, 2008 Sheet 34 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`
`
`
`
`Album Name
`
`11 of 87
`1602
`
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 16A
`
`35
`
`35
`
`

`

`Patent Application Publication May 29, 2008 Sheet 35 of 302
`
`US 2008/0122796 Al
`
`891
`(s)J9]}eLUOJE|B00
`
`a
`(oo
`vOd
`awoH
`
`ely
`Suoydool|Al
`
`
`
`Figure16B
`
`
`
`
`
`
`Z8JOLL|ewen wngqy 3
`
`cO9L
`
`Or SWI] JUNG
`
`ZOP [7
`
`OOL
`Bd1AVq UOHOUNIHINA s1Iqeyod
`
`90¢
`
`36
`
`36
`
`

`

`Patent Application Publication May 29, 2008 Sheet 36 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`
`
`
`
`Album Name
`
`11 of 87
`1602
`
`Image
`1606
`
`
`
`
`Email photo 12:
`
`
`
`Assign to contact120
`
`
`
`Use as wallpaper ize
`
`
`
`
`
`
`
`Cancel :z4
`
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 17
`
`37
`
`37
`
`

`

`Patent Application Publication May 29, 2008 Sheet 37 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`
`
`
`
`
`
`
`
`
`
`(Meperone|Home (Arr)(Meperone|13 204 (Arr)68
`
`
`
`Figure 18A
`
`38
`
`38
`
`

`

`Patent Application Publication May 29, 2008 Sheet 38 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`
`
`1 Great Photo
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 18B
`
`39
`
`39
`
`

`

`Patent Application Publication May 29, 2008 Sheet 39 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`@> 406
`
`1 Great Photo
`
`
`
`TO:
`
`Cc:
`
`
`
`
`
`
`
`
`
`
`
`
`Subject:
`
`1 Great Photo
`
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 18C
`
`40
`
`40
`
`

`

`Patent Application Publication May 29, 2008 Sheet 40 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`@> 406
`
`Cancel
`
`1 Great Photo
`|
`
`
`
`
`
`
`To:
`Ce:
`
`
`
`(iy wat
`eid)
`102+
`1 Great Photo “sod
`
`
`
`
`
`«1806}
`®
`
`
`
`ao?
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 18D
`
`41
`
`41
`
`

`

`Patent Application Publication May 29, 2008 Sheet 41 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`100
`
`Speaker 111
`
`Optical
`Sensor 164
`
`Proximity
`Sensor 166
`
`1800E
`
`Current Time 404
`
`
`
`
`[Cancel.) 1 Great Photo
`
`
`
`
`Co: ip
`
`
`Subject:|1 Great Photo 8001
`
`
`
`
`
`1806)
`
`
`
`
`
`
`
`
`®SeePLEl
`eeleeel
`BGO0000
`7123
`Space
`| Return
`
`16
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 18E
`
`42
`
`42
`
`

`

`ZL 402
`
`Current Time 404
`
`1 Great Photo
`
`(
`
`Send
`}
`C+)
`arlene@def.com
`
`
`
`Patent Application Publication May 29, 2008 Sheet 42 of 302
`
`US 2008/0122796 Al
`
`
`
`To: B
`Arlene Bascom 1826
`
`Bob Adams
`
`Kim Brook
`Bruce Walker
`
`i308
`
`v
`
`badams@abc.com
`
`+Kim@apple.com'*”°
`bwalker@gmail.com
`
` olweleldelele,
`ACCOGOCCOGS
`GECGooG
`7123|
`vpass
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 18F
`
`43
`
`43
`
`

`

`Patent Application Publication May 29, 2008 Sheet 43 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`100
`
`Speaker 111
`
`Optical
`Sensor 164
`
`Proximity
`Sensor 166
`
`1800G
`
`Current Time 404
`
`@b 406
`
`
`
`|[Cancel) 4 Great Photo[Send)
`
`
`
`Cc: Darin Adler
`
`
`
`Image 1606 meer
`meeeTee
`g ebpod
`
`To: Bob Adams
`
`
`
`
`
`Subject:
`
`1 Great Photo
`
`took 1832
`Bob,
`This is a picture | toom|
`
`
`
`
`
`
`
`Figure 18G
`
`44
`
`44
`
`

`

`Patent Application Publication May 29, 2008 Sheet 44 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`(Cancel|1 Great Photo(Send|
`
`
`To: Bob Adams
`C+)
`
`
`
`Cc: Darin Adler
`
`
`
`
`
`
`
`
`Subject:
`
`1 Great Photo
`
`1836
`Bob,
`This is a picture | took while visiting New York
`City.
`
`
`
`elwielRityuno
`atlelolebette
`¢Ecbee c
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 18H
`
`45
`
`45
`
`

`

`Patent Application Publication May 29, 2008 Sheet 45 of 302
`
`US 2008/0122796 Al
`
`Current Time 404
`
`‘ Cancel $1 Great Photo
`
`1808
`
`1814
`
`
`
`
`
`
`
`
`
`To: Bob Adams
`
`
`Cc: Darin Adler
`
`
`
`Subject: 1 Great Photo
`
`
`
`Bob,
`This is a picture | took while visiting New
`York City.
`
`
`
`
`
`110) / Save Draft
`
`
`wnDelete Message|
`e0n{ Edit Message |
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 181
`
`46
`
`46
`
`

`

`Patent Application Publication May 29, 2008 Sheet 46 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`1) 402
`
`Current Time 404
`
`
`
`All Contacts
`
`
`
`
`
`
`
`
`(First Name\Last Name)
`CAD
`Bob Adams«1816
`Darin Adler a 8209
`
`Darin Amon
`
`
`Kim Brook
`
` N<<S<CHNWOVOZZrFAC-LOamMmMUOUS
`
`
`
`Other Email
`
`
`Touch Screen 11
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 18J
`
`47
`
`47
`
`

`

`
`
`CA)
`Bob Adams «107
`Darin Adler
`
`
`A B C
`
`
`
`Patent Application Publication May 29, 2008 Sheet 47 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Speaker 111
`
`Optical
`Sensor 164
`
`Proximity
`Sensor 166
`
`1900A
`
`I) 402
`
`Current Time 404
`
`
`
`All Contacts
`
`
`
`
`
`( First Name YLast Name)
`
`c D E F G H | J K L M N O P QR s T U V
`
`
`
`Darin Amon
`
`
`
`
`Kim Brook
`
`
`v
`WwW
`
`x Y Z C
`
`Other Number
`ancel
`
`
`Touch Screen 112
`
`Microphone
`
`113
`
`( Home
`
`204
`
`Accelerometer(s)
`
`168
`
`Figure 19A
`
`48
`
`48
`
`

`

`Patent Application Publication May 29, 2008 Sheet 48 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Current Time 404
`
`
`1902
`
`This is whatit will look like when “Bob Adams”
`calls.
`Move andscale to adjust.
`
`
`
`
`
`
`
`
`
`Microphone
`413
`
`Accelerometer(s)
`168
`
`Figure 19B
`
`49
`
`49
`
`

`

`Patent Application Publication May 29, 2008 Sheet 49 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Current Time 404
`
`
`2002
`
`This is what the wallpaperwill looklike.
`Move and scale to adjust.
`
`
`
`
`
`
`
`
`
`Set
`Wallpaper
`
`2
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 20
`
`50
`
`50
`
`

`

`Patent Application Publication May 29, 2008 Sheet 50 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`
`
`
`
`Videos
`
`
`
`
`Playlists 121084
`
`Music Videos
`
`
`Podcasts
`
`
`TV Shows
`
`
`Movies
`
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 21A
`
`51
`
`51
`
`

`

`Patent Application Publication May 29, 2008 Sheet 51 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`
`
`My Movies
`
`‘27199
`
`
`
`
`
`Recently Added
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 21B
`
`52
`
`52
`
`

`

`Patent Application Publication May 29, 2008 Sheet 52 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`Current Time 404
`
`2106
`
`
`
`;
`My Movies
`Playlists
`
`
`
`
`
`
`
`
`Graphic
`
`
`
`King Kong
`
`3h 7m
`
`2112
`
`--
`
`
`
`Spiderman
`Graphic
`2h 15m
`
`
`
`Graphic
`
`Star Wars
`1h 55m
`
`
`
`
`
`
`
`113
`
`| Home
`204
`
`Accelerometer(s)
`168
`
`Figure 21C
`
`53
`
`53
`
`

`

`Patent Application Publication May 29, 2008 Sheet 53 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Current Time 404
`
`Settings
`
`
`(2202)
`Scale tofit
`
`
`
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 22A
`
`54
`
`54
`
`

`

`
`
`5 C
`
`ancel
`
`
`2210
`
`113
`
`| Home
`204
`
`Accelerometer(s)
`168
`
`Figure 22B
`
`55
`
`Patent Application Publication May 29, 2008 Sheet 54 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Current Time 404
`
`2204
`
`2208
`2206
`
`
`( Scale tofit ( Scale to full )
`
`
`
`55
`
`

`

`Patent Application Publication May 29, 2008 Sheet 55 of 302
`
`US 2008/0122796 Al
`
`206
`
`Speaker 111
`
`Optical
`Sensor 164
`
`Proximity
`Sensor 166
`
`
`
`Portable Multifunction Device
`100
`
`
`
`
`
`
`
`Sul}JUSIIND
`
`vOr
`
`Microphone
`113
`
`| Home
`204
`
`Accelerometer(s)
`168
`
`Figure 23A
`
`56
`
`56
`
`

`

`Patent Application Publication May 29, 2008 Sheet 56 of 302
`
`US 2008/0122796 Al
`
`206
`
`
`
`OLE?
`
`3s
`oF%
`
`‘per
`
`80
`
`Portable Multifunction Device
`100
`
`
`
`
`
`
`
`yOPSWI}JUBIND
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 23B
`
`o7
`
`57
`
`

`

`Patent Application Publication May 29, 2008 Sheet 57 of 302
`
`US 2008/0122796 Al
`
`206
`
`
`
`
`
`
`
`Portable Multifunction Device
`100
`
`
`
`
`
`
`
`vorSU]JUaLIND
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 23C
`
`58
`
`58
`
`

`

`Patent Application Publication May 29, 2008 Sheet 58 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`
`
`
`
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 23D
`
`59
`
`59
`
`

`

`Patent Application Publication May 29, 2008 Sheet 59 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`Optical
`Sensor 164
`
`Proximity
`Sensor 166
`
`
`
`Current Time 404
`
`Santa Cruz, CA
`
`H: 76° L: 58°
`
`swipe 2416
`
`
`
`66°
`
`
`
`
`
`
`
` -
`Monday
`x 72° 55
`Tuesday
`\-Wednesday x 15° 57°
`
`;
`
`|
`
`75°58°
`
`60
`78° 62°
`O
`240 cf)
`
`«4X
`
`xy
`Xf
`
`Thursday
`
`.F
`
`4 riday
`Saturday
`
`
`ri
`77°
`60°
`
`
`
`2/8
`
`2414-1 2414-2 2414-3 2414-4
`
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 24A
`
`60
`
`60
`
`

`

`Patent Application Publication May 29, 2008 Sheet 60 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`402
`
`Current Time 404
`
`
`
`City, State or Zip Code
`
`
`
`
`oe
`*
`e
`%
`© 2404
`*
`o
`* ew
`
`
`
`
`
`
`
`
`San Francisco, CA
`
`
`
`Cupertino, CA
`
`
`
`Santa Cruz, CA
`
`
`
`New York, NY
`
`Fahrenheit
`
`
`
`Remove
`
`Done
`
`2408
`2410
`
`
`2414-1
`
`
`
`14-3 2414-4414-2 2414-
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 24B
`
`61
`
`61
`
`

`

`Patent Application Publication May 29, 2008 Sheet 61 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`402
`
`Current Time 404
`
`
`
`
`
`
`
`City, State or Zip Code
`
`
`Rutl|
`
`
`
`San Francisco, CA
`
`
`
`Cupertino, CA
`
`
`
`
` 616
`
`
`
`
`(Rut!) (Rutland, VT) (Rutland, MA ) sz
`CUGCUCOCOG
`GEUUCOCUG
`i ‘z|x\e]y BIN
`
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 24C
`
`62
`
`62
`
`

`

`
`
`(1) New York, NY
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 24D
`
`63
`
`Patent Application Publication May 29, 2008 Sheet 62 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`Current Time 404
`
`@> 406
`
`|
`
`Weather
`
`—_|_— Done
`
`
`
`
`
`(=) San Francisco, CA
`
`(=) Cupertino, CA
`(-) Santa Cruz, CA
`
`
`
`
`
`63
`
`

`

`Patent Application Publication May 29, 2008 Sheet 63 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`Cupertino, CA
`
`H: 76° L: 58°
`
`{6O
`
`swipe 2416
`
`
`18° 68°
`
`77° 67
`
`79° 64°
`
`
`78° 68°
`
`
`
`
`
`79° 66°
`
`80° 67°
`
`2414-1 2414-2 2414-3 2414-4
`
`e
`
`Z|
`
`aon
`
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 24E
`
`64
`
`64
`
`

`

`Patent Application Publication May 29, 2008 Sheet 64 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`
`
`Current Time 404
`
`
`
`
`11240.35—-2.242501}
`
`
`
`
`
`
`
`
`
`-1.29
`68.30
`
`
`-.14
`29.90
`
`
`-1.61
`373.78
`GOOG)
`
`
`INTC
`
`17.49
`
`+.16
`
`
`
`1d 1w 1m 3m 6m ‘1y 2y
`
`ANN
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 25A
`
`65
`
`65
`
`

`

`Patent Application Publication May 29, 2008 Sheet 65 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`
`
`
`-.01%
`11240.35
`
`
`
`
`
`
`
`
`-1.85%
`68.30
`
`
`-.46%
`29.90
`
`
`-42%
`GOOG 373.78
`
`
`INTC
`
`17.49
`
`+.92%
`
`
`
`1d 1w 1m 3m 6m 1y 2y
`
`AVN
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 25B
`
`66
`
`66
`
`

`

`Patent Application Publication May 29, 2008 Sheet 66 of 302
`
`US 2008/0122796 Al
`
`@> 406
`Current Time 404
`
`
`
`
`+
`
`
`
`
`
`
`
`
`
`
`
`
`Dow JonesInd. Avg. 2510
`
`
`
`Apple Computer
`
`
`
`Walt Disney Company
`
`
`
`Google, Inc.
`
`Intel
`
`
`
`
`
`Remove
`
`2512
`
`Microphone
`113
`
`| Home
`204
`
`Accelerometer(s)
`168
`
`Figure 25C
`
`67
`
`67
`
`

`

`Patent Application Publication May 29, 2008 Sheet 67 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`100
`
`
`
`
`
`
`
`
`
`INDU
`
`Dow JonesInd. Avg.
`
`
`
`AAPL
`
`Apple Computer
`
`
`
`DIS
`
`Yo Up
`
`
`
`
`
`Walt Disney Company
`
`
`
`eiwielejrrere
`rLeltele
`Zlxtelvytelnt™
`
`A|S/|D
`
`
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 25D
`
`68
`
`68
`
`

`

`Current Time 404 208
`
`
`
`
`
`Walt Disney Company
`
`
`
`Google, Inc.
`
`Intel
`
`Patent Application Publication May 29, 2008 Sheet 68 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`100
`
`2500E
`
`Speaker 111
`
`Optical
`Sensor 164
`
`Proximity
`Sensor 166
`
` 208
`
`
`
`
`
`
`
`
`
`
`
`Dow JonesInd. Avg. 2510
`
`
`
`Apple Computer
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 25E
`
`69
`
`69
`
`

`

`
` NX&S<qCHMDWOVOZZR-AC—-TOMmMVODTY
`
`Kim Brook
`
`
`
`Favorites
`
`Recent
`
`Contacts
`
`aw
`
`Voice Mail
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 26A
`
`70
`
`Patent Application Publication May 29, 2008 Sheet 69 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`
`
`Current Time 404
`
`
`All Contacts
`
`
`
`
`Bob Adams
`
`Darin Adler
`
`
`Darin Amon
`2602
`CB)
`
`
`
`' :5 V
`
`70
`
`

`

`Patent Application Publication May 29, 2008 Sheet 70 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`402
`
`Current Time 404
`
`Enter a name for this contact
`
`New Contact
`
`
`
`
` First Name Last Name
`‘Company
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Microphone
`413
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 26B
`
`71
`
`71
`
`

`

`Patent Application Publication May 29, 2008 Sheet 71 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`Current Time 404
`
`
`
`Enter a name for this contact
`
`New Contact
`
`
`
`2606
`
`
`
`
`
`
`
`|
`(Smith
`|
`(Company
`owele\r|yujilelr
`s[slolelelo(ele
`
`
`
`
`
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 26C
`
`72
`
`72
`
`

`

`Patent Application Publication May 29, 2008 Sheet 72 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`
`
`All Contacts
`
`Info
`
`Current Time 404
`
`
`
`Add
`Photo
`
`2607
`
`Ron Smith
`
`
`
`
`
`
`
`
`
`
`
`(
`
`Delete Card
`
`}
`
`vy © ||2oo
`
`Favorites
`
`Recent
`
`i
`
`Voice Mail
`
`
`
`Microphone ( home(Acesteroreters))
`
`113
`
`204
`
`Figure 26D
`
`73
`
`7
`
`
`
`
`
`
`
`
`2608+ Add New Phone >
`Yb Add New Email
`>
`2611Yb Add New URL
`2612Yb Add New Address >
`
`73
`
`

`

`Patent Application Publication May 29, 2008 Sheet 73 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`
`Current Time 404
`
`
`
`Info
`
`
`
`Ron Smith
`
`
`
`
`
`
`
`os Add New Phone
`Yeh) (Add New Email
`xz
`(
`Take Photo
`‘Choose Existing Photo}*”
`(
`Cancel
`—|
`w ©
`Qo
`
`
`
`
`
`
`
`
`
`
`
`
`
`Favorites
`
`Recent
`
`i
`
`Voice Mail
`
`Microphone
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 26E
`
`74
`
`74
`
`

`

`Patent Application Publication May 29, 2008 Sheet 74 of 302
`
`US 2008/0122796 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Current Time 404
`
`
`
`Edit Phone
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Microphone
`
`113
`
`(Home
`
`204
`
`Accelerometer(s)
`
`168
`
`Figure 26F
`
`15
`
`75
`
`

`

`Patent Application Publication May 29, 2008 Sheet 75 of 302
`
`US 2008/0122796 Al
`
`Portable Multifunction Device
`100
`
`
`
`Current Time 404
`
`@> 406
`
`2630
`Label
`Edit Phone
`
`
`
`
`r mobile
`
`Add Custom Label 2628 Microphone
`
`pager
`
`
`| h
`
`
`
`ome Jf
`
`work
`
`main
`
`Home fax
`
`Work fax
`
`
`other
`
`
`
`preferred
`
`113
`
`Home
`204
`
`Accelerometer(s)
`168
`
`Figure 26G
`
`76
`
`76
`
`

`

`Patent Application Publicatio