as) United States
`a2) Patent Application Publication 10) Pub. No.: US 2008/0168405 Al
`(43) Pub. Date: Jul. 10, 2008
`
`Tolmasky et al.
`
`US 2008016840SA1
`
`(54) PORTABLE MULTIFUNCTION DEVICE,
`METHOD, AND GRAPHICAL USER
`INTERFACE FOR TRANSLATING
`DISPLAYED CONTENT
`
`(76)
`
`Inventors:
`
`Francisco Ryan Tolmasky,
`Cupertino, CA (US); Richard
`Williamson, Los Gatos, CA (US);
`Chris Blumenberg, San Francisco,
`CA (US); Patrick Lee Coffman,
`Menlo Park, CA (US)
`
`Correspondence Address:
`MORGAN LEWIS & BOCKIUS LLP/ APPLE
`INC.
`2 PALO ALTO SQUARE, 3000 EL CAMINO
`REAL
`PALO ALTO, CA 94306
`
`(21) Appl. No.:
`
`11/960,675
`
`(22)
`
`Filed:
`
`Dec. 19, 2007
`
`Related U.S. Application Data
`
`(60) Provisional application No. 60/937,993, filed on Jun.
`29, 2007, provisional application No. 60/946,976,
`
`filed on Jun. 28, 2007, provisional application No.
`60/879,469, filed on Jan. 8, 2007, provisional applica-
`tion No. 60/879,253, filed on Jan. 7, 2007.
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`(2006.01)
`GO6F 3/033
`(52) US. CMe coeccccccssssssssssssssssvseseesessessssasisssssenes 715/863
`
`(57)
`
`ABSTRACT
`
`A computer-implemented method, for use in conjunction
`with a portable multifunction device with a touch screen
`display, comprises displaying a portion of page content,
`including a frame displaying a portion of frame content and
`also including other content of the page, on the touch screen
`display. An N-finger translation gesture is detected on or near
`the touch screen display. In response,
`the page content,
`including the displayed portion of the frame content and the
`other content of the page, is translated to display a new por-
`tion of page content on the touch screen display. An M-finger
`translation gesture is detected on or near the touch screen
`display, where M is a different numberthan N.In response,
`the frame content is translated to display a new portion of
`frame content on the touch screen display, withouttranslating
`the other content of the page.
`
`60
`
`Display a portion of page content on a touch screen display of a portable
`multifunction device. The portion of page content includes: (1) a frame
`displaying a portion of frame content, and (2) other content of the page.
`
`6002
`
`6004
`
`Detect an N-finger translation gesture on or near the touch screen display.
`
` 6006
`
`
`In responseto detecting the N-finger translation gesture, translate the
`page content, including the displayed portion of the frame content and the
`other content of the page, to display a new portion of page content on the
`touch screen display.
`
`Detect an M-finger translation gesture on or near the touch screen
`display, where M is a different numberthan N.
`
`6008
`
`a 6010
`
`In responseto detecting the M-finger translation gesture, translate the
`frame content to display a new portion of frame content on the touch
`screen display, without translating the other content of the page.
`
`
`APPLE-1044
`
`1
`
`APPLE-1044
`
`

`

`Patent Application Publication
`
`Jul. 10, 2008 Sheet 1 of 10
`
`US 2008/0168405 Al
`
`Portable Multifunction Device
`100
`
`Memory
`102
`-
`Operating System
`Communication Module
`Contact/Motion Module
`
`Graphics Module
`Text Input Module
`GPS Module
`
`ontacts Module
`
`elephone Module
`
`-mail Client Module
`nstant Messaging Module
`
`126
`128
`92
`
`-
`——
`Applications (continued)
`Calendar Module
`Widget Modules
`
`
`
`her Widget
`149-2
`134
`Stocks Widget
`149-3
`435
`Calculator Widget
`449-4
`136
`Alarm Clock Widget
`149-5
`437
`Dictionary Widget
`138
`P:oCSCiz 149-6
`139
`440 eees)
`450
`sat
`442
`
`136
`148
`149
`149-1
`
`tet
`
`162
`
`[CameraModule
`Camera Module
`Power
`14a
`mage Management Module
`System
`145
`-
`
`
`VideoPlayerModule|
`Video Player Module
`146
`-
`24
`Music Player Module
`44
`External
`1
`
`
`MusicPlayerModule|
`7
`Port
`
`BrowsingModule
`Browsing Module
`103
`118
`5
`103
`RF Circuitry
`Cy
`108
`1
`103 —uqio iCircuitry
`
`Search Module 143
`-Y) ControllerI
`
`Speaker
`111
`
`Peripherals
`Interface
`
`110
`
`103
`
`103
`
`Proximity
`Sensor
`
`Microphone
`113
`166
`
`
`
`r—™ Accelerometer(s)
`168
`m~103
`——
`
`
`/O Subsystem
`158
`
`Optical
`OtherInput
`Display
`
`
`
`sensor(s)
`
`Controller(s)
`Controller
`Controller
`
`
`103
`
`103
`
`103
`
`Devices
`
`Touch-Sensitive
`Display System
`
`OtherInput
`Control
`
`Optical
`Sensor(s)
`164
`
`Figure 1A
`
`160
`
`116
`
`104
`
`122
`
`120
`
`106
`
`156
`
`112
`
`2
`
`

`

`Patent Application Publication
`
`Jul. 10, 2008 Sheet 2 of 10
`
`US 2008/0168405 Al
`
`126
`
`Portable Multifunction Device
`100
`136
`Applications (continued)
`148
`Calendar Module
`4149
`i
`449-41
`449-2
`149-3
`449-4
`4149-5
`
`Memory 102
`Operating System
`Communication Module
`Contact/Motion Module
`Graphics Module
`Text Input Module
`Weather Widget(s)
`GPS Module
`Stocks Widget
`
`icati
`Calculator Widget
`Contacts Module
`Alarm Clock Widget
`Telephone Module
`Dictionary Widget
`Video Conference Module PS 149-6
`E-mail Client Module
`User-Created Widget(s)
`450
`Instant Messaging Module
`Widget Creator Module
`451
`Blogging Module
`Search Module
`Camera Module
`Image Management Module
`
`
`
`ower
`System
`
`162
`
`4
`152
`153
`154
`147
`118
`
`Notes Module
`Map Module
`Browsing Module
`
`104
`122
`
`403
`Control
`ontroler
`
`
`
`Port
`103
`40
`VY
`i
`
`Peripherals
`Interface
`
`103
`
`103
`
`124
`
`Speaker
`411
`
`RF Circuitry
`108
`reuit i
`Circuitry
`410
`Fx)
`Microphone
`113
`166
`
`Sensor
`
`120
`
`Processor(s)
`
`106
`
`
`— Accelerometer(s)
`1
`103
`188
`
`VO Subsystem
`158
`
`Optical
`
`
`
`
`Display
`sensor(s)
`OtherInput
`Controller
`Controller(s)
`
`
`Controller
`
`156—“|
`
`103
`
`103
`
`Touch-Sensitive
`
`Senson(s)
`
`Display System 164
`
`103
`
`
`
`ornerneut
`
`Devices
`
`112
`
`Figure 1B
`
`160
`
`116
`
`3
`
`

`

`Patent Application Publication
`
`Jul. 10, 2008 Sheet 3 of 10
`
`US 2008/0168405 Al
`
`Portable Multifunction Device 100
`SIM Card Slot 210
`
`Speaker 111
`
`Optical
`plica
`Sensor 164
`
`Proximit
`roximity
`Sensor 166
`
`212
`
`\_
`
`head:
`“ phone
`jack
`
`206
`
`200
`
`co
`SI
`
`Cc
`oS
`N
`
`
`
`202
`
`Touch Screen 11
`
`Microphone)/ Home \ Accelerometer(s)
`
`13°). 204 |
`168
`
`External Port 124
`
`Figure 2
`
`4
`
`4
`
`

`

`Patent Application Publication
`
`Jul. 10, 2008 Sheet 4 of 10
`
`US 2008/0168405 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`Current Time » 308
`310“ Day and Date~ 312
`
`Wallpaper image
`314
`
`
`
`Slide to unlock
`
`(es
`
`{Merrnone|(“Home:\(Acceleroeter(s){Merrnone|204)(Acceleroeter(s)
`
`Touch Screen 112
`
`Figure 3
`
`5
`
`

`

`Patent Application Publication
`
`Jul. 10, 2008 Sheet 5 of 10
`
`US 2008/0168405 Al
`
`Portable Multifunction Device
`
`
`
`
`
`
`Q@O@e
`
`
`Photos
`Camera
`Videos
`144
`143
`145
`
`75°
`
`Weather
`149-1
`
`Jan
`
`15
`
`Stocks
`149-2
`
`Blog
`142
`
`Calendar
`148
`
`oSUser
`ABC
`
`ZY Figure 4A
`
`Music
`146
`
`Touch Screen 112
`
`Calculator
`149-3
`
`Alarm
`149-4
`
`Dictionary
`149-5
`
`/
`
`| Created
`
`\
`
`Widget_/
`Widget
`149-6
`
`Microphone
`113
`
`( Home \
`\ 204 |
`NO
`
`Accelerometer(s)
`168
`
`6
`
`

`

`Patent Application Publication
`
`Jul. 10, 2008 Sheet 6 of 10
`
`US 2008/0168405 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`
`
`
`
`Calendar
`148
`
`Photos
`144
`
`Calculator
`149-3
`
`Stocks
`149-2
`
`154
`
`Weather
`149-1
`
`\ (sea
`
`
`
` f“
`
`
`
`
`
`os
`
`Lf CO ™ \
`
`Browser
`147
`
`iPod
`152
`
`/
`
`U
`
`Touch Screen 112
`
`{Mererone|(“Home»[Accelerometers){Mererone|204)[Accelerometers)
`
`Figure 4B
`
`7
`
`

`

`Patent Application Publication
`
`Jul. 10, 2008 Sheet 7 of 10
`
`US 2008/0168405 Al
`
`206
`
`Portable Multifunction Device
`100
`
`Z| 402
`
`Current Time 404
`
` -++- http:/Awww.company.com/start
`
`w 4
`
`3920
`
`fo 4204
`
`
`
`
`
`
`
`N.
`
`
`
`™
`
`Microphone
`113
`
`( Home \
`, 204 |
`
`Accelerometer(s)
`168
`
`Figure 5A
`
`8
`
`

`

`Patent Application Publication
`
`Jul. 10, 2008 Sheet 8 of 10
`
`US 2008/0168405 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`_\ 402
`Current Time 404
`+ http:/Awww.company.com/start
`
`3920
`
`ps iSiO
`
`psS=a iO
`
`i) — So
`
`aree
`ee
`
`N
`
`
`
`
`
`Microphone
`113
`
`( Home \
`| 204
`|
`_ 204 ,Jf
`a
`
`Accelerometer(s)
`168
`
`Figure 5B
`
`9
`
`

`

`Patent Application Publication
`
`Jul. 10, 2008 Sheet 9 of 10
`
`US 2008/0168405 Al
`
`Portable Multifunction Device
`100
`
`
`| 402 Current Time 404
`-+- http://www.company.com/start
`
`
`
`5
`
`168
`
`3920
`
`fo 4204
`
`ww
`
`4
`
`
`
`aa
`
`Microphone
`
`113
`
`( Home \
`
`\ 204 |
`
`Accelerometer(s)
`
`Figure 5C
`
`10
`
`10
`
`

`

`Patent Application Publication
`
`Jul. 10, 2008 Sheet 10 of 10
`
`US 2008/0168405 Al
`
`6000
`
`
`
`Display a portion of page content on a touch screen display of a portable
`multifunction device. The portion of page content includes: (1) a frame
`displaying a portion of frame content, and (2) other content of the page.
`
`Detect an N-finger translation gesture on or near the touch screen display.
`
`In responseto detecting the N-finger translation gesture, translate the
`page content, including the displayed portion of the frame content and the
`other content of the page, to display a new portion of page content on the
`touch screen display.
`
`
`
`screen display, without translating the other content of the page.
`
`Detect an M-finger translation gesture on or near the touch screen
`display, where M is a different number than N.
`
`In response to detecting the M-finger translation gesture, translate the
`frame content to display a new portion of frame content on the touch
`
`6002
`
`6004
`
`6006
`
`6008
`
`6010
`
`Figure 6
`
`11
`
`11
`
`

`

`US 2008/0168405 Al
`
`Jul. 10, 2008
`
`PORTABLE MULTIFUNCTION DEVICE,
`METHOD, AND GRAPHICAL USER
`INTERFACE FOR TRANSLATING
`DISPLAYED CONTENT
`
`RELATED APPLICATIONS
`
`[0001] This application claimspriority to U.S. Provisional
`Patent Application Nos. 60/937,993, “Portable Multifunction
`Device,” filed Jun. 29, 2007; 60/946,976, “Portable Multi-
`function Device, Method, and Graphical User Interface for
`Translating Displayed Content,” filed Jun. 28, 2007; 60/879,
`469, “Portable Multifunction Device,” filed Jan. 8, 2007;
`60/879,253, and “Portable Multifunction Device,’filed Jan.
`7, 2007. All of these applications are incorporated by refer-
`ence herein in their entirety.
`[0002] This application is related to the following applica-
`tions: (1) U.S. patent application Ser. No. 10/188, 182, “Touch
`Pad For Handheld Device,”filed Jul. 1, 2002; (2) U.S. patent
`application Ser. No. 10/722,948, “Touch Pad For Handheld
`Device,” filed Nov. 25, 2003; (3) U.S. patent application Ser.
`No. 10/643,256, “Movable Touch Pad With Added Function-
`ality,”filed Aug. 18, 2003; (4) U.S. patent application Ser. No.
`10/654,108, “Ambidextrous Mouse,”filed Sep. 2, 2003; (5)
`USS. patent application Ser. No. 10/840,862, “Multipoint
`Touchscreen,” filed May 6, 2004; (6) U.S. patent application
`Ser. No. 10/903,964, “Gestures For Touch Sensitive Input
`Devices,” filed Jul. 30, 2004; (7) U.S. patent application Ser.
`No. 11/038,590, “Mode-Based Graphical UserInterfaces For
`Touch Sensitive Input Devices”filed Jan. 18, 2005; (8) U.S.
`patent application Ser. No. 11/057,050, “Display Actuator,”
`filed Feb. 11, 2005; (9) U.S. Provisional Patent Application
`No. 60/658,777, “Multi-Functional Hand-Held Device,”filed
`Mar. 4, 2005; (10) U.S. patent application Ser. No. 11/367,
`749, “Multi-Functional Hand-Held Device,” filed Mar. 3,
`2006; and (11) U.S. Provisional Patent Application No.
`60/824,769, “Portable Multifunction Device,”filed Sep. 6,
`2006. All of these applications are incorporated by reference
`herein in their entirety.
`
`TECHNICAL FIELD
`
`[0003] The disclosed embodiments relate generally to por-
`table electronic devices, and moreparticularly, to portable
`devices that
`translate displayed content
`in response to
`detected finger gestures.
`
`BACKGROUND
`
`[0004] As portable electronic devices become more com-
`pact, and the number of functions performed by a given
`device increase,
`it has become a significant challenge to
`design a userinterface that allows users to easily interact with
`a multifunction device. This challenge is particular signifi-
`cant for handheld portable devices, which have much smaller
`screens than desktop or laptop computers. This situation is
`unfortunate becausethe user interface is the gateway through
`which users receive not only content but also responses to
`user actions or behaviors, including user attempts to access a
`device’s features, tools, and functions. Some portable com-
`munication devices (e.g., mobile telephones, sometimes
`called mobile phones, cell phones, cellular telephones, and
`the like) have resorted to adding more pushbuttons, increas-
`ing the density of push buttons, overloading the functions of
`pushbuttons, or using complex menu systemsto allow a user
`to access, store and manipulate data. These conventional user
`
`interfaces often result in complicated key sequences and
`menuhierarchies that must be memorized bythe user.
`[0005] Many conventional user interfaces, such as those
`that include physical pushbuttons, are also inflexible. This is
`unfortunate because it may prevent a user interface from
`being configured and/or adaptedby either an application run-
`ning on the portable device or by users. When coupled with
`the time consuming requirement to memorize multiple key
`sequences and menuhierarchies, and thedifficulty in activat-
`ing a desired pushbutton, such inflexibility is frustrating to
`most users.
`
`[0006] An example of the inflexibility of many conven-
`tional user interfaces is the difficulty of using touch screen
`interfaces on portable devicesto translate displayed content,
`particularly displayed contentthat includes a framedisplay-
`ing a portion of content and also includes other content out-
`side of the frame. Sometimes a user may desire to translate
`only the displayed portion of content in the frame, without
`translating the other contentoutside ofthe frame. Other times
`a user maydesire to translate both content in the frame and
`content outside ofthe frame. Conventional touch screen inter-
`
`faces lack a user-friendly method of distinguishing between
`these two operations.
`[0007] Accordingly, there is a need for portable multifunc-
`tion devices with more transparent and intuitive user inter-
`faces for translating displayed content in accordance with a
`user’s intentions that are easy to use, configure, and/or adapt.
`Suchinterfaces increase the effectiveness, efficiency and user
`satisfaction with portable multifunction devices.
`
`SUMMARY
`
`[0008] The above deficiencies and other problemsassoci-
`ated with user interfaces for portable devices are reduced or
`eliminated by the disclosed portable multifunction device. In
`some embodiments, the device has a touch-sensitive display
`(also knownas a “touch screen’) with a graphicaluserinter-
`face (GUD), one or more processors, memory and one or more
`modules, programs or sets of instructions stored in the
`memory for performing multiple functions. In some embodi-
`ments, the user interacts with the GUI primarily through
`finger contacts and gestures on the touch-sensitive display. In
`some embodiments, the functions may include telephoning,
`video conferencing, e-mailing, instant messaging, blogging,
`digital photographing, digital videoing, web browsing,digi-
`tal music playing, and/or digital video playing. Instructions
`for performing these functions may be included in a computer
`program product configured for execution by one or more
`processors.
`[0009]
`In one aspect of the invention, a computer-imple-
`mented method, for use in conjunction with a portable mul-
`tifunction device with a touch screen display, comprises dis-
`playing a portion of page content on the touch screen display.
`The portion of page content includes a frame displaying a
`portion offrame contentandalso includes other contentofthe
`page. The method further comprises detecting an N-finger
`translation gesture on or near the touch screen display, and, in
`response to detecting the N-finger translation gesture, trans-
`lating the page content to display a new portion of page
`content on the touch screen display, wherein translating the
`page content includestranslating the displayed portion of the
`frame content and the other content ofthe page. Additionally,
`the method comprises detecting an M-finger translation ges-
`ture on or near the touch screen display, where M is a different
`numberthan N,and, in response to detecting the M-finger
`
`12
`
`12
`
`

`

`US 2008/0168405 Al
`
`Jul. 10, 2008
`
`translation gesture, translating the frame contentto display a
`new portion of frame content on the touch screen display,
`withouttranslating the other content of the page.
`[0010]
`In another aspect of the invention, a graphical user
`interface on a portable multifunction device with a touch
`screen display comprises a portion of page content on the
`touch screen display. The portion of page content includes a
`framedisplaying a portion of frame content and also includes
`other content ofthe page. In responseto detecting an N-finger
`translation gesture on or near the touch screen display, the
`page contentis translated to display a new portion of page
`content on the touch screen display, wherein translating the
`page content includes translating the other content of the
`page. In response to detecting an M-fingertranslation gesture
`on or near the touch screen display, where M is a different
`numberthan N, the frame content is translated to display a
`new portion of frame content on the touch screen display,
`withouttranslating the other content of the page.
`[0011]
`In another aspect of the invention, a portable multi-
`function device comprises a touch screen display, one or more
`processors, memory, and one or more programs. The one or
`more programsare stored in the memory and configured to be
`executed by the one or more processors. The one or more
`programsincludeinstructionsfor displaying a portion ofpage
`content on the touch screen display. The portion of page
`content includes a frame displaying a portion of frame con-
`tent and also includes other content of the page. The one or
`more programs also include instructions for detecting an
`N-finger translation gesture on or near the touch screen dis-
`play; instructionsfor translating the page content, in response
`to detecting the N-finger translation gesture, to display a new
`portion of page content on the touch screen display, wherein
`the instructions for translating the page content
`include
`instructions for translating the displayed portion ofthe frame
`content and the other content of the page; instructions for
`detecting an M-finger translation gesture on or near the touch
`screen display, where M is a different number than N; and
`instructions for translating the frame content, in response to
`detecting the M-finger translation gesture, to display a new
`portion of frame content on the touch screen display, without
`translating the other content of the page.
`[0012]
`In another aspect of the invention, a computer read-
`able storage medium stores
`instructions, which when
`executed by a portable multifunction device with a touch
`screen display, cause the device to display a portion of page
`content on the touch screen display. The portion of page
`content includes a frame displaying a portion of frame con-
`tent and also includes other content of the page. The instruc-
`tions also cause the device to detect an N-finger translation
`gesture on or near the touch screen display andto translate the
`page content, in response to detecting the N-fingertranslation
`to display a new portion of page content on the touch screen
`display, wherein translating the page content includestrans-
`lating the displayed portion ofthe frame content and the other
`content of the page. The instructions further cause the device
`to detect an M-finger translation gesture on or near the touch
`screen display, where M is a different numberthan N, and to
`translate the frame content,
`in response to detecting the
`M-finger translation gesture, to display a new portion of
`frame content on the touch screen display, withouttranslating
`the other content of the page.
`[0013]
`In another aspect of the invention, a portable multi-
`function device with a touch screen display comprises means
`for displaying a portion of page content on the touch screen
`
`display. The portion ofpage content includes a frame display-
`ing a portion of frame content and also includes other content
`ofthe page. The device also comprises meansfor detecting an
`N-finger translation gesture on or near the touch screen dis-
`play and meansfor translating the page content, in response to
`detecting the N-finger translation gesture, to display a new
`portion of page content on the touch screen display, wherein
`the meansfor translating the page content include meansfor
`translating the displayed portion of the frame content and the
`other content ofthe page. The device further comprises means
`for detecting an M-finger translation gesture on or near the
`touch screen display, where M is a different number than N,
`and meansfor translating the frame content, in response to
`detecting the M-finger translation gesture, to display a new
`portion of frame content on the touch screen display, without
`translating the other content of the page.
`[0014] The disclosed embodiments thus allow users to eas-
`ily translate page content or just translate frame content
`within the page content, depending on the numberoffingers
`usedin the gesture.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`For a better understanding of the aforementioned
`[0015]
`embodiments of the invention as well as additional embodi-
`ments thereof, reference should be madeto the Description of
`Embodiments below,in conjunction with the following draw-
`ings in which like reference numerals refer to corresponding
`parts throughoutthe figures.
`[0016]
`FIGS. 1A and 1B are block diagrams illustrating
`portable multifunction devices with touch-sensitive displays
`in accordance with some embodiments.
`
`FIG. 2 illustrates a portable multifunction device
`[0017]
`having a touch screen in accordance with some embodiments.
`[0018]
`FIG. 3 illustrates an exemplary user interface for
`unlocking a portable electronic device in accordance with
`some embodiments.
`
`FIGS. 4A and 4Billustrate exemplary user inter-
`[0019]
`faces for a menu ofapplications on a portable multifunction
`device in accordance with some embodiments.
`
`FIGS. 5A-5C illustrate exemplary user interfaces
`[0020]
`for translating page content or translating just frame content
`within the page content in accordance with some embodi-
`ments.
`
`FIG.6 is a flow diagram illustrating a process for
`[0021]
`translating content in accordance with some embodiments.
`
`DESCRIPTION OF EMBODIMENTS
`
`[0022] Reference will now be madein detail to embodi-
`ments, examples ofwhichare illustrated in the accompanying
`drawings. In the following detailed description, numerous
`specific details are set forth in order to provide a thorough
`understanding of the present invention. However, it will be
`apparent to one of ordinary skill in the art that the present
`invention may bepracticed without these specific details. In
`other instances, well-known methods, procedures, compo-
`nents, circuits, and networks have not been described in detail
`so as not to unnecessarily obscure aspects of the embodi-
`ments.
`
`It will also be understood that, although the terms
`[0023]
`first, second, etc. may be used herein to describe various
`elements, these elements should not be limited by these
`terms. These terms are only used to distinguish one element
`from another. For example,a first gesture could be termed a
`
`13
`
`13
`
`

`

`US 2008/0168405 Al
`
`Jul. 10, 2008
`
`second gesture, and, similarly, a second gesture could be
`termed a first gesture, without departing from the scope ofthe
`present invention.
`[0024] The terminology used in the description of the
`invention herein is for the purpose of describing particular
`embodiments only and is not intended to be limiting of the
`invention. As used in the description of the invention and the
`appendedclaims, the singular forms “a”, “an” and “the” are
`intended to include the plural formsas well, unless the con-
`text clearly indicates otherwise. It will also be understood that
`the term “and/or” as used herein refers to and encompasses
`any and all possible combinations of one or more of the
`associated listed items. It will be further understood that the
`terms “comprises” and/or “comprising,” when used in this
`specification, specify the presenceof stated features, integers,
`steps, operations, elements, and/or components, but do not
`preclude the presence or addition of one or more other fea-
`tures, integers, steps, operations, elements, components, and/
`or groups thereof.
`[0025] Embodiments of a portable multifunction device,
`user interfaces for such devices, and associated processes for
`using such devices are described. In some embodiments, the
`device is a portable communications device such as a mobile
`telephone that also contains other functions, such as PDA
`and/or music player functions.
`[0026] The user interface may include a physical click
`wheel in addition to a touch screen or a virtual click wheel
`
`displayed on the touch screen. A click wheel is a user-inter-
`face device that may provide navigation commands based on
`an angular displacement of the wheel or a point of contact
`with the wheelby a user ofthe device. A click wheel mayalso
`be used to provide a user commandcorresponding to selec-
`tion of one or more items, for example, whenthe user of the
`device presses downonat least a portion of the wheelor the
`center of the wheel. Alternatively, breaking contact with a
`click wheel image on a touch screen surface may indicate a
`user commandcorrespondingto selection. For simplicity, in
`the discussion that follows, a portable multifunction device
`that includes a touch screen is used as an exemplary embodi-
`ment. It should be understood, however, that some of the user
`interfaces and associated processes may be applied to other
`devices, such as personal computers and laptop computers,
`that may include one or more other physical user-interface
`devices, such as a physical click wheel, a physical keyboard,
`a mouse and/or a joystick.
`[0027] The device supports a variety of applications, such
`as a telephoneapplication, a video conferencing application,
`an e-mail application, an instant messaging application, a
`blogging application, a digital camera application, a digital
`video camera application, a web browsing application, a digi-
`tal music player application, and/or a digital video player
`application.
`[0028] The various applications that may be executed on
`the device may useat least one commonphysical user-inter-
`face device, such as the touch screen. One or more functions
`of the touch screen as well as corresponding information
`displayed on the device may be adjusted and/or varied from
`one application to the next and/or within a respective appli-
`cation. In this way, acommonphysical architecture (such as
`the touch screen) of the device may support the variety of
`applications with user interfaces that are intuitive andtrans-
`parent.
`[0029] The user interfaces may include one or moresoft
`keyboard embodiments. The soft keyboard embodiments
`
`may include standard (QWERTY)and/or non-standard con-
`figurations of symbols on the displayed iconsofthe keyboard,
`such as those described in U.S. patent application Ser. Nos.
`11/459,606, “Keyboards For Portable Electronic Devices,”
`filed Jul. 24, 2006, and 11/459,615, “Touch Screen Key-
`boards For Portable Electronic Devices,”filed Jul. 24, 2006,
`the contents of which are hereby incorporated by reference in
`their entirety. The keyboard embodiments may include a
`reduced numberof icons(or soft keys) relative to the number
`of keys in existing physical keyboards, such as that for a
`typewriter. This may makeit easier for users to select one or
`more icons in the keyboard, and thus, one or more corre-
`sponding symbols. The keyboard embodiments may be adap-
`tive. For example, displayed icons may be modified in accor-
`dance with user actions, such as selecting one or more icons
`and/or one or more corresponding symbols. One or more
`applications on the portable device may utilize common and/
`or different keyboard embodiments. Thus,
`the keyboard
`embodiment used maybe tailored to at least some of the
`applications. In some embodiments, one or more keyboard
`embodiments may be tailored to a respective user. For
`example, one or more keyboard embodiments maybetailored
`to a respective user based on a word usagehistory (lexicog-
`raphy,slang, individual usage) ofthe respective user. Some of
`the keyboard embodiments maybe adjustedto reduce a prob-
`ability of a user error when selecting one or more icons, and
`thus one or more symbols, when using the soft keyboard
`embodiments.
`
`[0030] Attention is now directed towards embodiments of
`the device. FIGS. 1A and 1B are block diagramsillustrating
`portable multifunction devices 100 with touch-sensitive dis-
`plays 112 in accordance with some embodiments. The touch-
`sensitive display 112 is sometimescalled a “touch screen”for
`convenience, and may also be knownasorcalled a touch-
`sensitive display system. The device 100 may include a
`memory 102 (which may include one or more computer read-
`able storage mediums), amemory controller 122, one or more
`processing units (CPU’s) 120, a peripherals interface 118, RF
`circuitry 108, audio circuitry 110, a speaker 111, a micro-
`phone 113, an input/output (I/O) subsystem 106, other input
`or control devices 116, and an external port 124. The device
`100 may include one or more optical sensors 164. These
`components may communicate over one or more communi-
`cation busesor signal lines 103.
`[0031]
`It should be appreciated that the device 100 is only
`one example of a portable multifunction device 100, and that
`the device 100 may have more or fewer components than
`shown, may combine two or more components, or a may have
`a different configuration or arrangement of the components.
`The various components shown in FIGS. 1A and 1B may be
`implementedin hardware, software or a combination of both
`hardware and software, including one or more signal process-
`ing and/or application specific integrated circuits.
`[0032] Memory 102 may include high-speed random
`access memory and mayalso include non-volatile memory,
`such as one or more magnetic disk storage devices, flash
`memory devices, or other non-volatile solid-state memory
`devices. Access to memory 102 by other components of the
`device 100, such as the CPU 120 andthe peripherals interface
`118, may be controlled by the memory controller 122.
`[0033] The peripherals interface 118 couples the input and
`output peripherals of the device to the CPU 120 and memory
`102. The one or more processors 120 run or execute various
`
`14
`
`14
`
`

`

`US 2008/0168405 Al
`
`Jul. 10, 2008
`
`software programs and/or sets of instructions stored in
`memory 102 to perform various functions for the device 100
`and to process data.
`the peripherals interface
`[0034]
`In some embodiments,
`118, the CPU 120, and the memory controller 122 may be
`implemented on a single chip, such as a chip 104. In some
`other embodiments, they may be implemented on separate
`chips.
`[0035] The RF (radio frequency) circuitry 108 receives and
`sends RFsignals, also called electromagnetic signals. The RF
`circuitry 108 converts electrical signals to/from electromag-
`netic signals and communicates with communications net-
`works and other communications devices via the electromag-
`netic signals. The RF circuitry 108 may include well-known
`circuitry for performing these functions, including but not
`limited to an antenna system, an RF transceiver, one or more
`amplifiers, a tuner, one or more oscillators, a digital signal
`processor, a CODEC chipset, a subscriber identity module
`(SIM) card, memory, and so forth. The RF circuitry 108 may
`communicate with networks, such as the Internet, also
`referred to as the World Wide Web (WWW), an intranet
`and/or a wireless network, such as a cellular telephonenet-
`work, a wireless local area network (LAN) and/or a metro-
`politan area network (MAN), and other devices by wireless
`communication. The wireless communication mayuse any of
`a plurality of communicationsstandards, protocols and tech-
`nologies, including but not limited to Global System for
`Mobile Communications (GSM), Enhanced Data GSM Envi-
`ronment (EDGB), high-speed downlink packet access (HS-
`DPA), wideband codedivision multiple access (W-CDMA),
`code division multiple access (CDMA), time division mul-
`tiple access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi)
`(e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11 g and/or
`TEEE 802.11n), voice over
`Internet Protocol
`(VoIP),
`Wi-MAX,a protocol for email (e.g., Internet message access
`protocol (IMAP) and/or post office protocol (POP)), instant
`messaging(e.g., extensible messaging and presence protocol
`(XMPP), Session Initiation Protocol for Instant Messaging
`and Presence Leveraging Extensions (SIMPLE), and/or
`Instant Messaging and Presence Service (IMPS)), and/or
`Short Message Service (SMS)), or any other suitable com-
`munication protocol, including communication protocols not
`yet developedas ofthe filing date of this document.
`[0036] The audio circuitry 110, the speaker 111, and the
`microphone 113 provide an audio interface between a user
`and the device 100. The audio circuitry 110 receives audio
`data from the peripherals interface 118, converts the audio
`data to an electrical signal, and transmitsthe electrical signal
`to the speaker 111.