as) United States
`a2) Patent Application Publication co) Pub. No.: US 2008/0259041 Al
`
`(43) Pub. Date: Oct. 23, 2008
`Blumenbergetal.
`
`US 20080259041A1
`
`(54) METHOD, SYSTEM, AND GRAPHICAL USER
`INTERFACE FOR ACTIVATING
`HYPERLINKS
`
`(76)
`
`Inventors:
`
`Chris Blumenberg, San Francisco,
`CA (US), Richard Williamson,
`Los Gatos, CA (US)
`
`Correspondence Address:
`MORGAN LEWIS & BOCKIUS LLP/ AI
`2 PALO ALTO SQUARE, 3000 EL CAMINO
`REAL
`PALO ALTO, CA 94306 (US)
`
`(21) Appl. No.:
`
`11/620,646
`
`(22)
`
`Filed:
`
`Jan. 5, 2007
`
`Publication Classification
`
`(51)
`
`Int.Cl.
`(2006.01)
`GO6F 3/041
`(52) US. CD. ceccccccseccccseccccsssssesscesessessessessevseseeveeee 345/173
`
`(57)
`
`ABSTRACT
`
`Methods, systems, and graphical user interfaces for activating
`hyperlinks are disclosed. In one embodiment,a portable elec-
`tronic device: displays content on a touch screen display,
`wherein the content includesa plurality of links to additional
`content; detects a contact by a finger with the touch screen
`display, wherein the contact includes anarea ofcontact; deter-
`mines a point within the area of contact: determines a link in
`the plurality of links that satisfies two or more predetermined
`criteria with respect to the point, including a closest proximity
`criterion and a maximum proximitycriterion; and activates
`the determinedlink.
`
`Portable Electronic Device
`
`200
`
`APPLE-1004
`
`1
`
`APPLE-1004
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 1 of 13
`
`US 2008/0259041 Al
`
`Memory 102
`
`Operating System
`Communication Module
`Display Module
`Contact/Motion Module
`-
`Graphics Module
`Applications
`Web Browser
`
`Contact Point Module
`
`Closest Link Module
`Link Information Module
`
`122
`124
`125
`126
`128
`130
`131
`
`132
`
`134
`136
`
`Portable Electronic Device
`
`100
`
`137
`
`Power
`System
`
`103
`
`Optical
`p
`Sensor
`
`403
`
`External
`Port
`
`148
`
`135
`
`146
`103
`y|116
`104
`.
`RF Circuitry
`108
`420
`Controller
`
`Peripherals
`Interface
`
`
`
`Processor(s)
`
`
`|
`
`103
`
`103
`
`103
`
`110
`
`Speaker 142
`
`—_
`
`{|
`Audio
`Circuitry .
`
`Microphone 144
`
`118
`
`106
`
`152
`
`112
`
`
`
`Touch Screen
`OtherInput
`—
`Controller
`Controller(s)
`
`103
`Control Devices
`
`Touch Sensitive
`Display System
`
`OtherInput
`
`103
`
`454
`
`114
`
`FIG. 1
`
`2
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 2 of 13
`
`US 2008/0259041 Al
`
`200
`
`Portable Electronic Device
`
`™
`
`FIG. 2
`
`3
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 3 of 13
`
`US 2008/0259041 Al
`
`300
`
`Display content on a touch screen, wherein the
`content includes multiple links
`
`first link
`
`Choosea first link amongst the multiple links based
`on the proximity of the first link to the determined
`point within the contact area
`
`Detect finger contact with the touch screen,
`wherein the contact includes a contact area
`
`
`
`Determine a point within the contact area
`
`Display information associated with the first link
`over the content, wherein the displayed information
`includes information other than anchor text of the
`
`FIG. 3
`
`4
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 4 of 13
`
`US 2008/0259041 Al
`
`400
`
`Display content on a touch screen, wherein the
`content includes multiple links
`
`
`Detect finger contact with the touch screen,
`wherein the contact includes a contact area
`
`Determine a point within the contact area
`
`Activate the determinedlink
`
`Determine a link of the multiple links that satisfies
`two or more predetermined criteria with respect to
`the point, including a closest proximity criterion and
`a maximum proximity criterion
`
`FIG. 4
`
`5
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 5 of 13
`
`US 2008/0259041 Al
`
`Portable Electronic Device
`
`12:35 PM
`
`Tech newsand blogs
`
`There are many tech newssites and blogs on
`the Web. They run the gamut from general
`tech newsto the latest and greatestin
`gadgets. Links to myfavorites are included
`below. Check them out!
`
`Slashdot
`Engadget
`CNet News.com
`The Register
`Ars Technica
`Phone Scoop
`
`MobileTracker
`PalmInfocenter
`
`-
`
`
`
`FIG. 5A
`
`6
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 6 of 13
`
`US 2008/0259041 Al
`
`Portable Electronic Device
`
`200
`
`™™
`
`@e@0o0o
`
`12:35 PM
`
`Tech newsand blogs
`
`There are many tech newssites and blogs on
`the Web. They run the gamut from general
`tech newsto the latest and greatestin
`gadgets. Links to my favorites are included
`below. Check them out!
`Slashdot
`
`508
`
`CNet News.co
`The Register
`Ars Technica
`Phone Scoop
`MobileTracker
`PalmInfocenter
`
`504
`
`
`
`FIG. 5B
`
`7
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 7 of 13
`
`US 2008/0259041 Al
`
`Portable Electronic Device
`
`200
`
`Ss
`
`There are many tech newssites and blogs on
`the Web. They run the gamut from general
`tech newsto the latest and greatestin
`gadgets. Links to my favorites are included
`below. Check them out!
`
`507
`
`12:35 PM
`
`Tech news and blogs
`
`508
`
`FIG. 5C
`
`8
`
`

`

`Patent Application Publication
`
`Oct. 23, 2008 Sheet 8 of 13
`
`US 2008/0259041 Al
`
`Portable Electronic Device
`200
`
`WXPKKKKKKXKKAN,
`
`XXKAXXXAXXKXXKKAKAXKAAKAAMKAAAKA,
`KXHHHMOKHKIHOHHAHNIIEIIIBIRCHICHHIICMON,
`AAKAKAKKKKKRMNANARAMAAKRKAKAANAKKKKEAARAKAKAKARAKKRK
`WAKAKAKKRAKEAKANKAKKAKNIRARHLAANIKAKAKAIAII,
`WHAAKKXKKHMKHANKAKANRHHHHXHHHAAKHHIHINHKCN
`HHHKKHKKHHHHIKIKIKIHHHHEHHHICMSMHHHHORII,
`HOPOHHOCKKIHKHKIOKKK,
`KARRAKAKKKKKKKKAAKAKKKAKANAKKKAKAKAKARAKIARIAADK
`WOHHHKHHKHNHHHHHHHHHKIEHOHHHHHHIINHHHHHA
`HPOKKKKKM,
`OOOOKAKOMORIN,
`XHKARAKIHHINAHKHANHIMANMMMHKKH MAIN,
`KHERHIIIIRRRRRHOCHOHHHHHCHDORICHOCICKCIRC,
`WRKKKRXRKKWNKKARAMKKMKKKKAAAKAKEKRERKRKAKKKKAKAKEK
`AAAKAKKARKREAAA
`KAHANKHHIIAAHIIAINHHIMMHHHIIRMIMIAIM,
`WXWOKKKKKKXKXANAHKHIMKKKKHIKHMHHIHIICHKHICHHRIIO
`HXPKKKAKKXKKK,
`ARKAKAKAKAKKKKKKKRAARKKKKAKAKARAKAMAKARARAKAMARAIAADADA
`HOOKIKINHHHIIHIHIKIHMHHHEHHICHAHHHHKAAIOOOINN,
`
`
`
`12:35 PM
`
`Cnet News.com
`
`FIG. 5D
`
`9
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 9 of 13
`
`US 2008/0259041 Al
`
`Portable Electronic Device
`
`12:35 PM
`
`news and hloas
`
`http://
`www.phonescoop.com
`
`hdot
`
`
`
`FIG. 5E
`
`10
`
`10
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 10 of 13
`
`US 2008/0259041 Al
`
`Portable Electronic Device
`
`200
`
`\
`
`12:35 PM
`
`Tech news and blogs
`
`tech| WWW.palminfocenter.com
`gadq Palm devices and Palm OS news,
`
`CNetNews.com
`
`The Register
`Ars Technica
`PhoneScoop
`
`
`
`nometracker
`
`
`
`FIG. 5F
`
`11
`
`11
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 11 of 13
`
`US 2008/0259041 Al
`
`Portable Electronic Device
`
`200
`
`™\
`
`12:35 PM
`
`Tech news and blogs
`
`There are many tech newssites and blogs on the
`Web. They run the gamut from general tech newsto
`the latest and greatest in gadgets. Links to my
`favorites are included below. Check them out!
`
`Slashoot
`Engadget
`
`507
`
`Phone Scoop
`MobileTracker
`| Palm Infocenter
`Vv
`
`504
`
`)
`
`506
`
`
`
`FIG. 5G
`
`12
`
`12
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 12 of 13
`
`US 2008/0259041 A
`
`
`
`Portable Electronic Device
`200
`
`12:35 PM
`
`
`
`XXRKRXXXAXXKAAKXAAKAAKAAAXAAKAAKAKK
`
`KXKXKAXKIKI
`XHAXKKKKKKKK
`HOHHIHKHKKKK
`KIARA
`XKAKAKMAKAK
`HKXKHOKK
`AKIHKANKKK
`KOKO
`XXX,
`XAXXAKK
`AKAAAKMAAAK
`OOOO
`AHAMAAANHKM
`http “/]
`ZOOCOOI"
`XMKAXAXKAK
`TOO0OOXXM
`XAXKAKAKAKK
`XHOOOOHOO"
`voor WWW. Palminfocenter.cOomM fr»:
`XAXKAKKK
`OCXKKKKK
`XO
`POXXXAXXAAIN
`KKXXKXKXM
`XKKAKAKAAK
`OOUO0U0UC
`AXXXXAAAKAK
`KKKKMKKKKXKKK voce
`OMIKWKKKIKK
`YHOOKKK,
`
`ZRIIDonncoa0000000000000 HHAHAKHKKK
`XXX
`KKK
`KXXXNIOOMOOOOOKKK,
`XXQOKOIOOIOOKKAKKKKKK
`KROOOOIKRKK
`KHAKI
`KROIOOKIIONK
`ZX2OOCOCOOOOOHAKXX,
`<
`DOKWIODOIGHIKKK
`HXKKAKAKKAKK
`nanan
`YHAHAKARAXARK
`XKXKKXKXKKKKK
`xpppenenenec90900¢
`XKXKX
`KXAKKKIOQOOIOOOKKK:
`AAAMAKAAAANAN
`XOOKKKOOOOCOK
`200%
`JOOKIKOK,
`XARA
`XPHAHKAKKAK
`KKKXAXKXKAKKK
`HOOKHOOK,
`YAXKXKAKAKAXK,
`KKKKKKKKKXKKK
`XOOOOHIXKKKK
`KKKKAKKKKIKK,
`WKHKKWKAKKKK,
`OOOOOOOOOOK
`XAXXAKAAXKANK
`HKOKKKKKXKKK
`NHKXXHKAKKKK
`XAXXAKKAKXKAK,
`AAXMAXARRARK,
`ROOKKK,
`ARKKAKAXXKAAK
`OOKKXIOI,
`XAXXAXANKXKAK,
`XAXKAKKAKAKAK,
`XXHAXAXAKKAK
`OOOOOOOIIO,
`AKAKKHKRXKKK,
`KKXXXXKXKAKKK
`XMXKAKMANKNAK
`HIIKHL,
`NAKKKXAKAKAKK
`
`FIG. 5H
`
`13
`
`13
`
`

`

`Patent Application Publication
`
`Oct. 23,2008 Sheet 13 0f13
`
`US 2008/0259041 A
`
`
`
`Portable Electronic Device
`200
`
`
`
`XXXKKXAXKANAN
`KOKIKAK,
`KXXKXKKXXKAKKKAKKKHKKKAKKKKKKKKAKIK
`KAIAMAARAKAM,
`XXXXXXKMXMKKK
`HXIOODOOKY
`YEXKAAKAKKAKK
`SOOODOOH
`XXXXXXK
`XXXII"
`2OQODO00
`SOLQUDUON
`http://
`TOOK
`vom Www. palminfocenter.com
`XXKKKKEK
`sanonD00
`XKXKAKIAAKIKK,
`OOOO
`XXX
`XKKXHHKIKHKIOK
`AXAANAIAARIO
`peosstbotboued
`ANXAANAAAKNK,
`XKKAK,
`XKXAIKKAA
`XXXAAR,
`XKXANMIAWOOAK,
`AXXADAAAAKIAK,
`XXXAKIN
`OOOOH
`IIOOHOK
`XXXXKKAKKKK
`XHKXHKAKO
`XXXANMAKAKIAK,
`XXXAMANAXAKANA,
`OOOO
`JOCOOIIOHOOC
`XXARIOKIOK
`
`XXPAAKAKAKK,
`KNOX,
`KKMKKAHKK,
`XXKXAXARAAKK,
`HXXKAAK
`POXKMKXKKAAAX
`REKAKAXARAK
`EXKXANAXXHKAA
`YOXKXHRNANKKK
`XKKKXHHAXHKKK
`XXX
`YOAXKAAAAAKAXN
`KAAKXAMAAKAN
`XAKKXAAAKKKKK
`peesecseeehses
`XXKKK,
`XXKKKKKRXAMKR
`YAXKXAANAKHAN
`HAAKANNAAKMAN
`OXKXXOKAKN
`XXXXXAAAAKHKN
`YOOXKAKHHRN
`HOKKXIKOMKK
`NAKKXAKAXAXKK
`YOAXAXNAAAKANN
`HAAKXAMAXAMNN
`XXXXKAKAAKKKN
`HAXXXHANARAKN
`YOCXKXKAKKKK
`YAKXXNKAAKMAN
`
`XXWOCOOHQIOIIKXAKN
`AXIOKANKXAN,
`KAKIOKKKKKKKKKAKI
`ZECOCOCOCIHII
`ZHIKIKI
`X2GROCDEIOROOUCO
`XXWOOVIONKKKKAAKA,
`XXAXOOOHKKEKE,
`
`FIG. 51
`
`14
`
`14
`
`

`

`US 2008/0259041 Al
`
`Oct. 23, 2008
`
`METHOD, SYSTEM, AND GRAPHICAL USER
`INTERFACE FOR ACTIVATING
`HYPERLINKS
`
`
`
`RELATED APPLICATIONS
`
`[0001] This application is related to U.S. patent application
`Ser. No.
`to be assigned, filed Jan. 5, 2007, entitled
`“Method, System, and Graphical User Interface for Display-
`ing Hyperlink Information,” Attorney Docket No. 063266-
`5043, the disclosure of whichis hereby incorporated by ref-
`erence herein.
`
`TECHNICAL FIELD
`
`[0002] The disclosed embodimentsrelate generally to user
`interfaces for portable devices, and moreparticularly, to acti-
`vating hyperlinks ona portable electronic device.
`
`contact. The predeterminedcriteria include a closest proxim-
`ity criterion and a maximum proximity criterion.
`[0009] According to some embodiments, a portable elec-
`tronic device includes a touch screen display, one or more
`processors, memory; and a program. The program is stored in
`the memory and configured to be executed by the one or more
`processors. The program includes instructionsfor displaying
`content on a touch screen display, wherein the content
`includesa plurality oflinks to additional content; instructions
`for detecting a contact by a finger with the touch screen
`display, wherein the contact includes an area of contact;
`instructions for determining a point within the arca of contact;
`instructions for determining a link in the plurality oflinks that
`satisfies two or more predetermined criteria with respect to
`the point, including a closest proximity criterion and a maxi-
`mumproximity criterion; and instructions for activating the
`determinedlink.
`
`BACKGROUND
`
`[0010] According to some embodiments, a computer-pro-
`gramproduct includes a computer readable storage medium
`and a computer program mechanism embedded therein. The
`In recent years, the capabilitics of portable clec-
`[0003]
`computer program mechanism includes instructions which,
`tronic devices have expanded greatly. A feature that has
`whenexecuted bya portable electronic device with a touch
`becomepopularis web browsingvia a wireless network, such
`as cellular networks or Wi-Fi. With this feature, users can
`screen display, cause the device to: display content on a touch
`screen display, wherein the content includes a plurality of
`browse websites without having to be in front of a desktop
`links to additional content; detect a contact by a finger with
`computer or having to carry around a laptop computer.
`the touch screen display, wherein the contactincludes an area
`[0004] A drawback of portable devices, however,
`is the
`small screen size. The small screensizelimits the amount of
`of contact; determine a point within the area of contact; deter-
`information and/or the size of the information that can be
`minealink in the pluralityof links that satisfies two or more
`shownonthe screen. ‘This limitation can pose problems for
`predetermined criteria with respect to the point, including a
`web browsing on such devices because links in webpages
`closest proximity critcrion and a maximum proximity crite-
`rion; and activate the determined link.
`displayed on a small screen maynot be perceived easily by
`users. As a result, getting information about the hyperlinks
`[0011] According to some embodiments, a portable elec-
`and navigating to other webpagesvia the hyperlinks takes on
`tronic device with a touch screen display includes meansfor
`a hit-or-miss character, which can frustrate users and make
`displaying content on a touch screen display, wherein the
`the web browsing experience on portable devices cumber-
`content includes a plurality of links to additional content;
`some.
`meansfor detecting a contact by a finger withthe touch screen
`display, wherein the contact includes an area of contact;
`means for determining a point within the area of contact;
`means for determining a link in the plurality of links that
`satisfies two or more predetermined. criteria with respect to
`the point, including a closest proximity criterion and a maxi-
`mumproximity criterion; and meansforactivating the deter-
`minedlink.
`
`[0005] Accordingly, there is a need for a more efficient
`ways to convey hyperlink information and select hyperlinks
`in portable devices.
`
`SUMMARY
`
`[0006] The above deficiencies and other problemsassoci-
`ated with user interfaces for portable devices are reduced or
`eliminated by the disclosed device that includes a userinter-
`face for activating hyperlinks.
`[0007] According to some embodiments, a computer-
`implemented method for a portable electronic device
`includes: displaying content on a touch screen display,
`wherein the content includesa plurality oflinks to additional
`content; detecting a contact by a finger with the touch screen
`display, wherein the contact includes anarea ofcontact; deter-
`mining a point within the area of contact; determining a link
`in the plurality of links that satisfies two or more predeter-
`minedcriteria with respect to the point, including a closest
`proximity criterion and a maximumproximity criterion; and
`activating the determinedlink.
`[0008] According to some embodiments, a graphical user
`interface on a portable electronic device with a touch screen
`display includes content that includes a plurality of links to
`additional content. In response to detection of an area of
`contact ofa finger with the touch sercen display, a point in the
`area ofcontact is determined anda link in the plurality oflinks
`is chosenand activated. The link satisfies two or more prede-
`terminedcriteria with respect to the point within the area of
`
`[0012] Thus, the invention activates hyperlinks in portable
`electronic devices with touch screen displays. The invention
`is particularly useful for devices that primarily receive finger-
`based input on the touch screen, rather than stylus-based
`input, becausethe large contact area ofa finger may otherwise
`makeit difficult for a user to know which hyperlink will be
`selected for a given finger contact.
`
`
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`For a better understanding of the aforementioned
`[0013]
`embodiments of the invention as well as additional embodi-
`mentsthereof, reference should be madeto the Description of
`Embodiments below, in conjunction with the following draw-
`ings in which like reference numerals refer to corresponding
`parts throughout the figures.
`[0014]
`FIG. 1 is a block diagram illustrating a portable
`electronic device in accordance with some embodiments.
`
`FIG.2 illustrates a portable electronic device having
`[0015]
`a touch screen and a soft keyboard in accordance with some
`embodiments.
`
`15
`
`15
`
`

`

`US 2008/0259041 Al
`
`Oct. 23, 2008
`
`FIG.3 is a flow diagram illustrating a process for
`[0016]
`displaying information associated with a link in accordance
`with some embodiments.
`[0017]
`FIG. 4 is a flowdiagram illustrating a process for
`activating a link in accordance with some embodiments.
`[0018]
`FIGS. 5A-5] illustrate a user interface for displaying
`information associated with links and activating links in
`accordance with some embodiments.
`
`DESCRIPTION OF EMBODIMENTS
`
`display 112 is sometimes called a “touch screen” for conve-
`nience. The device 100 may include amemory controller 120,
`one or more data processors, image processors and/or central
`processing units 118 and a peripherals interface 116. The
`memory controller 120, the one or more processors 118 and/
`or the peripherals interface 116 may be separate components
`or maybe integrated, such as in an integrated circuit 104. The
`various components in the device 100 may be coupled byone
`or more communicationbusesor signal lines 103.
`[0024]
`Ifthe device 110 includes picture taking capabili-
`ties, the peripherals interface 116 is coupled to an optical
`[0019] Reference will now be made in detail to embodi-
`sensor 148, such as a CMOS or CCDimage sensor. The
`ments, examples of which areillustrated in the accompanying
`peripherals interface 116 may also be coupled to RF circuitry
`drawings. In the following detailed description, numerous
`108; audio circuitry 110; and/or an input/output (I/O) sub-
`specific details are set forth in order to provide a thorough
`system 106. The audio circuitry 110 may be coupled to a
`understanding of the present invention. However, it will be
`speaker 142 and a microphone 144. The device 100 may
`apparent to one of ordinary skill in the art that the present
`support voice recognition and/or voice replication. The RF
`invention maybe practiced without these specific details. In
`circuitry 108 may be coupled to one or more antennas 146 and
`other instances, well-known methods, procedures, compo-
`may allow communication with one or more additional
`nents, circuits, and networkshave not been described in detail
`devices, computers and/or servers using a wireless network.
`so as not to unnecessarily obscure aspects of the embodi-
`ments.
`The device 100 may support a variety of communications
`protocols, including code division multiple access (CDMA),
`Embodimentsof user interfaces and associated pro-
`[0020]
`Global System for Mobile Communications
`(GSM),
`cesses for using a portable electronic device with a touch
`
`Enhanced Data GSM Environment (EDGE), Wi-Fi (such as
`
`screen are described. In some embodiments, the device is a
`
`
`
`IEEE 802.11a, IEEE 802.11b, IGEL 802.1 g and/or IDLE
`portable communications device. The user interface may
`include a click wheel in addition to a touch screen. A click
`802.11n), Bluetooth, Wi-MAX,a protocol for email, instant
`messaging, and/or a short message service (SMS), or any
`wheel is a physical user-interface device that may provide
`other suitable communication protocol, including communi-
`navigation commandsbased on an angular displacement of
`cation protocols not yet developedas ofthe filing date ofthis
`the wheel or a point of contact with the wheelby a user ofthe
`document. In an exemplary embodiment, the device 100 may
`device. A click wheel may also be used to provide a user
`be, at least in part, a mobile phone(e.g., a cellular telephone).
`command corresponding to selection of one or more items,
`for example, whenthe user of the device presses down onat
`[0025] The I/O subsystem 106 may include a touch screen
`least a portion of the wheel or the center of the wheel. lor
`controller 152 and/or other inpul controller(s) 154. The
`simplicity, in the discussion that follows, a portable electronic
`touch-screen controller 152 may be coupled to a touch-sen-
`device capable of wireless communications(e.g., a mobile or
`sitive screen or touchsensitive display system 112. The touch
`cellular telephone ora personaldigital assistant with wireless
`screen 112 and touch screen controller 152 maydetect con-
`networking capabilities) that includes a touch screen is used
`tact and any movement or break thereof using any of a plu-
`as an exemplary embodiment. It should be understood, how-
`rality of touch sensitivity technologics now knownorlater
`ever, that the user interfaces and associated processes may be
`developed, including but not limited to capacitive, resistive,
`applied to other devices, such as personal computers and
`infrared, and surface acoustic wave technologies, as well as
`laptops, which mayinclude one or more other physical user-
`other proximity sensorarrays or other elements for determin-
`interface devices, such as a click wheel, a keyboard, a mouse
`ing one or more points of contact with the touch-sensitive
`and/or a joystick.
`screen 112. A touch-sensitive display in some embodiments
`[0021] The device may support a variety of applications,
`of the display system 112 may be analogous to the multi-
`such as one or more telephone applications, text messaging,
`touch sensitive tablets described in the following U.S. Pat.
`word processing, email, web browsing, and a music player.
`Nos. 6,323,846 (Westermanet al.), 6,570,557 (Weslermanet
`The music player may be compatible with one or more file
`al.), and/or 6,677,932 (Westerman), and/or U.S. Patent Pub-
`formats, such as MP3 and/or AAC. In an exemplary embodi-
`lication 2002/0015024A1, cach of which is hereby incorpo-
`ment, the device includes an iPod music player (ipod is a
`rated by reference. However, a touch screen in the display
`trademark of Apple Computer, Inc.).
`system 112 displays visual output from the portable elec-
`tronic device 100, whereas touch sensitive tablets do not
`[0022] The various applications that may be executed on
`the device mayuseal least one commonphysical user-inter-
`provide visual output. The touch-sensitive screen 112 may
`face device, such as the touch screen. In embodiments that
`have a display resolution in excess of 100 dpi. In an exem-
`include a touch screen, one or more functions of the touch
`plary embodiment, the touch-sensitive screen 112 has a dis-
`screen as well as corresponding information displayed on the
`play resolution of approximately 168 dpi. The other input
`device maybe adjusted and/or varied from one applicationto
`controller(s) 154 may be coupled to other input/control
`devices 114, such as one or more buttons. In somealternative
`the next and/or within a respective application. In this way, a
`common physical architecture (such as the touch screen) of
`embodiments, input controller(s) 154 may be coupled to any
`the device may support the variety of applications with user
`(or none) of the following: a keyboard, infrared port, USB
`interfaces that are intuitive and transparent to a user.
`port, and/orapointer device such as a mouse. ‘he one or more
`[0023] Attention is now directed to an embodiment of a
`buttons (not shown) may include an up/down button for vol-
`portable electronic device. FIG. 1 is a block diagram illus-
`umecontrol of the speaker 142 and/or the microphone 144.
`trating an embodiment ofa portable electronic device 100
`The one or more buttons (not shown) may include a push
`having a touch-sensitive display 112. The touch-sensitive
`button. A quick press of the push button (not shown) may
`
`
`
`16
`
`16
`
`

`

`US 2008/0259041 Al
`
`Oct. 23, 2008
`
`
`
`disengage alock ofthe touch screen 112. A longerpress ofthe
`push button (not shown) may turn powerto the device 100 on
`or off. The user may be able to customize a functionality of
`one or more ofthe buttons. The touch screen 112 may be used
`to implementvirtual or soft buttons and/or one or more key-
`boards.
`
`may include a display module(or a set of instructions) 125, a
`contact/motion module(or a set of instructions) 126 to deter-
`mine one or more points of contact and/or their movement,
`and a graphics module (or a set of instructions) 128. The
`graphics module 128 may support widgets, that is, modules or
`applications with embedded graphics. The widgets may be
`implemented using JavaScript, IITML, AdobeI'lash,or other
`[0026] A touch-sensitive display in some embodiments of
`suitable computer program languages and technologies.
`the display system 112 maybe as described inthe following
`[0030] The memory 102 may also include one or more
`applications: (1) U.S. patent application Ser. No. 11/381,313,
`applications 130. Examples ofapplications that may be stored
`“Multipoint Touch Surface Controller,” filed on May 2, 2006;
`in memory 102 include telephone applications, email appli-
`(2) US. patent application Ser. No. 10/840,862, “Multipoint
`cations, text messaging or instant messaging applications,
`Touchscreen,”filed on May 6, 2004; (3) U.S. Pat. No. appli-
`cation Ser. No. 10/903.964, “Gestures For Touch Sensitive
`memopad applications, address booksor contact lists, calen-
`dars, picture taking and management applications, and music
`Input Devices,” filed on Jul. 30, 2004; (4) U.S. patent appli-
`cation Ser. No. 11/048.264, “Gestures For Touch Sensitive
`playing and managementapplications. The applications 130
`may include a web browser 131 for rendering pages written in
`Input Devices,” filed on Jan. 31, 2005; (5) U.S. patent appli-
`the Hypertext Markup Language (HTML), Wireless Markup
`cation Ser. No. 11/038,590, “Mode-Based Graphical User
`Language (WML), or other languagessuitable for composing
`Interfaces For Touch Sensitive Input Devices,” filed on Jan.
`webpagesor other online content.
`18, 2005; (6) U.S. patent application Ser. No. 11/228,758,
`“Virtual Input Device Placement On A Touch Screen User
`[0031] The applications 130, including the web browser
`Interface,” filed on Sep. 16, 2005; (7) U.S. patent application
`131, mayrender contentthat includes one or more hyperlinks
`(or “inks’’) that link to other content. A hyperlink to an item
`Ser. No. 11/228,700, “Operation Of A Computer With A
`of content is associated with the Universal Resource I_ocator
`Touch Screen Interface,’ filed on Sep. 16, 2005; (8) US.
`patent application Ser. No. 11/228,737, “Activating Virtual
`(URL)ofthe item of content. Hyperlinks may be included in
`Keys OfA Touch-Screen Virtual Keyboard,” filed on Sep. 16,
`a wide variety of documents, including but not limited to
`2005; and (9) U.S. patent application Ser. No. 11/367,749,
`webpages, email messages, text messages, text documents,
`“Multi-Functional Hand-Held Device,’filed on Mar. 3, 2006.
`and so forth. A hyperlink may be associated with anchortext
`Allofthese applications are incorporated by reference herein.
`or an anchor image in a document.
`[0032] Also included in the memory 102 are a contact point
`[0027]
`In some embodiments, the device 100 may include
`module (ora set ofinstructions) 132, a closest link module (or
`circuitry for supporting a location determining capability,
`asct of instructions) 134, and a link information module (or a
`such as that provided by the Global Positioning System
`set of instructions) 136. The contact point module 132 deter-
`(GPS). In some embodiments, the device 100 maybe used to
`mines the centroid or some other reference point in a contact
`play back recorded music, such as one or more files, such as
`MP3files or AACfiles. In some embodiments, the device 100
`area formed bycontact on the touch screen 112. The closest
`link module 134 determinesalink that satisfies one or more
`mayinclude the functionality of an MP3 player, such as an
`iPod (trademark ofApple Computer, Inc.). In some embodi-
`predefined criteria with respect to a point in a contact area as
`ments, the device 100 may include a multi-pin (e.g., 30-pin)
`determined by the contact point module 132. The link infor-
`connector that is compatible with the iPod.
`mation module 136 retrieves and displays information asso-
`ciated with hyperlinks.
`[0028] Thedevice 100 also includes a powersystem 137 for
`
`powering the various components. The power system 137
`[0033] Each of the above identified modules and applica-
`mayinclude a power management system, one or more power
`tions correspondto a setofinstructions for performing one or
`sources(e.g., battery, alternating current (AC)), a recharging
`more functions described above.‘hese modules(1.2., sets of
`system, a powerfailure detection circuit, a power converter or
`instructions) need not be implemented as separate software
`inverter, a power status indicator(e.g., a light-emitting diode
`programs, procedures or modules. The various modules and
`(LED)) and any other components associated with the gen-
`sub-modules may be rearranged and/or combined. Memory
`cration, management and distribution of power in portable
`102 may include additional modules and/or sub-modules, or
`devices. The device 100 mayalso include one or more exter-
`fewer modules and/or sub-modules. Memory 102, therefore,
`nal ports 135 for connecting the device 100 to other devices.
`may include a subset or a superset of the above identified
`modules and/or sub-modules. Various functions of the device
`[0029] The memory controller 120 may be coupled to
`100 may be implemented in hardware and/or in software,
`memory 102, which may include one or more types of com-
`including in one or more signal processing, and/orapplication
`puter readable medium. Memory 102 mayinclude high-
`specitic integrated circuits.
`speed random access memory and/or non-volatile memory,
`such as one or more magnetic disk storage devices, one or
`[0034] Attention is now directed towards embodiments of
`more optical storage devices, and/or flash memory. Memory
`user interfaces and associated processes that may be imple-
`102 may store an operating system 122, such as Darwin,
`mented on the device 100. FIG. 2 is a schematic diagram
`RTXC, LINUX, UNIX, OS X, WINDOWS,or an embedded.
`illustrating an embodimentof a user interface for a portable
`electronic device 200. The device 200 includes a touch screen
`operating system such as VxWorks. ‘he operating system
`122 mayinclude procedures(or sets of instructions) for han-
`208. For someapplications, the touch screen maydisplay one
`dling basic system services and for performing hardware
`or more trays. A tray is a defined region or area within a
`dependent tasks. Memory 102 mayalso store communication
`graphical user interface. One tray may include a user entry
`procedures(orsets of instructions) in a communication mod-
`interface, such as a keyboard 210 that includesa plurality of
`ule 124. The communication procedures maybe used for
`icons. The icons may include one or more symbols. In this
`communicating with one or more additional devices, one or
`embodiment, as well as others described below, a user may
`select one or moreofthe icons, and thus, one or more of the
`more computers and/orone or more servers. The memory 102
`
`17
`
`17
`
`

`

`US 2008/0259041 Al
`
`Oct. 23, 2008
`
`corresponding symbols, by making contact or touching the
`keyboard 210, for example, with one or more fingers 212 (not
`drawn to scale in the figure). The contact may correspond to
`the one or moreicons. In some embodiments, selection ofone
`or more icons occurs whenthe user breaks contact with the
`one or more icons. In some embodiments, the contact may
`include a gesture, such as one or more taps, one or more
`swipes (e.g., fromleft to right, right to left, upward and/or
`downward) and/ora rolling ofa finger(e.g., from rightto lefi,
`left to right, upward and/or downward) that has made contact
`with the device 200. In some embodiments, inadvertent con-
`tact with an icon maynotselect a corresponding symbol. For
`example, a swipe gesture that sweeps over an icon may not
`select a corresponding symbol ifthe gesture corresponding to
`selection is a tap gesture.
`[0035] The device 200 may include a display tray 214,
`whichis displayed on the touch screen 208. The displaytray
`214 maydisplay one or more ofthe characters and/or symbols
`that are selected bythe user. The device 200 mayalso include
`one or more physical buttons, such as the clear, hold and menu
`buttons shown in FIG. 2. The menu button may be used to
`navigate to any application ina set ofapplications that may be
`executed on the device 200. Alternatively, in some embodi-
`ments,the clear, hold, and/or menu buttons are implemented
`as soft keys in a GUI in touch screen 208.
`[0036] Attention is nowdirected to FIG. 3, whichillustrates
`aprocess flow 300 for displaying information associated with
`a link in accordance with some embodiments. Content is
`displayed on a touch screen of a device (302). The content
`includesa plurality oflinks, which maybe clustered together
`or scattered throughout the content. In some embodiments,
`the content is a webpage, which may be rendered in a web
`browser application 131 in the device. In some other embodi-
`ments, the content may be an email, text message, or some
`other document, rendered in an application 130, that includes
`one or morelinks.
`
`[0037] Acontact with the touch screen is detected, wherein
`the contact includes a contact area (304). In some embodi-
`ments, the contact is detected by contact/motion module 126,
`in conjunction with the touch-sensitive display system 112
`and the touchscreen controller 152. The contact may be made
`by a finger. ‘he contact forms a contact area on the touch
`screen.
`
`[0038] A point within the contact area is determined (306).
`In some embodiments, the point is determined bya contact
`point module 132 in conjunction with the touch-sensilive
`display system 112, the touch screen controller 152, and/or
`the processor(s) 118. The determi