as) United States
`a2) Patent Application Publication 10) Pub. No.: US 2011/0074699 Al
`
`(43) Pub. Date: Mar. 31, 2011
`Marret al.
`
`US 20110074699A1
`
`(54) DEVICE, METHOD, AND GRAPHICAL USER
`INTERFACE FOR SCROLLING A
`MULTI-SECTION DOCUMENT
`
`(52) US. CMe coeccccccssssssssssssssssvseseesessessssasisssssenes 345/173
`
`(57)
`
`ABSTRACT
`
`(21) Appl. No.:
`
`12/567,717
`
`(22)
`
`Filed:
`
`Sep. 25, 2009
`
`A methodfor scrolling a multi-section documentis disclosed,
`including displaying onadisplay an electronic documentthat
`Jason Robert Marr, Cupertino, CA
`(76)
`Inventors:
`includes a plurality of document sections separated by
`(US); Akiva Leffert, San Francisco,
`respective logical structure boundaries; detecting a gesture on
`CA (US); Peter William Rapp,
`a touch-sensitive surface, the gesture having an initial veloc-
`Pittsburgh, PA (US); Christopher
`ity that exceeds a predefined speed threshold such that the
`Douglas Weeldreyer, San Carlos,
`gesture will scroll the electronic document more than one
`CA (US); Jay Christopher Capela,
`documentsection;initiating scrolling of the electronic docu-
`Santa Cruz, CA (US)
`menton the displayat the initial velocity in accordance with
`an initial scrolling speed versus scrolling distance function;
`while scrolling the electronic document, adjusting the scroll-
`ing speed versus scrolling distance function so that when the
`scrolling speed becomeszero,a first logical structure bound-
`ary in the electronic documentis displayed at a predefined
`location on the display; and, scrolling the electronic docu-
`ment in accordance with the adjusted scrolling speed versus
`scrolling distance function.
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`GO6F 3/041
`
`(2006.01)
`
`Portable Multifunction Device 100
`210
`
`212
`
`Speaker 111
`
`Optical
`Sensor 164
`
`Proximity
`Sensor 166
`
`2
`
`06
`
`00
`
`2
`
`oo
`&
`
`wf
`Nl
`
`210 is SIM card slot
`212 is headphone jack
`
`Touch Screen 14
`
`IN
`
`INS
`
`203
`
`Microphone
`113
`
`f Home
`— 204 |
`
`Accelerometer(s)
`168
`
`External Port 124
`
`1
`
`APPLE-1019
`
`1
`
`APPLE-1019
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 1 of 28
`
`US 2011/0074699 Al
`
`126
`128
`130
`132
`
`Portable Multifunction Device
`100
`
`
`
`136
`148
`449
`149-1
`449-2
`149-3
`449-4
`149-5
`
`Memory
`102
`-
`——
`-
`Applications (continued)
`Operating System
`Calendar Module
`Communication Module
`Contact/Motion Module
`-
`-
`Weather Widget
`Graphics Module
`Stocks Widget
`as
`Text Input Module
`Calculator Widget
`136
`GPS Module
`
`Alarm Clock Widget
`137
`Dictionary Widget
`138
`Contacts Module
`slephone Module te||LE]_wo.
`
`Te
`Video Conference Module
`440
`User-Created Widget(s)
`450
`Widget Creator Module
`4154
`E-mail Client Module
`444
`nstant Messaging Module
`4142
`Search Module
`Workout Support Module
`143
`162
`Power
`—e—r oa 444
`
`imageManagementModule|anagement Module 445 System
`
`
`Video Player Module
`146
`-
`Music Player Module
`447
`124
`Browsing Module
`
`Port
`103
`10
`VY 103
`5
`
`
`
`Peripherals
`Interface
`
`Speaker
`111
`
`RF Circuitry
`108
`Audio i
`Circuitry
`110_ +)
`Microphone
`113
`
`103
`
`Sensor
`
`103
`
`166
`
`118
`
`103
`Controll
`ontroler
`
`
`
`Processor(s)
`
`104
`122
`
`120
`
`106
`
`-—"
`Accelerometer(s)
`168
`103
`——
`
`
`/O Subsystem
`158
`Optical
`
`
`
`
`Display
`Other Input
`sensor(s)
`
`Controller
`Controller(s)
`
`Controller
`
`156—“|
`103
`103
`
`Devices
`
`Touch-Sensitive
`
`Display System
`
`112
`
`Oreninput
`
`Sensors)
`
`164
`
`Figure 1A
`
`103
`
`160
`
`116
`
`2
`
`

`

`Patent Application Publication
`
`Mar. 31, 2011 Sheet 2 of 28
`
`US 2011/0074699 Al
`
`Memory 102
`
`Operating System
`Communication Module
`
`Contact/Motion Module
`
`Graphics Module
`Text Input Module
`GPS Module
`
`ontacts Module
`
`elephone Module
`
`E-mail Client Module
`
`nstant Messaging Module
`
`Camera Module
`
`mage Management Module
`Video and Music Player Module
`
`Notes Module
`
`126 Applications (continued)
`128
`
`82
`
`134
`135
`136
`
`ios
`
`ino
`
`up
`
`tat
`
`‘ap
`143
`44
`152
`153
`
`-
`
`:
`
`Power
`System
`
`162
`
`ae
`19
`
`Mao
`
`403
`149-3
`149-4
`
`149-6
`
`‘0
`
`tt
`
`155
`
`Portable Multifunction Device 100
`2>s|5</a4;o»°° =°°<¢oOa-~3°co3>c®sog3\8/3/3 3=® S=aca==©D
`
`Browsing Module
`
`124
`
`External
`154
`Port
`147
`403
`103
`118
`,
`RF Circuitry
`108
`Speaker
`Av
`404
`111
`
`Controll | 0°|Audio =(
`
`110 +)
`Microphone
`113
`
`
`
`Peripherals
`Interface
`
`103
`
`Sensor
`
`103
`
`166
`
`
`
`120
`
`106
`
`Processor(s)
`
`
`
`-—™ Accelerometer(s)
`168
`y*103
`——
`
`
`VO Subsystem
`158
`
`-
`Display
`Optical
`Other Input
`
`
`
`
`sensor(s)
`
`Controller
`Controller(s)
`
`
`Controller
`
`156——“|
`
`103
`
`103
`
`103
`
`Display System Control
`Devices
`
`Touch-Sensitive
`
`112
`
`Other Input
`
`Optical
`Sensor(s)
`164
`
`Figure 1B
`
`160
`
`116
`
`3
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 3 of 28
`
`US 2011/0074699 Al
`
`Portable Multifunction Device 100
`
`Ze
`
`Speaker 111
`
`Optical
`Sensor 164
`
`Proximity
`Sensor 166
`
`206
`
`200
`
`.
`o
`
`oO
`oO
`N
`
`210 is SIM card slot
`212 is headphone jack
`
`Touch Screen 11
`
`202
`
`203
`
`Microphone
`113
`
`a oN
`
`( Home \
`. 204 |}
`
`Accelerometer(s)
`168
`
`External Port
`
`124
`
`Figure 2
`
`4
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 4 of 28
`
`US 2011/0074699 Al
`
`Memory 370
`
`300
`Device
`evice
`
`310
`
`390
`
`CPU
`
`(s)
`
`330
`
`I/O Interface
`
`126
`128
`130
`132
`134
`136
`137
`138
`139
`140
`144
`442
`143
`444
`445
`146
`447
`148
`149
`149-1
`149-3
`149-4
`449-5
`
`Operating System
`Communication Module
`Contact/Motion Module
`Graphics Module
`Text Input Module
`—
`
`
`Contacts Module
`
`Telephone Module
`Video Conference Module
`
`E-mail Client Module
`Instant Messaging Module
`
`
`Workout Support Module
`
`Camera Module
`
`Image Management Module
`
`Video Player Module
`
`Music Player Module
`
`Browsing Module
`Calendar Module
`Weather Widaet
`
`Stocks Widget
`Calculator Widget
`Alarm Clock Widget
`
`Dictionary Widget
`Network
`360|Communications PP tag
`Interface
`User-Created Widget(s)
`450
`
`Widget Creator Module
`451
`er on
`380
`
`IDrawingModuleMo ule
`382
`
`Presentation Module
`384
`
`Word Processing Module
`386
`Website Creation Module
`388
`
`
`Disk Authoring Module
`390
`
`Spreadsheet Module
`
`
`
`Display
`Keyboard/
`
`e
`
`Touchpad
`
`340
`
`355
`
`Figure 3
`g
`
`
`
`5
`
`

`

`Patent Application Publication
`
`Mar.31, 2011 Sheet 5 of 28
`
`US 2011/0074699 Al
`
`Portable Multifunction Device
`
`
`
`
`
`
`
`
`
`
`
`
`Photos
`144
`
`a“
`
`—
`
`Weather
`149-1
`
`Stocks
`149-2
`
`
`
`Videos
`145
`
`
`Jan
`
`
`
`15
`
`Workout
`Support
`142
`
`Calendar
`148
`
`168 Figure 4A
`
`
`
`N\
`
`Jo
`
`:ABC.
`
`‘Sy
`
`i/
`
`User- >
`
`| Created
`
`/ \Widget /
`Widget
`Dictionary
`149-6
`149-5
`
`Calculator
`149-3
`
`Alarm
`149-4
`
`
`
`Music
`146
`
`Touch Screen 112
`
`Microphone
`113)
`
`( Home \
`| 204 |
`
`Accelerometer(s)
`
`6
`
`6
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 6 of 28
`
`US 2011/0074699 Al
`
`206
`
`Portable Multifunction Device
`100
`
`
`
`
`
`
`Jan
`15
`
`
`
`
`
`
`Calendar
`148
`
`Photos
`144
`
`Online
`Video
`155
`
`Stocks
`149-2
`
`a
`
`Nf
`
`154
`
`Weather
`149-1
`
`Calculator
`149-3
`
`Notes
`153
`
`Settings
`412
`
`
`
` 7
`
`\Oe
`
`Browser
`147
`
`iPod
`152
`
`f
`
`Touch Screen 112
`
`{Miewrnone|(‘Home,\(Accelerorneter(s)(Meroprone|204 |J (Acceterorietens))
`
`Figure 4B
`
`7
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 7 of 28
`
`US 2011/0074699 Al
`
`450
`
`468
`
`470
`
`453
`
` Figure 4C
`
`8
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 8 of 28
`
`US 2011/0074699 Al
`
`
`
`Portable Multifunction Device 100
`
`
`
`
`Pg.2 ~*500-2
`Pg. 3
`
`Pg. 3
`pg. 3 7500-3
`Pg. 4
`
`Pg. 4
`
`Pg.4 “500-4
`Pg. 5
`
`
`
`
`
`
`
`
`208
`
`208
`
`
`
`
`
`
`
`
`
`ScrollSpeed
`
`Scroll Distance
`
`9
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 9 of 28
`
`US 2011/0074699 Al
`
`Portable Multifunction Device 100
`
`208
`
`208
`
`
`
`
`
`
`
`
`
`~>500-3
`
`502
`
`Figure
`5B
`
`5B2
`
`oO
`oO
`oO
`a—
`512
`
`GannceceenceencenececennncenesnaneneennnnnceensnneneenenesSo.
`oO
`Adjusted — 514-A
`”
`
`
`
`5B3
`
`1
`
`2
`
`3
`
`5
`4
`Scroll Distance
`
`6
`
`7
`
`8
`
`10
`
`
`
`
`
`
`
`
`
`Pg. 9
`
`Pg. 10
`
`Pg, 10
`Pg. 10
`
`5B1
`
`
`
`10
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 10 of 28
`
`US 2011/0074699 Al
`
`
`
`
`
`ScrollSpeed
`
`510
`
`5C1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`Pg. 6
`
`Pg. 6
`
`Pg. 6
`Pg. 7
`
`Pg. 7
`
`Pg. 7
`Pg. 8
`
`Pg. 8
`
`Pg. 8
`Pg. 9
`
`Pg. 9
`
`Pg. 9
`Pg. 10
`
`Pg. 10)
`
`Pg. 10
`
`Figure
`5C
`
`5C2
`
`Adjusted — 514-A
`
`5C3
`
`1
`
`2
`
`3
`
`5
`4
`Scroll Distance
`
`6
`
`7
`
`8
`
`9
`
`11
`
`11
`
`

`

`Patent Application Publication Mar. 31,2011 Sheet 11 of 28
`
`US 2011/0074699 Al
`
`Portable Multifunction Device 100
`
`
`Pg. 9
`
`Speed
`
`Pg _ 504-1a
`
`Pg. 5A504-14-—- —
`
`
`
`Scroll
`
`5D3
`
`4
`
`
`
`Pg. 1
`
`
`
`502
`
`
`
`00-5
`
`Figure
`5D
`
`
`
`
`
`
`
`2
`
`3
`
`4
`
`5
`
`6
`
`7
`
`8
`
`9
`
`Scroll Distance
`
`12
`
`12
`
`

`

`Patent Application Publication Mar. 31,2011 Sheet 12 of 28
`
`US 2011/0074699 Al
`
`Portable Multifunction Device 100
`
`Pg. 1
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`ScrollSpeed
`
`5E3
`
`1
`
`2
`
`3
`
`4
`
`5
`
`6
`
`7
`
`8
`
`9
`
`Scroll Distance
`
`13
`
`13
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 13 of 28
`
`US 2011/0074699 Al
`
`
`
`
`
`
`
`
`
`\ng500-6 SF
`Pg. 7
`
`Pg. 7
`
`Pg. 7
`Pg. 8
`
`Pg. 8
`
`Pg. 8
`Pg. 9
`
`Pg. 9
`
`Pg. 9
`
`
`
`
`
`ScrollSpeed
`
`
`
` Figure
`
`
`516
`
`5F3
`
`1
`
`2
`
`3
`
`5
`4
`Scroll Distance
`
`6
`
`7
`
`8
`
`9
`
`14
`
`14
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 14 of 28
`
`US 2011/0074699 Al
`
`
`
`
`
`510
`
`5G1
`
`Pg. 10
`Pg.10]
`
`5G?
`
`
`
`ScrollSpeed
`
`Adjusted 524-A
`
`--$—————___ Initial 524
`
`Pg. 10
`
`
`
`
`5G3
`
`1
`
`2
`
`3
`
`5
`4
`Scroll Distance
`
`6
`
`7
`
`8
`
`9
`
`15
`
`15
`
`

`

`Patent Application Publication Mar. 31,2011 Sheet 15 of 28
`
`US 2011/0074699 Al
`
`
`
`Pg.
`
`1
`
`
`
`SS by5,500-5
`50g Pg. 6504-14 ae
`502 _
`Figure
`
`Portable Multifunction Device 100
`
`
`Pg. 9
`Speed
`
`Scroll
`
`5H3
`
`4
`
`2
`
`3
`
`5
`4
`Scroll Distance
`
`6
`
`7
`
`8
`
`9
`
`16
`
`16
`
`

`

`Patent Application Publication Mar. 31,2011 Sheet 16 of 28
`
`US 2011/0074699 Al
`
`
`
`
`
`Pg. 1
`
`Pg. 1
`Pg. 1
`Pg. 2
`
`Pg. 2
`
`Pg. 2
`Pg. 3
`
`Pg. 3
`
`Pg. 3
`Pg. 4
`
`Pg. 4
`
`Pg. 4
`Pg. 5
`
`
`Pg. 5
`
`Pg. 5
`
`
`Pg. 6
`P96
`\
`\Pg.6
`
`Figure
`~500-6 5
`
`
`
`Portable Multifunction Device 100
`
`Pg. 9
`
`516
`
`
`
`
`
`
`
`ScrollSpeed
`
`513
`
`.
`Scroll Distance
`
`17
`
`17
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 17 of 28
`
`US 2011/0074699 Al
`
`
`
`Pg. 1
`
`Pg. 1
`Pg. 1
`Pg. 2
`
`Pg. 2
`
`
`Pg. 2
`Pg. 3
`
`Pg. 3
`
`
`Pg. 3
`Pg. 4
`
`Pg. 4
`
`Pg. 4
`Pas
`
`*Pg. 5
`
`Pg. 7+".
`
`504-16.
`
` Pg. 9 Pg. 9
`
`
`
`534-2
`
`.
`
`N
`
`S.
`
`[pg
`Pg. 6
`
`Figure
`500-6 5J
`
`502
`
`~~500-7
`
`
`Pg. 7
`Pg. 8
`
`Pg. 8
`
`Pg. 8
`Pg. 9
`
`Speed
`
`Scroll
`
`5J3
`
`Scroll Distance
`
`18
`
`18
`
`

`

`
`
`
`
`
`
`
`
`
`
`
`
`ScrollSpeed
`
`Patent Application Publication Mar. 31, 2011 Sheet 18 of 28
`
`Portable Multifunction Device 100
`
`"5383
`
`598-4 + 3
`538-2
`
`Pg. Fe
`
`US 2011/0074699 Al
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`5K3
`
`4
`
`2
`
`3
`
`5
`|
`4
`Scroll Distance
`
`6
`
`7
`
`8
`
`9
`
`19
`
`19
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 19 of 28
`
`US 2011/0074699 Al
`
`
`
`
`
`
`
`
`
`Figure
`
`Portable Multifunction Device 100
`5L
`
`
`
`
`
`ScrollSpeed
`
`
`
`
`
`
`
`
`
`
`SL3
`
`Scroll Distance
`
`20
`
`516
`
`20
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 20 of 28
`
`US 2011/0074699 Al
`
`Portable Multifunction Device 100
`
`
`
`Pg. 1
`
`
`
`
`
`
`
`
`
`
`
`
`
`Figure
`5M
`
`
`
`
`
`OD
`oD
`®o
`Qa
`
`2
`
`510
`
`5M1
`
`
`
`
`Pg. 10
`
`Pg. 10
`Pg, 10
`
`5M2
`
`
`
`o ~ee ee ee ee ee ee ee ee ee ee eeKe
`oO
`”
`
`Adjusted 542-A
`
`pil
`
`
`
`4
`
`2
`
`3
`
`4
`
`5
`
`6
`
`7
`
`8
`
`9
`
`516
`
`Initial 542
`
`5M3
`
`Scroll Distance
`
`21
`
`21
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 21 of 28
`
`US 2011/0074699 Al
`
`Portable Multifunction Device 100
`
`
`950-2
`
`reece,
`
`
`
`
`
`
`
`
`
`
`
`Figure
`5N
`
`500-8
`502
`
`500-9
`
`5N2
`
`508
`
`512
`nnnnanceeeepeceecceeccereccenecenees5.
`.
`
`*Initial 552
`
`-
`oO
`oO
`B
`BH
`
`5a
`
`
`
`5N3
`
`1
`
`2
`
`3
`
`5
`4
`Scroll Distance
`
`6
`
`7
`
`8
`
`9
`
`516
`
`22
`
`22
`
`

`

`Patent Application Publication Mar. 31,2011 Sheet 22 of 28
`
`US 2011/0074699 Al
`
`
`
`
`
`
`
`Figure
`50
`
` Scroll
`
`Speed
`
`503
`
`1
`
`2
`
`3
`
`4
`5
`Scroll Distance
`
`6
`
`7
`
`8
`
`516
`
`9
`
`23
`
`23
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 23 of 28
`
`US 2011/0074699 Al
`
`> iO
`
`r
`;
`;
`;
`;
`| Respective logical structure boundaries correspond to respective page 1
`|
`boundaries within the electronic document.
`
`r
`
`;
`The logical structure boundaries are row and/or column boundaries
`within the electronic document.
`
`An entire document section is displayed on the display, and the first
`logical structure boundaryis displayed at a location selected from the
`group consisting of the top of the display and the bottom of the
`display.
`
`!
`
`!
`
`Display on the display an electronic documentthat includes a plurality of
`document sections separated by respective logical structure boundaries.
`| Respectivedocumentsectionscorrespondto respective pages within ||604
`|
`the electronic document.
`
`distance function.
`
`Detect a gesture on the touch-sensitive surface, wherein aninitial contact of||
`the gestureis at a location that corresponds to a first location in the
`electronic document, the gesture having gesture parametersthat include an
`initial velocity.
`
`When the initial velocity of the gesture exceeds a predefined speed
`threshold such that the gesture will scroll the electronic document more
`than one document section:
`
`Initiate scrolling of the electronic document on the display atthe initial
`velocity in accordancewith an initial scrolling speed versus scrolling
`
`Figure 6A
`
`24
`
`24
`
`

`

`Patent Application Publication Mar. 31,2011 Sheet 24 of 28
`
`US 2011/0074699 Al
`
`When the initial velocity of the gesture exceeds a predefined speed
`threshold such that the gesture will scroll the electronic document more
`than one document section:
`
`While scrolling the electronic documenton the display, adjust the
`scrolling speed versus scrolling distance function so that when the
`scrolling speed becomeszero, a first logical structure boundary in the
`electronic documentis displayed at a predefined location on the
`display.
`
`p618
`
`occurs within a predefined time after detecting liftoff of the gesture
`ae
`from the touch-sensitive surface.
`
`_
`
`620
`
`is performed substantially at the time of detecting liftoff of the
`gesture from the touch-sensitive surface.
`
`— 622
`
`~~ 628
`
`I
`
`The predefined location on the display of the first logical structure
`boundary is selected from the group consisting of the top of the
`display and the bottom of the display.
`
`j------------------------------------------
`Use one or more of a gesture acceleration value, the initial velocity,
`and a gesture distance, to calculate the adjusted scrolling speed
`versus scrolling distance function
`
`— 624
`
`— 626
`
`(-----------------------------------------------
`| Scroll the electronic document in accordancewith the initial scrolling speed
`| versus scrolling distance function whentheinitial velocity of the gestureis Le 630
`below the predefined speed threshold.
`|
`
`po--------------------- +--+ --- +--+ -------------
`| Forego adjusting the scrolling speed versus scrolling distance function when
`the electronic documentis displayed at a magnification level greater than a _- 632
`predefined magnification level.
`|
`
`|
`
`Figure 6B
`
`25
`
`25
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 25 of 28
`
`US 2011/0074699 Al
`
`— ee ee ee ee ee ee ee ee Ee Ee ee ee EE EE EE EE EE EE EE EE EE EE EE
`
`Detect a touch gesture on the touch sensitive surface at a location
`corresponding to a location in the electronic document.
`|
`I Terminate the scrolling of the electronic document on the display in
`;
`responseto detecting the touch gesture on the touch sensitive surface | Ur 638
`at the location corresponding to the executable icon in the electronic
`document.
`
`|
`
`|
`
`|
`;
`
`Determine that the location of the touch gesture corresponds to an
`executable icon within the electronic document.
`
`+|
`
`
`
`I
`
`Adjusting the adjusted scrolling speed versus scrolling distance function
`comprises:
`Determine a point in the electronic documentthat correspondsto a total
`distance to be scrolled from the first location in the electronic document in
`accordance with the initial scrolling speed versus scrolling distance
`function.
`
`Lr 644
`
`eaaa na a a aaaa aa aaa ae ae ee ee 4
`|
`Identify a document section in the plurality of document sections that Ly 648
`I
`contains the point in the electronic document.
`;
`|
`PTTTT YTTT ay|
`|
`Identify a logical structure boundary associated with the determined point.
`;—
`foYtl
`Adjust the scrolling speed versus scrolling distance function so the scrolling ty 652
`of the electronic documentwill end whenthe identified logical structure
`boundaryis displayed at an extremum ofthe display.
`
`7
`
`rcoccccco
`
`\(
`
`Figure 6C
`
`26
`
`26
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 26 of 28
`
`US 2011/0074699 Al
`
`IO IO iO
`
`Display on the display an electronic documentthat includes a plurality of
`document sections separated by respective logical structure boundaries.
`
`Detect a gesture on the touch-sensitive surface, wherein an initial contact of
`,
`_
`the gesture is at a location that corresponds to a first location in the
`electronic document, the gesture having gesture parameters that include an
`initial velocity.
`
`|’662
`
`| 664
`
`- 666
`Whentheinitial velocity of the gesture exceeds a predefined speed
`threshold such that the gesture will scroll the electronic document more|~
`than one document section:
`
`Initiate scrolling of the electronic document on the display at the initial
`velocity in accordancewith aninitial scrolling speed versus scrolling
`distance function.
`
`r~ 668
`
`
`
`While scrolling the electronic document on the display, determine a
`670
`~~
`total scrolling distance based on theinitial velocity, wherein the total
`scrolling distance is adjusted to correspondtoafirst logical structure
`boundary in the electronic document.
`
`_
`
`[Oenan7
`1 Adjustmentof the total scrolling distance is performed substantially
`at the time of detecting liftoff of the gesture from the touch-sensitive
`surface.
`
`!
`
`Scroll the electronic documentfor the total scrolling distance.
`
`_
`
`~~
`
`672
`
`“~ 674
`
`Figure 6D
`
`27
`
`27
`
`

`

`Patent Application Publication Mar. 31, 2011 Sheet 27 of 28
`
`US 2011/0074699 Al
`
`Im OO iO
`
`Display on the display an electronic documentthat includes a plurality of
`document sections separated by respective logical structure boundaries.
`
`Detect a gesture on the touch-sensitive surface, the detected gesture
`corresponding to a scroll of the electronic document having a scrolling
`distance that is more than one document section.
`
`scrolling distance.
`
`In responseto detecting the gesture:
`
`Initiate scrolling of the electronic document on the display.
`
`While scrolling the electronic document on the display, adjust the
`scrolling distance so that whenthe scrolling stops, a first logical
`structure boundary in the electronic documentwill be at a predefined
`location on the display
`
`“Adjustmentofthescrolling distanceis performedsubstantially at|
`the time of detecting liftoff of the gesture from the touch-sensitive
`ae ee ee ee ee ee ee ee ee ee ee ee ee ee ee ee EE EE 4
`surface.
`
`Scroll the electronic documentin accordancewith the adjusted
`
`Figure 6E
`
`28
`
`28
`
`

`

`Patent Application Publication
`
`Mar.31, 2011 Sheet 28 of 28
`
`US 2011/0074699 Al
`
`dq
`
`2anbi4
`
`Vzeinbi4
`
`VOOZIN
`
`29
`
`29
`
`
`

`

`US 2011/0074699 Al
`
`Mar. 31, 2011
`
`DEVICE, METHOD, AND GRAPHICAL USER
`INTERFACE FOR SCROLLING A
`MULTI-SECTION DOCUMENT
`
`TECHNICAL FIELD
`
`[0001] The disclosed embodimentsrelate generally to elec-
`tronic devices with touch-sensitive surfaces, and more par-
`ticularly, to methods and electronic devices with touch-sen-
`sitive
`surfaces
`for
`scrolling multi-section electronic
`documents in accordance with heuristics for improved elec-
`tronic documentdisplay.
`
`BACKGROUND
`
`[0002] The use of touch-sensitive surfaces as input devices
`for computers and other electronic computing devices has
`increased significantly in recent years. Exemplary touch-sen-
`sitive surfaces include touch pads and touch screen displays.
`Such surfaces are widely used to manipulate user interface
`objects on a display.
`[0003] Many users rely on electronic computing devices
`with touch-sensitive surfaces and displays for viewing and
`manipulating multi-section electronic documents. In these
`circumstances, users may navigate through an electronic
`documenton the display with gestures on the device’s touch-
`sensitive surface or touch screen. Unfortunately, existing
`methods for scrolling multi-section documents are cumber-
`someand inefficient, and often do notresult in the display of
`electronic documents according to a user’s desires. In addi-
`tion, existing methods of scrolling through documents take
`longer than necessary, thereby wasting energy. This latter
`consideration is particularly important in battery-operated
`devices.
`
`[0004] Accordingly, there is a need for computing devices
`with faster, more efficient methods and interfaces for scroll-
`ing multi-section documents in accordance with heuristics
`that improveelectronic documentdisplay. Such methods and
`interfaces may complementor replace conventional methods
`for scrolling multi-section documents. Such methods and
`interfaces reduce the cognitive burden on a user and produce
`a more efficient human-machineinterface. For battery-oper-
`ated computing devices, such methods and interfaces con-
`serve power and increase the time between battery charges.
`
`support, digital photographing, digital videoing, web brows-
`ing, digital music playing, and/or digital video playing.
`Executable instructions for performing these functions may
`be included in a computer readable storage medium or other
`computer program product configured for execution by one or
`more processors.
`
`In accordance with some embodiments, a methodis
`[0006]
`performed at a multifunction device with a display, and a
`touch-sensitive surface. The method includes: displaying on
`the display an electronic documentthat includesa plurality of
`documentsections separated by respective logical structure
`boundaries; detecting a gesture on the touch-sensitive sur-
`face, wherein an initial contact of the gesture is at a location
`that correspondsto a first location in the electronic document,
`the gesture having gesture parameters that include aninitial
`velocity; and whentheinitial velocity of the gesture exceeds
`a predefined speed threshold such that the gesture will scroll
`the electronic document more than one documentsection:
`initiating scrolling of the electronic documenton the display
`at the initial velocity in accordance with an initial scrolling
`speed versus scrolling distance function; while scrolling the
`electronic document on the display, adjusting the scrolling
`speed versus scrolling distance function so that when the
`scrolling speed becomeszero,a first logical structure bound-
`ary in the electronic documentis displayed at a predefined
`location on the display; and, scrolling the electronic docu-
`ment in accordance with the adjusted scrolling speed versus
`scrolling distance function.
`[0007]
`In accordance with some embodiments, a multi-
`function device includes a display, a touch-sensitive surface,
`one or more processors, memory, and one or more programs.
`The one or more programs are stored in the memory and
`configured to be executed by the one or more processors. The
`one or more programsinclude instructionsfor: displaying on
`the display an electronic documentthat includesa plurality of
`documentsections separated by respective logical structure
`boundaries; detecting a gesture on the touch-sensitive sur-
`face, wherein an initial contact of the gesture is at a location
`that correspondsto a first location in the electronic document,
`the gesture having gesture parameters that include aninitial
`velocity; and whentheinitial velocity of the gesture exceeds
`a predefined speed threshold such that the gesture will scroll
`the electronic document more than one documentsection:
`
`SUMMARY
`
`initiating scrolling of the electronic documenton the display
`at the initial velocity in accordance with an initial scrolling
`speed versus scrolling distance function; while scrolling the
`[0005] The above deficiencies and other problemsassoci-
`electronic document on the display, adjusting the scrolling
`ated with user interfaces for computing devices with touch-
`speed versus scrolling distance function so that when the
`sensitive surfaces are reducedor eliminated by the disclosed
`scrolling speed becomeszero,a first logical structure bound-
`devices. In some embodiments, the device is a desktop com-
`ary in the electronic documentis displayed at a predefined
`puter. In some embodiments, the device is portable (e.g., a
`location on the display; and, scrolling the electronic docu-
`notebook computer, tablet computer, or handheld device). In
`ment in accordance with the adjusted scrolling speed versus
`some embodiments, the device has a touchpad. In some
`scrolling distance function.
`embodiments, the device has a touch-sensitive display (also
`[0008]
`In accordance with some embodiments, a computer
`known as a “touch screen” or “touch screen display”). In
`readable storage medium has stored therein instructions
`some embodiments, the device has a graphical user interface
`which when executed by a multifunction device with a dis-
`(GUI), one or more processors, memory and one or more
`play and a touch-sensitive surface, cause the device to: dis-
`modules, programs or sets of instructions stored in the
`play on the display an electronic document that includes a
`memory for performing multiple functions. In some embodi-
`plurality of documentsections separated by respective logical
`ments, the user interacts with the GUI primarily through
`structure boundaries; detect a gesture on the touch-sensitive
`finger contacts and gestures on the touch-sensitive surface. In
`surface, wherein an initial contact of the gesture is at a loca-
`some embodiments, the functions may include imageediting,
`
`drawing, presenting, word processing, website creating, disk tion that correspondstoafirst location in the electronic docu-
`authoring, spreadsheet making, game playing, telephoning,
`ment, the gesture having gesture parameters that include an
`video conferencing, e-mailing, instant messaging, workout
`initial velocity; when the initial velocity of the gesture
`
`30
`
`30
`
`

`

`US 2011/0074699 Al
`
`Mar. 31, 2011
`
`exceeds a predefined speed threshold such that the gesture
`will scroll the electronic document more than one document
`
`section: initiate scrolling of the electronic document on the
`display at the initial velocity in accordance with an initial
`scrolling speed versus scrolling distance function; while
`scrolling the electronic document on the display, adjust the
`scrolling speed versus scrolling distance function so that
`whenthe scrolling speed becomeszero, a first logical struc-
`ture boundary in the electronic documentis displayed at a
`predefined location on the display; and, scroll the electronic
`document in accordance with the adjusted scrolling speed
`versus scrolling distance function.
`[0009]
`In accordance with some embodiments, a graphical
`user interface is displayed on a multifunction device with a
`display, a touch-sensitive surface, a memory, and one or more
`processors to execute one or more programsstored in the
`memory. The graphical user interface includes an electronic
`documentdisplayed on the display, which includesa plurality
`of document sections separated by respective logical struc-
`ture boundaries, wherein: a gesture is detected on the touch-
`sensitive surface, wherein an initial contactofthe gestureis at
`a location that correspondsto a first location in the electronic
`document, the gesture having gesture parametersthat include
`an initial velocity; when the initial velocity of the gesture
`exceeds a predefined speed threshold such that the gesture
`will scroll the electronic document more than one document
`
`gesture on the touch-sensitive surface, wherein aninitial con-
`tact of the gesture is at a location that correspondsto a first
`location in the electronic document, the gesture having ges-
`ture parameters that include an initial velocity; when the
`initial velocity of the gesture exceeds a predefined speed
`threshold such thatthe gesture will scroll the electronic docu-
`ment more than one documentsection: means for initiating
`scrolling of the electronic document on the display at the
`initial velocity in accordance with an initial scrolling speed
`versus scrolling distance function; while scrolling the elec-
`tronic document on the display, means for adjusting the
`scrolling speed versus scrolling distance function so that
`whenthe scrolling speed becomeszero, a first logical struc-
`ture boundary in the electronic documentis displayed at a
`predefined location on the display; and, means for scrolling
`the electronic document in accordance with the adjusted
`scrolling speed versus scrolling distance function.
`[0012]
`In accordance with some embodiments, a methodis
`performed at a multifunction device with a display and a
`touch-sensitive surface. The method includes: displaying on
`the display an electronic documentthat includesa plurality of
`documentsections separated by respective logical structure
`boundaries; detecting a gesture on the touch-sensitive sur-
`face, wherein an initial contact of the gesture is at a location
`that correspondsto a first location in the electronic document,
`the gesture having gesture parameters that include aninitial
`velocity; when the initial velocity of the gesture exceeds a
`predefined speed threshold such that the gesture will scroll
`the electronic document more than one documentsection:
`
`section: scrolling of the electronic documentis initiated on
`the display at the initial velocity in accordance with aninitial
`scrolling speed versus scrolling distance function; while
`initiating scrolling of the electronic documenton the display
`scrolling the electronic documenton the display, the scrolling
`at the initial velocity in accordance with an initial scrolling
`speed versus scrolling distance function is adjusted so that
`speed versus scrolling distance function; while scrolling the
`whenthe scrolling speed becomeszero, a first logical struc-
`electronic documenton the display, determining a total scroll-
`ture boundary in the electronic documentis displayed at a
`ing distance based on the initial velocity, wherein the total
`predefined location on the display; and, the electronic docu-
`
`ment is scrolled in accordance with the adjusted scrolling scrolling distance is adjusted to correspondtoafirst logical
`speed versus scrolling distance function.
`structure boundary in the electronic document; and,scrolling
`the electronic documentfor the total scrolling distance.
`[0010]
`In accordance with some embodiments, a multi-
`[0013]
`In accordance with some embodiments, a multi-
`function device includes: a display; a touch-sensitive surface;
`and meansfor displaying on the display an electronic docu-
`function device includes a display, a touch-sensitive surface,
`mentthat includesa plurality of documentsections separated
`one or more processors, memory, and one or more programs.
`by respective logical structure boundaries; means for detect-
`The one or more programs are stored in the memory and
`ing a gesture onthe touch-sensitive surface, wherein aninitial
`configured to be executed by the one or more processors. The
`
`contactofthe gesture is at a location that correspondstoafirst one or more programsinclude instructionsfor: displaying on
`location in the electronic document, the gesture having ges-
`the display an electronic documentthat includesa plurality of
`ture parameters that include an initial velocity; when the
`documentsections separated by respective logical structure
`initial velocity of the gesture exceeds a predefined speed
`boundaries; detecting a gesture on the touch-sensitive sur-
`threshold such thatthe gesture will scroll the electronic docu-
`face, wherein an initial contact of the gesture is at a location
`ment more than one documentsection: meansfor initiating
`that correspondsto a first location in the electronic document,
`scrolling of the electronic document on the display at the
`the gesture having gesture parameters that include aninitial
`initial velocity in accordance with an initial scrolling speed
`velocity; when the initial velocity of the gesture exceeds a
`versus scrolling distance function; while scrolling the elec-
`predefined speed threshold such that the gesture will scroll
`the electronic document more than one documentsection:
`tronic document on the display, means for adjusting the
`scrolling speed versus scrolling distance function so that
`initiating scrolling of the electronic documenton the display
`whenthe scrolling speed becomeszero, a first logical struc-
`at the initial velocity in accordance with an initial scrolling
`ture boundary in the electronic documentis displayed at a
`speed versus scrolling distance function; while scrolling the
`predefined location on the display; and, means for scrolling
`electronic documenton the display, determining a total scroll-
`the electronic document in accordance with the adjusted
`ing distance based on the initial velocity, wherein the total
`
`scrolling speed versus scrolling distance function. scrolling distance is adjusted to correspondtoafirst logical
`structure boundary in the electronic document; and,scrolling
`[0011]
`Inaccordance with some embodiments, an informa-
`the electronic documentfor the total scrolling distance.
`tion processing apparatus for use in a multifunction device
`with a display and a touch-sensitive surface includes: m