as) United States
`a2) Patent Application Publication co) Pub. No.: US 2008/0062141 Al
`
`(43) Pub. Date: Mar. 13, 2008
`Chandhri
`
`US 20080062141A1
`
`(54) MEDIA PLAYER WITH IMAGED BASED
`BROWSING
`
`Related U.S. Application Data
`
`(76)
`
`Inventor:
`
`Imran Chandhri, San Francisco,
`CA (US)
`
`Correspondence Address:
`TECHNOLOGY & INNOVATION LAW GROUP,
`PC
`ATTN: 101, 19200 STEVENS CREEK BLVD.,
`SUITE 240
`CUPERTINO, CA 95014
`
`(21) Appl. No.:
`
`11/767,409
`
`(22)
`
`Filed:
`
`Jun. 22, 2007
`
`(60) Provisional application No. 60/843,832, filed on Sep.
`11, 2006, provisional application No. 60/878,746,
`filed on Jan. 5, 2007.
`Publication Classification
`
`(51)
`
`Int. CL
`(2006.01)
`GO6F 3/041
`(52) US. CMe
`ccceccssssssssssssssssveeseesesssssssssssnsnnenees 345/173
`
`(57)
`
`ABSTRACT
`
`Methods and systems that improve the way media is played,
`sorted, modified, stored and cataloged on a portable media
`player are disclosed. One aspect relates to an image based
`browser that allows a user to navigate through and select
`images that are related to media items.
`
`
`
`STORE IMAGE DATA
`
`1002
`
`RETRIEVED IMAGES
`
`RECEIVE DISPLAYCOMMAND
`
`RETRIEVE DESIGNATED
`IMAGES
`
`OUTPUT ONE OR MORE OF
`
`1004
`
`1006
`
`1008
`
`APPLE-1018
`
`1
`
`APPLE-1018
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 1 of 32
`
`US 2008/0062141 Al
`
`2
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 2 of 32
`
`US 2008/0062141 Al
`
`
`
`3
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 3 of 32
`
`US 2008/0062141 Al
`
`50
`
`INPUT
`
`SPEAKER
`
`58B
`
`58A
`
`
`__
`DISPLAY
`
`
`MEDIA
`
`CONTROLLER
`
`52
`
`
`
`
`
`MEDIA
`
`MEDIA FILES
`
`DATABASE
`
`56
`
`64
`
`
`
`
`
`FIG. 4
`
`94
`
`94
`
`92
`
`94
`
`94
`
`82
`
`FIG. 5
`
`4
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 4 of 32
`
`US 2008/0062141 Al
`
`80B
`
`94.94.9494
`
`92
`
`94 94 94 94
`
`
`
`I a|
`I
`
`I
`
`|
`
`I
`
`|
`I
`
`o
`
`
`
`80C
`
`94
`949494
`bib
`
`87
`
`FIG. 6
`
`92
`
`
`
`
`
`
`ON a ; Pid
`
`|
`{
`
`.
`
`82
`
`
`
`949494
`94
`Daa
`
`nrmma!
`
`9
`
`5
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 5 of 32
`
`US 2008/0062141 Al
`
`102
`
`PRESENT IMAGE BROWSER
`WINDOW
`
` 104
`
`PERFORM ACTION
`ASSOCIATED WITH
`IMAGE
`
`Yes
`
`106
`
`108
`
`No
`
`
`
`NAVIGATION
`COMMAND?
`
` No
`
`
`
`Yes
`
`112
`
`
`
` CLOSE
`COMMAND?
`
`
`
`Wo
`
`114
`
`WINDOW
`
`TRANSITION THROUGH
`IMAGES IN
`ACCORDANCEWITH
`NAVIGATION COMMAND
`
`REMOVE IMAGE
`BASED
`BROWSER
`
`FIG. 9
`
`6
`
`

`

`Patent Application Publication
`
`Mar.13, 2008 Sheet 6 of 32
`
`US 2008/0062141 Al
`
`a
`
`vel
`
`GSéL
`
`Ol‘Old
`
`vyOhwing
`
`IsILV
`wingiy
`
`uy
`
`Gsweu6u0Sv
`ZaweuBuos
`
`;aweuBuos|
`
`9eweubuos
`
`BuikeldMONZouies
`
`|
`
`}aweuBuos
`eweuWngiy
`
`SUeUISI
`
`ecb
`
`CCL
`
`py8h}windy
`
`suasodwoy
`
`Ssyooqgolpny
`
`S$81Uas)
`
`él
`
`Ol
`
`S}siAeld
`
`sojOUd
`
`SOSPIA
`
`Se1]XQ
`
`sBuijas
`
`S|SIUY
`
`sungiy
`
`BuiAejqMON
`
`sbuosanus
`
`
`
`
`
`192dBIPa|a|Qeyod
`
`7
`
`
`
`
`
`
`
`
`
`
`

`

`
`
`
`Extras
`Playlists
`.
`Settings
`Movies
`
`
`Shuffle Songs Music Videos
`
`Now Playing
`TV Shows
`
`
`Video meicasf=|Mod
`
`
`VideoPodeast
`Video SettingsPg
`
`
`
`
`
`
`
`
`
`
`>
`
`Video Settings
`
`Image
`
`
`
`133
`
`Patent Application Publication Mar. 13, 2008 Sheet 7 of 32
`
`US 2008/0062141 Al
`
`130
`
`Portable Media Player
`
`Photos
`
`|
`
`
`
`Portable Media Player
`
`
`Music
`
`
`Photos
`
`
`Extras
`
`Settings
`Shuffle Songs —
`
`:
`Music Videos
`Now Playing
`TV Shows
`
`
` FIG. 11
`
`136
`
`8
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 8 of 32
`
`US 2008/0062141 Al
`
`140
`
`142
`
`FIG. 12A
`
`
`
`ADDRESS BOOK
`140
`
`144
`
`PN ADDRESS BOOK
`
`Joe Smith
`346 Emerald Ave
`Mesa, AZ 94037
`
`602-345-9876
`loo@mac,com
`
`4446
`
`FIG. 12B
`
`9
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 9 of 32
`
`US 2008/0062141 Al
`
`150
`
`170
`
`APPLICATIONS
`PHOTOS
`
`We
`
`FIG. 13
`
`172
`
`FIG. 15
`
`10
`
`10
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 10 of 32
`
`US 2008/0062141 Al
`
`160
`
`CALENDAR
`
`FIG. 14D
`
`11
`
`11
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 11 of 32
`
`US 2008/0062141 Al
`
`182
`
`FIG. 16
`
`
`
`190A
`
`180
`DATA ENTRY
`
`
`
`192A
`
`FIG. 17A 194
`
`DATA ENTRY
`
`190B
`
`
`
`1928
`
`FIG. 17B 194
`
`FRED F(}
`
`12
`
`12
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 12 of 32
`
`US 2008/0062141 Al
`
`~~
`
`
`DISPLAY IMAGE BASED BROWSER
`WINDOW
`
`DETECT OBJECT OVER A SENSING
`SURFACE
`
`INPUT
`
`TRANSITION THROUGH IMAGES OF
`IMAGE BASED BROWSER IN
`ACCORDANCEWITH NAVIGATIONAL
`
`RECOGNIZE NAVIGATIONAL INPUT BASED
`ON OBJECT ACTION
`
`202
`
`204
`
`206
`
`208
`
`13
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 13 of 32
`
`US 2008/0062141 Al
`
`FIG. 19D
`
`
`FIG. 19E
`214
`
`FIG. 19C
`
`FIG. 19F
`
`FIG. 19G
`
`FIG. 19H
`
`14
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 14 of 32
`
`US 2008/0062141 Al
`
`
`
`DISPLAY IMAGE BASED BROWSER
`WINDOW
`
`DETECT OBJECT OVER A SENSING
`SURFACE
`
`IMAGE BEING SELECTED
`
`RECOGNIZE SELECTION INPUT BASED ON
`OBJECT ACTION
`
`INITIATE ACTION ASSOCIATED WITH
`
`252
`
`254
`
`256
`
`258
`
`|
`
`15
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 15 of 32
`
`US 2008/0062141 Al
`
`FIG. 21A
`
`
`
`277
`
`
`FIG. 21D
`
`FIG. 21E
`
`FIG. 21F
`
`16
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 16 of 32
`
`US 2008/0062141 Al
`
`DISPLAY IMAGE BASED BROWSER
`WINDOW
`
`DETECT OBJECT OVER A SENDING
`
`302
`
`304
`
`300 ~\
`
`SURFACE
`
`
`SELECTED? No
`
`314
`
`SELECTABLE DATA
`
`TRANSITION THROUGH
`IMAGES OF IMAGE
`BASED BROWSER IN
`ACCORDANCEWITH
`FIRST INPUT
`
`INPUT?
`
`No
`
`Yes
`
`312
`
`PRESENT SELECTABLE
`DATA ASSOCIATED WITH
`IMAGE
`
` DATA
`
`Yes
`
`INITIATE ACTION
`ASSOCIATED WITH
`
`306
`
`316
`
`FIG. 22
`
`318
`
`17
`
`17
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 17 of 32
`
`US 2008/0062141 Al
`
`FIG. 23F
`
`FIG. 23G
`
`lo
`
`Now Playing
`
`Album title 14
`Artist
`Song name 2
`
`FIG. 23D
`
`FIG. 23H
`
`18
`
`18
`
`

`

`Patent Application Publication
`
`Mar.13, 2008 Sheet 18 of 32
`
`US 2008/0062141 Al
`
`9/86-SPE-c09 VeeSls
`
`dreSls
`
`9286-SPE-c09
`
`6829O9
`
`6829-vES-c09
`
`
`
`woo’sew®s0/!
`
`19
`
`6829-€S-Z09|®HLIWS
`
`gorONITWO
`
`aveSls
`
`Ore‘Old
`
`Ub‘SlsYwoooeWsof
`
`9L86-SPt-c09
`
`6829-PES-C09
`
`He‘Sls
`
`AveSls
`
`
`
`Adve‘Sls
`
`19
`
`
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 19 of 32
`
`US 2008/0062141 Al
`
`DISPLAY IMAGE BASED BROWSER
`WINDOW
`
`352
`
`FLIP INPUT IS DETECTED
`
`FLIP BETWEEN FIRST AND SECOND
`IMAGES AT PRIMARY POSITION WHEN
`
`DETECT FLIP INPUT
`
`FIG. 25
`
`20
`
`20
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 20 of 32
`
`US 2008/0062141 Al
`
`FIG. 26A
`
`
`
`
`
`FIG. 26B
`
`FIG. 26C
`
`21
`
`21
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 21 of 32
`
`US 2008/0062141 Al
`
`
`
`
`FIG. 26D
`
`FIG. 26E
`
`22
`
`22
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 22 of 32
`
`US 2008/0062141 Al
`
`=~
`
`POSITION
`
`TRANSITION THROUGH IMAGES IN
`ORDER TO PLACE SELECTED
`SECONDARYIMAGE AT PRIMARY
`
`DISPLAY IMAGE BASED BROWSER
`WINDOW
`
`402
`
`RECOGNIZE SELECTION INPUT OVER
`ONE OF SECONDARY IMAGES
`
`FIG. 27
`
`23
`
`23
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 23 of 32
`
`US 2008/0062141 Al
`
`
`
`FIG. 28A
`
`
`
`FIG. 28B
`
`24
`
`24
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 24 of 32
`
`US 2008/0062141 Al
`
`om
`
`DISPLAY IMAGE BASED BROWSER
`WINDOW
`
`POSITION
`
`TRANSITION THROUGH IMAGES IN
`ORDER TO PLACE FIRST IMAGE
`ASSOCIATED WITH LETTER IN PRIMARY
`
`DISPLAY ALPHABET UNDERNEATH
`BROWSER
`
`DETECT OBJECT OVER LETTER
`
`422
`
`424
`
`426
`
`428
`
`FIG. 29
`
`25
`
`25
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 25 of 32
`
`US 2008/0062141 Al
`
`STUVWXYZ
`
`ABCDEFGHIJKLMNO
`
`ABCDEFGHIJKLMNOPQRSTUVWXY2Z
`
`FIG. 30B
`
`26
`
`26
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 26 of 32
`
`US 2008/0062141 Al
`
`452 ©
`
`454
`
`456
`
`458
`
`DISPLAY IMAGE BASED BROWSER
`WINDOW
`
`DETECT OBJECT OVER A FIRST OR
`SECOND SECONDARYPOSITIONS
`
`oN
`
`
`
`
`
`|
`
`RECOGNIZE PRESENCE OF OBJECT
`OVER SECONDARYIMAGE AS
`NAVIGATION INPUT
`
`TRANSITION THROUGH IMAGES OF
`IMAGE BASED BROWSER IN
`ACCORDANCEWITH NAVIGATIONAL
`
`INPUT
`
`FIG. 31
`
`27
`
`27
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 27 of 32
`
`US 2008/0062141 Al
`
`502
`
`~ C
`
`REATE FILE FOLDER
`
`‘ADD IMAGE TO IMAGE BASED BROWSER
`
`ASSIGN IMAGE TO FILE FOLDER
`
`FIG. 32
`
`28
`
`28
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 28 of 32
`
`US 2008/0062141 Al
`
`=
`
`PROVIDE FIRST AND SECOND GUIs
`
`552
`ELECTRONIC DEVICE
` DETERMINE ORIENTATION OF PORTABLE
` 558
`
`
`PRESENT SECOND GUI
`PRESENT FIRST GUI
`
`
`WHEN PORTABLE
`WHEN PORTABLE
`
`
`ELECTRONIC DEVICE
`ELECTRONIC DEVICE
`
`
`
`IS IN SECOND
`IS IN FIRST
`
`
`ORIENTATION
`ORIENTATION
`
`FIG. 33
`
`29
`
`29
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 29 of 32
`
`US 2008/0062141 Al
`
`‘MENU ITEM 6
`MENU ITEM 7
`
`MENU ITEM 1
`MENU ITEM 2
`MENU ITEM 3
`
`IMAGE BROWSER
`
`FIG. 34
`
`30
`
`30
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 30 of 32
`
`US 2008/0062141 Al
`
`714
`
`700
`
`f
`
`740 £08
`
`UserInput Device
`
`PWR
`
`CODEC
`
`712
`
`Display
`
`702
`
`Processor
`
`716
`
`718
`
`PWR
`
`Network / Bus
`Interface
`
`,
`
`722
`
`706
`Cache
`
`PWR
`
`- 104
`File System
`
`,
`
`(Solid-state Storage) 720
`
`Charge Circuit
`9
`
`722
`
`720 WR
`
`PWR
`
`PWR
`
`Batt
`
`attery
`
`,
`
`.
`
`FIG. 35
`
`31
`
`31
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 31 of 32
`
`US 2008/0062141 Al
`
`800
`
`| —
`
`818
`
`“7
`
`\
`
`:
`
`804
`
`7
`
`Communication
`Module
`
`Play Module
`
`824
`
`Media Database
`
`Media Storage
`
`Data Storage
`
`Media Player
`
`
`
`802
`
`Host Computer
`
`Communication
`Module
`
`806
`
`Management
`- Module
`
`File
`Manager
`
`Media Database
`
`Media Storage
`
`Data Storage
`
`FIG. 36
`
`32
`
`32
`
`

`

`Patent Application Publication Mar. 13, 2008 Sheet 32 of 32
`
`US 2008/0062141 Al
`
`°
`——
`RECEIVE IMAGE DOWNLOAD
`
`902
`
`REQUESTAT HOSTDEVICE
`
`904
`
`PRODUCE IMAGE COLLECTION
`
`FOR EACH REQUESTED IMAGE
`AT AHOST DEVICE
`
`SEND IMAGE COLLECTION FOR|
`298
`
`
`
`EACH REQUESTEDIMAGE TO
`MEDIA DEVICE
`
`FIG. 37
`
`STORE IMAGE DATA
`
`RECEIVE DISPLAY COMMAND
`
`RETRIEVED IMAGES
`
`RETRIEVE DESIGNATED
`IMAGES
`
`OUTPUT ONE OR MORE OF
`
`FIG. 38 »
`
`33
`
`33
`
`

`

`US 2008/0062141 Al
`
`Mar. 13, 2008
`
`MEDIA PLAYER WITH IMAGED BASED
`BROWSING
`
`CROSS-REFERENCE TO OTHER
`APPLICATIONS
`
`[0001] This application claimspriority to: (1) U.S. Provi-
`sional Patent Application No. 60/843,832, filed Sep. 11,
`2006, entitled “TECHNIQUES AND SYSTEMS FOR
`BROWSING MEDIA CONTENT”, which is herein incor-
`porated by reference; and (ii) U.S. Provisional Patent Appli-
`cation No. 60/878,746, filed Jan. 5, 2007, entitled “ELEC-
`TRONIC DEVICE WITH IMAGE BASED BROWSERS”,
`which is herein incorporated by reference.
`[0002] This application also references U.S. patent appli-
`cation Ser. No. 11/519,460, filed Sep. 11, 2006, entitled
`“MEDIA MANAGER WITH INTEGRATED BROWS-
`
`ERS”, which is herein incorporated by reference.
`
`includes performing an action associated with an image
`when the image is selected. The method further includes
`transitioning through the group of images in accordance
`with a user input. By way of example, the user input may be
`a rotational or linear user input. Furthermore,
`the input
`device may for example be a touch sensing device.
`[0007] The invention relates, in another embodiment, to a
`portable electronic device. The portable electronic device
`includes a display device. The portable electronic device
`also includesa user input device. The user input device may
`for example be a touch sensing device such as a touch pad,
`touch screen or touch sensitive housing. The portable elec-
`tronic device further includes at least one memory device
`capable of storing a plurality of images associated with one
`or more data items and computer program codefor display-
`ing, navigating and selecting the plurality of images. The
`portable electronic device additionally includes a processing
`device operatively connected to the display device, the user
`input device and the at
`least one memory device. The
`processing device is capable of executing the computer
`program code for displaying, navigating, and selecting the
`plurality of images. The plurality of images from a group of
`images are displayed, and transitioned through in accor-
`dance with a user input at the user input device. The user
`input may for example be a linear user inputor a rotational
`user input. Furthermore, the images may be configured to
`move horizontally across the display device during transi-
`tioning.
`[0008] The invention relates, in another embodiment, to a
`method of operating a portable electronic device. The
`method includes displaying an image based browser win-
`dow. The method also includes detecting an object over a
`sensing surface. The sensing surface may for example be a
`touch sensing surface. The method further includes transi-
`tioning through images of image based browser in accor-
`dance with a navigation input associated with a moving
`object. The object may for example be a finger swirling,
`swiping or sliding relative to the sensing surface. The
`method additionally includes presenting selectable data
`items associated with a selected image in accordance with a
`first selection input. Moreover, the method includes initiat-
`to a
`in one embodiment,
`[0005] The invention relates,
`ing an action associated with a selected data item in accor-
`portable electronic device having an imaged based browser
`dance with a secondselection input.
`window for navigating through and selecting imagesthat are
`[0009] The invention relates, in another embodiment, to a
`related to data. Selecting an image causes an action to be
`handheld electronic device having a touch screen display.
`initiatedat the portable electronic device. The action may for
`The touch screen display presents a plurality of imagesin at
`example correspondto playing a media item associated with
`least two groups. A first group is presented inafirst format.
`the image or launching a menu that
`lists media items
`A second group is presented in a second format. The
`associated with the image. Navigating through the images
`plurality of images is sequentially advanced from thefirst
`maybeinitiated with an input arrangement of the portable
`group to the second group in responseto a usersliding their
`electronic device. In one example, navigating through the
`finger along a surface of the touch screen display. The
`images horizontally is provided by rotational user inputs. In
`advancing may besubstantially proportional the speed of the
`another example, navigating through the images horizon-
`finger as it is slid along the surface of the touch screen
`tally is provided by linear user inputs. The user inputs may
`display.
`for example be accomplished through various input devices.
`In one embodiment, the input device is an object sensing
`[0010] The invention relates, in another embodiment, to a
`device such as a touch sensing device. In one example, the
`handheld electronic device having a display and a touch pad.
`input device is selected from touch pads, touch screens and
`The display presents a plurality of images in at least two
`touch sensitive housings.
`groups. A first group is presented inafirst format. A second
`[0006] The invention relates, in another embodiment, to a
`group is presented in a second format. The plurality of
`method for browsing imagesstored on a portable electronic
`images sequentially advancing from the first group to the
`device having a display and a user input device. The method
`second group in responseto a usersliding their finger along
`includes presenting an image browser window that displays
`a surface of the touch pad. The advancing may be substan-
`a plurality of images from a group of images. The images
`tially proportional the speed of the fingeras it is slid along
`may be associated with media items. The method also
`the surface of the touch pad.
`
`BACKGROUND OF THE INVENTION
`
`Description of the Related Art
`
`[0003] Today, media playback devices, such as media
`players or music players, have storage capacity to store large
`collections of media, such as music. With such large media
`collections, in order for a user to select a particular song to
`be played by the media player, the user typically navigates
`through a long list of songs. As an example, the user could
`interact with the media player to display a list of artists that
`have songsthat are stored within the media collection on the
`media player. The user then scrolls through the list and
`selects an appropriate song to be played. Unfortunately,
`however, as the storage capacity of media players increases,
`the numberof songs stored in a media collection on a media
`player increases. Consequently, the list through which users
`must navigate in order to select a song can be extensive.
`[0004] Therefore,
`improved methods
`for browsing
`through content are desired.
`
`SUMMARY OF THE INVENTION
`
`34
`
`34
`
`

`

`US 2008/0062141 Al
`
`Mar. 13, 2008
`
`[0011] The inventionrelates, in another embodiment, to an
`electronic device. The electronic device includes a storage
`device for storing a plurality of media items and a touch
`screen display. The electronic device also includes an image
`browser module operable to present images associated with
`the media items on the touch screen display and to permit a
`user to browse through the images to locate a particular
`media item within the media items. The electronic device
`further includes a playback module operable to play back the
`particular media item.
`[0012] The invention relates, in another embodiment, to a
`computer readable medium including tangible computer
`program code executable by a computer for browsing
`images stored on an electronic device. The electronic device
`may have a display and a user input device. The computer
`readable medium may include at least: computer program
`code for presenting an image browser windowthat displays
`a plurality of images from a group of images; computer
`program code for transitioning through the group of images
`in accordance with at least one user input; computer pro-
`gram code for selecting one of the images from the group of
`images following the transitioning; and computer program
`code for subsequently performing an action associated with
`the selected image.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0013] The invention may best be understood by reference
`to the following description taken in conjunction with the
`accompanying drawings in which:
`[0014]
`FIG. 1 is a diagram of an electronic device,
`accordance with one embodiment of the invention.
`
`in
`
`FIG. 2 is a diagram ofa portable electronic device,
`[0015]
`in accordance with one embodimentof the invention.
`
`FIG. 3 is a diagram ofa portable electronic device,
`[0016]
`in accordance with one embodimentof the invention.
`
`FIG. 4 is a simplified block diagram of a portable
`[0017]
`electronic device capable of storing, cataloging, selecting
`and outputting data, in accordance with one embodimentof
`the present invention.
`[0018]
`FIG. 5 is a diagram of a browse windows capable
`of browsing through images,
`in accordance with several
`embodiments of the present invention.
`[0019]
`FIG. 6 is a diagram of a browse windows capable
`of browsing through images,
`in accordance with several
`embodiments of the present invention.
`[0020]
`FIG. 7 is a diagram of a browse windows capable
`of browsing through images,
`in accordance with several
`embodiments of the present invention.
`[0021]
`FIG. 8 is a diagram of a browse windows capable
`of browsing through images,
`in accordance with several
`embodiments of the present invention.
`[0022]
`FIG. 9 is a methodof operating a browser window,
`in accordance with one embodiment of the present inven-
`tion.
`
`FIG. 10 is a menu hierarchy, in accordance with
`[0023]
`one embodiment of the present invention.
`[0024]
`FIG. 11 is a menu hierarchy, in accordance with
`one embodiment of the present invention.
`[0025]
`FIGS. 12A-12B shows an image based browser
`when the portable electronic device is in a phone or com-
`munication mode, in accordance with one embodiment of
`the present invention.
`
`FIG. 13 shows an image based browserassociated
`[0026]
`with applications, in accordance with one embodiment of
`the present invention.
`[0027]
`FIG. 14A-14D shows an image based browser
`associated with a date book or calendar, in accordance with
`one embodimentof the present invention.
`[0028]
`FIG. 15 shows an image based browserassociated
`with a photo viewing application, in accordance with one
`embodiment of the present invention.
`[0029]
`FIG. 16 shows an image based browserassociated
`with modesof the portable electronic device, in accordance
`with one embodimentof the present invention.
`[0030]
`FIG. 17A-17B show an image based browserasso-
`ciated with entering data into the portable electronic device,
`in accordance with one embodiment of the present inven-
`tion.
`
`FIG. 18 is a browsing method, in accordance with
`[0031]
`one embodimentof the present invention.
`[0032]
`FIGS. 19A-19H show several examples of object
`actions used to create navigation inputs for an image based
`browser, in accordance with one embodimentofthe present
`invention.
`[0033]
`FIG. 20 is a browsing selection method, in accor-
`dance with one embodimentof the present invention.
`[0034]
`FIGS. 21A-21F show several examples of object
`actions used to create selection inputs for an image based
`browser, in accordance with one embodimentofthe present
`invention.
`
`FIG. 22 is a browser method, in accordance with
`[0035]
`one embodimentof the present invention.
`[0036]
`FIGS. 23A-23H illustrate an exemplary browsing
`sequence using the methods described in FIG. 22, in accor-
`dance with one embodimentof the present invention.
`[0037]
`FIGS. 24A-24Hillustrate an exemplary browsing
`sequence using the methods described in FIG. 22, in accor-
`dance with one embodimentof the present invention.
`[0038]
`FIG. 25 is a selection method, in accordance with
`one embodimentof the present invention.
`[0039]
`FIGS. 26A-26E illustrate a flipping sequence for
`use in the embodiment mentioned above.
`
`FIG. 27 is a browsing method, in accordance with
`[0040]
`one embodimentof the present invention.
`[0041]
`FIGS. 28A and 28B are diagrams showing the
`method described in FIG. 27,
`in accordance with one
`embodiment of the present invention.
`[0042]
`FIG. 29 is a browsing method, in accordance with
`one embodimentof the present invention.
`[0043]
`FIGS. 30A and 30B are diagrams showing the
`method described in FIG. 29,
`in accordance with one
`embodiment of the present invention.
`[0044]
`FIG. 31 is a browse method, in accordance with
`one embodimentof the present invention.
`[0045]
`FIG. 32 is a method ofassigning an imagetoa list,
`in accordance with one embodiment of the present inven-
`tion.
`
`FIG. 33 is an operational method for a portable
`[0046]
`electronic device, in accordance with one embodimentof the
`present invention.
`[0047]
`FIG. 34 is a diagram showing a devicetransition-
`ing between a menu based window in portrait mode, and an
`image based browseris in a landscape mode, in accordance
`with one embodimentof the present invention.
`[0048]
`FIG. 35 is a block diagram of a media device, in
`accordance with one embodiment of the present invention.
`
`35
`
`35
`
`

`

`US 2008/0062141 Al
`
`Mar. 13, 2008
`
`FIG. 36 is a block diagram of a media management
`[0049]
`system, in accordance with one embodimentof the present
`invention.
`[0050]
`FIG. 37 is a method of transferring image data
`between a host device and a portable media device,
`in
`accordance with one embodiment of the present invention.
`[0051]
`FIG. 38 is an operational method for a portable
`media device, in accordance with one embodiment of the
`present invention.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`operations with the user interface during use. In two-handed
`operation, one hand is used to support the device while the
`other hand performs operations with a user interface during
`use or alternatively both hands support the device as well as
`perform operations during use. In somecases, the hand-held
`electronic device is sized for placement into a pocket of the
`user. By being pocket-sized,
`the user does not have to
`directly carry the device and therefore the device can be
`taken almost anywhere the user travels (e.g., the user is not
`limited by carrying a large, bulky and often heavy device).
`[0059]
`In accordance with one embodiment, the electronic
`device 2 is capable of performing an image based browser
`function. The image based browser function provides a
`graphical user interface that allows a user to navigate
`through and/or select images rather than textual menu items
`contained in a conventional menulist (e.g., vertical menu).
`It should be noted howeverthat the electronic device 2 is not
`
`limited to image based browsers and often includes both
`menu driven lists and image based browsers. In fact, the
`electronic device 2 may be configured to operate in either
`configuration depending on the needs of the device, software
`platform and/or user. In somecases, the electronic device 2
`may even operate both menu driven lists and image based
`browsers at the same time.
`
`[0052] The invention generally pertains to methods and
`systems that
`improve the way media is played, sorted,
`modified, stored and cataloged on an electronic device, such
`as portable electronic device. One aspect of the invention
`relates to an imaged based browsing that allows a user to
`navigate through and/or select images.
`[0053]
`In accordance with one embodiment, an electronic
`device can perform or provide an image based browser
`function to perform image based browsing. The image based
`browser function provides a graphical user interface that
`allows a user to navigate through and/or select images rather
`than textual menu items contained in a conventional menu
`[0060] Generally speaking, the image based browserpro-
`list (e.g., vertical menu). Image based browsing can provide
`vides a scrolling type action that permits a user to flip
`efficient, graphical browsing (e.g., scrolling) through a
`through images in an efficient and user friendly manner. The
`group of digital items that can are or can be represented in
`a visual manner.
`images generally describe graphically some aspectofafile
`stored on the electronic device 2. In many cases, the browser
`[0054] The images being browsed mayberelated or linked
`includes at least a viewing area which provides a location
`to data. For example, the images may be associated with
`where images from a group of images are taken in and out
`media files, address files, date book files, documentfiles,
`of view. The viewing area typically only displays a small
`applications, modes, etc. In one embodiment, image brows-
`portion of the total numberof images that are available in the
`ing may be implemented to mimic turning pagesor flipping
`group of images. The images may for example move from
`through rolodex or calendar, or flipping through LP records
`or CD’s in a bin.
`one position to the next position along a path that
`is
`containedor spread across the viewing area. The path can be
`[0055] These and other embodiments of the invention are
`an open endedline fixed along an axis such as horizontal or
`discussed below with reference to FIGS. 1-38. However,
`vertical axis. Alternatively, the path may not be fixed along
`those skilled in the art will readily appreciate that
`the
`an axis. For example, the path may be associated with a
`detailed description given herein with respect to these fig-
`waveform (e.g., sinusoidal). In other cases, the path may be
`ures is for explanatory purposes as the invention extends
`closed ended thereby forming a shape. For example, the path
`beyond these limited embodiments.
`may follow a shape suchascircular, oval, triangular, square,
`[0056]
`FIG. 1 is a diagram of an electronic device 2, in
`accordance with one embodiment of the invention. The
`rectangular, and/or the like.
`[0061] The images contained in the browser may be
`electronic device 2 may for example be a portable electronic
`widely varied. The images may for example be album art,
`device that is easily transported or conveyed.
`which represents one or more songs stored on the portable
`[0057] The electronic device can for example correspond
`electronic device. The images may also be thumbnail pic-
`to a computer(e.g., personal computer), mobile phone(e.g.,
`tures of photos stored on the portable electronic device. The
`cellular phone), personal digital assistant (PDA), media
`images mayalso be icons that represent applications stored
`player (e.g., music, videos, games, images), media storage
`on the portable electronic device. The images may also
`device, camera, remote control, and/or the like. The elec-
`represent months or days of a date book which is stored on
`tronic device may also be a multi-functional device that
`combine two or more of these device functionalities into a
`the portable electronic device. The images may also be
`pictures of people whose information is stored in an address
`single device. Examples of multi-functional devices can be
`book of the portable electronic device. The images may also
`found in U.S. Provisional Patent Application No. 60/658,
`be icons that represent various modes of the portable elec-
`777 filed Mar. 4, 2005 and entitled “MULTI-FUNCTIONAL
`tronic device. The images may also be symbols or characters
`HAND-HELD DEVICE”, which is herein incorporated by
`reference.
`for inputting information into the portable electronic device.
`The images may also be images of documents such as PDF,
`word processing or spreadsheet documents (e.g., pdf, doc,
`xls).
`[0062] Additional details on image based browsers and
`menu lists for electronic devices are provided in: (1) US.
`patent application Ser. No. 10/282,861, filed Oct. 28, 2002
`and entitled “GRAPHICAL USER INTERFACE AND
`
`[0058] The electronic device may further be a hand-held
`electronic device. The term hand-held generally meansthat
`the electronic device has a form factor that is small enough
`to be comfortably held in one hand. A hand-held electronic
`device may be directed at one-handed operation or two-
`handed operation. In one-handed operation, a single handis
`used to both support the device as well as to perform
`
`36
`
`36
`
`

`

`US 2008/0062141 Al
`
`Mar. 13, 2008
`
`METHODS OF USE THEREOF IN A MULTIMEDIA
`
`PLAYER”, (2) U.S. patent application Ser. No. 11/519,460,
`filed Sep. 11, 2006 and entitled “MEDIA MANAGER
`WITH INTEGRATED BROWSERS”, both of which are
`herein incorporated by reference.
`[0063]
`Further details regarding image based browsers
`and menulists will be described in greater detail below.
`[0064]
`Inthe illustrated embodiment, the electronic device
`2 is a portable electronic device that includes a housing4, at
`least one display device 6 and one or more user input devices
`8, all of which can be located on a front, side, and/or back
`surface of the housing 4. The display device 6 may for
`example be used to display an image based browser 3 that
`is associated with the image based browser function and the
`user input devices 8 may be used to navigate through and/or
`select images, which are stored on the portable electronic
`device 2. Of course, the display device 6 and input devices
`8 can also be used for other functionalities of the portable
`electronic device 2 including for example menudrivenlists.
`[0065] The display device 6 can, for example, include a
`liquid crystal display (LCD), display, an organic light emit-
`ting diode (OLED)display, a display based on electronic
`inks, and/orthelike. The display device 6 may have a variety
`of different configurations depending on the overall footprint
`of the portable electronic device 2. By way of example, and
`not by way of limitation, the display device 6 may have a
`traditional aspect ratio of about 4:3 or it may have an aspect
`ratio that is more panoramic such as 16:9.
`[0066]
`In one embodiment,
`the electronic device 2
`includes a small display at a portion of the front surface of
`the electronic device 2. In another embodiment, the display
`device 2 is configured to coverat least a majority of the front
`surface of the electronic device 2. For example, the area of
`the display device may consume greater than 50% of the
`area ofthe front surface, and further greater than 75% of the
`area of the front surface. The electronic device 2 may be
`configured with a full screen display or a near full screen
`display that consumes, or at least dominates, a surface (e.g.,
`front surface) of an electronic device 2. In one implemen-
`tation, a full screen display consumessubstantially the entire
`front surface of the electronic device 2 (in both directions).
`The full screen display may extend edge to edge or it may
`fit within a small bezel of the housing at the edge of the
`device.
`
`for
`the user input devices 8 can,
`In addition,
`[0067]
`example, include one or more mechanically and/or electri-
`cally driven input devices. Mechanically driven input
`devices include such mechanismsas buttons, keys, switches,
`dials, navigation pads, joysticks, jog balls, and/or the like.
`Electrically driven input devices may include for example
`object sensing devices such as proximity sensing devices
`that detect objects located above a surface (e.g.,
`front
`surface) and/or touch sensing devices that detect objects
`touching a surface (e.g., front surface). Examples of touch
`sensing devices include touch pads, touch screens and touch
`sensitive housings, and/or the like.
`[0068] The number and combination of input devices used
`in the electronic device generally depends on the desired
`needs of the electronic device. In most cases, the electronic
`device 2 includes at least input devices for navigating and
`selecting content store