US 6,741,232 B1
`(10) Patent No.:
`a2) United States Patent
`Siedlikowski et al.
`(45) Date of Patent:
`May25, 2004
`
`
`US006741232B1
`
`(54) USER INTERFACE FOR A DATA
`PROCESSING APPARATUS
`
`(75)
`
`Inventors: Andrew Siedlikowski, San Francisco,
`.
`:
`on we: Tony Robinson,Palo Alto,
`(US)
`(73) Assignee: Good Technology, Inc., Sunnyvale, CA
`(US)
`
`*)
`
`Notice:
`
`J
`y
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`US.C. 154(b) by 0 days.
`
`(21) Appl. No.: 10/056,313
`(22)
`Filed:
`Jan. 23, 2002
`7
`(51)
`Tint. C1.) cic ccccccecsessssssssssesecsesenes G09G 5/00
`(52) US. Ch. eee 345/156; 345/167; 345/169;
`345/184
`(58) Field of Search 0.0.0.0... eee 345/156, 157,
`345/163, 167, 169, 184
`
`(56)
`
`.
`References Cited
`U.S. PATENT DOCUMENTS
`
`5,825,353 A * 10/1998 Will wo. eceeeeeee 345/184
`5,835,732 A * 11/1998 Kikinis et al... 710/303
`5,915,228 A *
`6/1999 Kumihiro et al.
`............ 455/575
`OOotos Bt * sooo! poplySevereeeeeeeeteeeen steuet
`
`ato et al. we
`5297,
`*
`6,489,950 Bl * 12/2002 Griffin et al.
`secesssseeee-- 345/168
`2001/0012025 Al *
`8/2001 Wojaczynskiet al.
`...... 345/856
`2003/0006959 Al *
`1/2003 Varanda wo... 345/156
`
`* cited by examiner
`Primary Examiner—Bipin Shalwala
`Assistant Examiner—Ricardo Osorio
`(74) Attorney, Agent, or Firm—Blakely, Sokoloff Taylor &
`Zafman, LLP
`
`ABSTRACT
`(57)
`A user interface for a data processing device is described
`comprising: an input wheel rotatably mounted to the data
`processing device and configured to generate input signals to
`the data processing device when rotated or clicked down,
`wherein clicking and holding down the input wheel for less
`than a threshold amount of time causesa first function to be
`executed by the data processing device, and wherein click-
`ing and holding down the input wheel for greater than the
`threshold amount of time causes a second function to be
`executed by the data processing device.
`
`5,396,265 A *
`
`3/1995 Ulrich etal. wc. 345/158
`
`32 Claims, 19 Drawing Sheets
`
`220
`
`
`
`
`From: Rick Osterloh
`
`
`Subject: RE: Testing
`
`
`
`---—— Original Message-----
`From: Andrewe [
`
`
`Click
`mailto :Andrew2@DE¥.G000.COM)
`Selection
`Sent: Thursday, October 11, 2081
`
`
`
`Wheel
`2:43 FM
`
`
`
`B Items
`To: Rick Osterloh
` f=]
`
`
`
`Subject: Re: Testing
`
`
`Thu, Oct
`11, 2661
`
`
`pick Usterloh AE: Testing
`
`& 2:4apRick Osterloh Testing
`
`i: yo! This is a test reply
` 2:23pAndrew Sied... Test
`
`Thu, Oct 4, 2681
`
`© 11:3ta Andrew Sied...FW: [Bug 11...
`
`
`© 11:36aAndrew Sied...IDC believes...
`
`
`Click & Hold
`Wed, Oct 3, 2681
`Selection Wheel
`
`
`
`© 5:12p David Hotfm... your device
`(oo
`hada
`
`
`
`k Osterlo
`
`Forward
`@& 2:48pRic
`
`
`@ 2:23pAndrew Sie|Mark Unread
`
`
`Thu, Oct 4jMoue..
`
`
`& 11:31a Andrew SieMelete
`
` W:36aAndrew SielNew Message
`
`
`Wed, Oct 3)\Find Messages...
`S:l2p David Hoffr|Select Folder...
`Email Filters
`
`a 2
`
` 210
`
`230
`
`Page | of 25
`
`GOOGLEEXHIBIT 1008
`
`Page 1 of 25
`
`GOOGLE EXHIBIT 1008
`
`

`

`U.S. Patent
`
`May 25, 2004
`
`Sheet 1 of 19
`
`US 6,741,232 B1
`
`
`
`Fig. 1
`
`Page 2 of 25
`
`Page 2 of 25
`
`

`

`U.S. Patent
`
`May25, 2004
`
`Sheet 2 of 19
`
`US 6,741,232 B1
`
`
`
`PDaAUyAADLPSSMeapuydez:2@papm404/Ol4a}304OIdgp:2
`
`
`
`
`
`“ASP/94499/9Sluyjoypinogdzi:¢&“sabbssal]
`
`
`
`PUulylejog‘pam
`
`
`
`
`Me4puyOE"|,BW_2bdsse}|MANhaigmedpUyDBE:|L@apoag/ets
`
`
`“anole#90“MYL
`
`
`
`Saa}|14[!OWU3
`
`oeOLz
`
`z“big
`
`
`
`
`
`“SanayaqIOI“PalsMeapuyoge:|,
`
`
`
`SdinapANOh“LuyoHpinogdzp:¢|@lagz“S390‘pem
`
`
`
`
`
`
`
`
`
`“tLbng):ma4“PalsMmeaPUYOLE“|,
`
`lage“b0“NYL
`
`
`
`
`
`youeyso4oYdaP:2z&ESEPRSkeeeeS) po]“palsmeapuydez:z@Buse)
`
`
`
`
`
`
`
` ifidaa}s03Dstsiyyjoof,
`
`
`
`Buseyray:poefgns
`
`
`
`lHAideyTEENSDET
`
`fyday}#90“YL
`
`
`I294MUOHIa|ag
`
`HOQUT«
`PIOH841D
`
`
`
`
`
`
`
`LaBz“IL4990399“Appsanyy:yuasUdHhS3/eS
`
`
`
`
`
`aeabpssejyjourblag-----
`
`
`
`[WOT0009AAOZMe4puy:oj10WUD]2Maapuy
`
`:wodsy
`
`
`
`‘SIU3531
`
`
`
`buysay:gy:poalgns
`
`
`
`YopiapysqASI:WWOd4
`
`Occ
`
`Page 3 of 25
`
`YOpAS}SQASIOL
`Wd&b:2ISOUM
`SWUS}T9HOQU»
`
`
`
`\aa2“I0“MYL]
`
`Page 3 of 25
`
`
`
`
`
`
`
`
`

`

`GUOL)
`
`HWG8:BL=
`
`1B#827B)30S
`
`PIOH849!D
`
`uol}oa|as
`
`IBSUM
`
`SUOL]
`
`WUO06=
`
`WyGb:Gl=
`
`1a/@2/Gl30S
`
`18/@2/0140S yUstuzUIoddy
`
`U.S. Patent
`
`May25, 2004
`
`Sheet 3 of 19
`
`US 6,741,232 B1
`
`pUstUyUIOddYmay
`
`mary
`
`bee
`
`Page 4 of 25
`
`O0ce
`
`e¢“big
`
`Ole
`
`Page 4 of 25
`
`

`

`U.S. Patent
`
`May 25, 2004
`
`Sheet 4 of 19
`
`US 6,741,232 B1
`
`LSE:yoafqngs
`
`
`yuansADP|IyO7U01}0907,
`
`
`
`WH96:6)+
`
`Oce BUONa
`
`I3QUM
`
`OSE
`
`ge‘big
`
`
`
`pUsLUyUIOddYmay
`
`yuenesfop|iw¥oO
`
`‘UO1}DI07
`
`‘yoalqns
`
`Ove
`
`4D
`
`uoHoa|aS
`
`I39UM
`
`
`
`pUsUyUlOddyrmapy
`
`uonoa|as
`
`PIOH
`
`18/82,/B140S:
`
`WHG86+SUL}ADPS
`
`
`
`WYG8:G1=|16#8278)30S-9}09pug
`
`Page 5 of 25
`
`Page 5 of 25
`
`
`
`
`
`
`
`
`

`

`US 6,741,232 B1
`
`pbig
`
`0eV
`
`02r
`
`OLY
`
`U.S. Patent
`
`May 25, 2004
`
`Sheet 5 of 19
`
`sue|yoy
`
`OFUlgUYOr
`
`LLY
`
`Page 6 of 25
`
`Page 6 of 25
`
`

`

`U.S. Patent
`
`May25, 2004
`
`Sheet 6 of 19
`
`US 6,741,232 B1
`
`
`
`JospoobSuyolsoy
`
`:poalgns
`
`07
`
`2¢‘bly
`
`eg“big (eatswyor)05
`
`q¢‘
`
`big
`
`PUsidyWYO).
`OpUlgWYorfqns
`
`
`
`Page 7 of 25
`
`Page 7 of 25
`
`
`
`

`

`U.S. Patent
`
`May25, 2004
`
`Sheet 7 of 19
`
`US 6,741,232 B1
`
`eRelp
`MPSPIPISZHADMYISDISsar-
`
`
`Weebe-£bo(859)OPUldUYor
`
`
`
`eyTee
`
`
`
`Sima]uosor
`
`9‘biz
`
`
`
`hayysyAiuusssc
`
`Wwossighada
`
`Page 8 of 25
`
`Page 8 of 25
`
`

`

`U.S. Patent
`
`May25, 2004
`
`Sheet 8 of 19
`
`US 6,741,232 B1
`
`SID0}a4nyDUBbIspuaddyfay
`alupy)fipjdsig&y
`
`
`
`
`
`
`
`elu,fojdsig
`
`SUIdgIDL
`
`
`
`
`
`S[IDWUZ0}sAnyoubIspueddyfay
`
`aohojdsig
`
`aul)ApjdsigFy
`
`
`
`
`sUddgWOW
`
`Page 9 of 25
`
`Z‘big
`
`0cLOLl
`
`
`
`woohupdwos@uyol
`
`LbZ
`
`Page 9 of 25
`
`
`
`

`

`U.S. Patent
`
`May 25, 2004
`
`Sheet 9 of 19
`
`}33M07]
`
`ate
`
`8
`
`US 6,741,232 B1
`
`g‘big
`
`028
`
`0L
`
`Page 10 of 25
`
`Page 10 of 25
`
`

`

`U.S. Patent
`
`May25, 2004
`
`Sheet 10 of 19
`
`US 6,741,232 B1
`
`
`
` eeeaHPBursa|:3Yyol49}502401gp:Za3
`
`7r-)
`
`laaz2‘Ik399“NY
`
`OTSSobaioTU
`
`lez“LL390“NYL
`
`
`SUUS}T9HOQUT«
`
`
`EE
`
`SWUS}T9
`
`[4]
`
`HOQU]«
`
`6‘big
`
`
`
`faSSaApPPYYODasGy
`
`
`fpog
`
`yoapasGyoalqnsyouDesFy
`
`
`
`SasseAppyYoiDes&)
`
`
`
`yoalgnsYoapasgy
`
`
`
`ApogyoapasGE
`
` |99UD4)
`
`OL6
`
`Page 11 of 25
`
`Page 11 of 25
`
`
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`May25, 2004
`
`Sheet 11 of 19
`
`US 6,741,232 B1
`
`
`
`cOOL+001L£Ool
`
`0001
`
`OL‘big
`
`OLOL
`
`auospoogfap}
`
`@2399“hdpanjyosJ
`
`OCPrrrrirriiittrey
`
`
`
`$}US}DgPNOGDHID]
`
`Beeb-GE-1
`
`Ba}WooY
`
`esUatajuo)Ubisag
`
`OG:-Ga
`
`-
`
`Page 12 of 25
`
`Page 12 of 25
`
`
`
`
`
`

`

`U.S. Patent
`
`May25, 2004
`
`Sheet 12 of 19
`
`US 6,741,232 B1
`
`lH
`
`
`
`
`
`eLp“big
`
`E)
`
`
`
`‘L300“MYL
`
`neo
`
`
`Appia4UOYea0}s]QDpIOnDnohS4ySe]“pssmeaapuydez:2fserssseessvensnscnnssnsensnssnescssesssnesnsevsennsnessessavenss
`
`
`
`
`UBWYJOHpINnDg:wo44
`
`sdinepAnoh:y3e/qn
`
`é06'|4D1aez“by90“TYEGE-Zl-EI
`
`
`“sanalleqIOI“Palgmaspuyogs:||@galWooy
`
`“HE6ng]:ma-PalgMaspuyDIE:3}US3DgYNOQDA/D)
`
`
`
`
`1)eepeeaeeas)..
`
`SLUS}T3HOQU«
`:3yYodays9AolNdgp:2@1aaeBuse)Yyolsszs9xoludgp:2z&Buysal
`
`
`
`\aez€390‘PamBBE~Ob2
`OLLL0001
`
`
`
`
`
`
`99Ue49jJU07UBIsaq
`
`uospoogAp
`
`az399“fppanyos
`
`“9-01
`
`LOOL
`
`Page 13 of 25
`
`Page 13 of 25
`
`
`
`
`
`
`
`

`

` >) GB &)
`
`US 6,741,232 B1
`
`
`
`OSLQLL“blzOPLL
`
`O€bL
`
`Sheet 13 of 19
`
`AppiajUoaa0}a[gD)IONDNofippi4gUoysaW0}ajqojIDNDno
`
`
`colé0l
`
`Ja
`Fy
`
`U.S. Patent
`
`May 25, 2004
`
`aoInapano:y9eq
`
`
`UBLUJJOHpinng:
`
`
`
`UDWJjJOHpinpg:
`
`
`
`soinapAnahi:ya
`
`[4
`
`
`
`azinapanoh"yoatgn
`
`
`
`
`
`UDWJOHpINDg:wWosAy
`
`Page 14 of 25
`
`Page 14 of 25
`
`
`
`
`
`
`
`

`

`U.S. Patent
`
`May 25, 2004
`
`Sheet 14 of 19
`
`US 6,741,232 B1
`
`
`
`pabog)Buseysajosgore-
`
`&)q>Bl+9
`
`OSL}
`
`
`(coy
`
`Pxy
`
`OVLL
`
`OLL“big
`
`Page 15 of 25
`
`Page 15 of 25
`
`
`
`

`

`U.S. Patent
`
`May25, 2004
`
`Sheet 15 of 19
`
`US 6,741,232 B1
`
`<8:40
`
` (wuooY
`
`
`
`CeS
`
`Applaguoyea0}ajqoyIONDNohsay
`
`
`
`UDWYJOHpiInDg:wosl4
`aoinapanohyoarqns
`
`O?LLOOLL
`‘yLOLL
`PLL‘big
`————_—_————$<$<$<$<$—$————————————$———een}
`[=]a}=fl? & eae
`padog)Bunsay,ysajosgare-
`
`
`
`is
`
`Page 16 of 25
`
`Page 16 of 25
`
`
`
`
`
`
`

`

`==o=SSi3—_
`
`US 6,741,232 B1
`
`eg,‘big
`
`“NUL«SWAY]9=]HOqUTFJSUA}T9=]eeiaSWATg&DTaeaSs=
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`yoIdap:2&=Buysel3049BuyseyyousBuse)Yopeysgyore N=om°“eo=aainapanoh-wyjoHpinogdzj:¢w&aoinapano-wyoHpinogdzj:¢@soinepAnoh-wyyoHpinogdzy:¢w@2lage“€}7O“namo1¢:1,@1902“b}MMMMtLIoeLaGz“bh¥]509Odd6\Gz“bh190“MYLmeaapuyde?:2@+Busey9]“P85[slusz]papsjegFLPals|swez]pepejeqc}SaL“paissm4~Pats“HBng]:M4paigsozsosmem“iBrg]:M4~PelsMeapuylaaz‘f490‘Pambag2“€390“pem=~“sanayeqIOI-psis““senayeqJOL“patsmaapuyoge|,@“S9NSOQIOI“PasMespuyogg:||@4“y6ng]
`
`
`
`:3yYol4a!=swayryOIWdgp:2@a19@2puescybuiyse]33YYojsebuiysal23YYyo4e}sg
`
`
`
`
`
`‘Ht+#oqiN0FE1oaz“Il}LeG2“M390
`
`
`
`
`
`
`O2CLOOcL
`
`
`
`
`
`
`Page 17 of 25
`
`Page 17 of 25
`
`
`
`

`

`U.S. Patent
`
`May25, 2004
`
`Sheet 17 of 19
`
`US 6,741,232 B1
`
`
`
`aud4apjoyysibue7]WO
`
`HINASJONSIACy
`
`
`
`SUIStTPe}3|9]CJ
`
`
`
` $}40192SWS}]PUSSCy
`
`HOgIND
`
`ROquIgg
`
`snteinnnnninnnnanstoroad
`WO
`
`
`
`NAVeLC4
`
`Lech
`
`0&cl
`
`qzL‘biz
`
`Page 18 of 25
`
`Page 18 of 25
`
`
`
`

`

`U.S. Patent
`
`May25, 2004
`
`Sheet 18 of 19
`
`US 6,741,232 B1
`
`-$5D7
`
`
`
`
`
`
`
`Abojouyse)poog:AundwoyWOTpoobSyad:|IDWA‘OUT
`
`aud
`€@IH
`
`9SbP
`
`
`
`
`
`SIGP-Ge9(899)-449/))
`
`-¢|IDUUA
`
`-E|IDwuy
`
`Chel
`
`LLEL
`
`ep‘big
`
`
`
`[UONDIYIZORYjOIOads
`
`
`
`SUOIPDOYIZOR)[DIGeds
`
`
`
`
`
`l66P-8c9(063)-8D4
`
`
`
`
`
`IB6P-B¢9(BS9)-#OY
`
`
`
`
`
`
`Wor
`
`
`
`
`
`poobSxo1d:‘oulAbojouysalpoog“flupdwo}
`
`
`
`
`
`PULUBLYYONPOAY“AID=SIPLL
`
`
`
`YO|4a}s923507]-O|PPIL
`
`MY=4544
`
`}9D}U0}}PJ
`
`YO43450
`
`Page 19 of 25
`
`
`
`
`
`PULUBLY}ONPodg“aigsayy
`
`Page 19 of 25
`
`

`

`U.S. Patent
`
`May25, 2004
`
`Sheet 19 of 19
`
`US 6,741,232 B1
`
`WdPOL
`
`Syualuyuioddyay
`
`a2390“Appanyos
`
`uospooyADL
`
`HQSUdIDOYIOL
`
`
`
`UGSHORDYNO
`
`HQolpoyWan
`
`HO4smojWn].
`
`pLbig
`
`LLvL
`
`OLVL
`
`Page 20 of 25
`
`Page 20 of 25
`
`
`

`

`US 6,741,232 B1
`
`1
`USER INTERFACE FOR A DATA
`PROCESSING APPARATUS
`
`BACKGROUND
`
`1. Field of the Invention
`
`This invention relates generally to the field of wireless
`data systems. More particularly, the invention relates to an
`improved user interface for a wireless device.
`2. Description of the Related Art
`A variety of wireless data processing devices have been
`introduced over the past several years. These include wire-
`less personal digital assistants (“PDAs”) such as the Palm®
`VIIx handheld, cellular phones equipped with data process-
`ing capabilities, and, more recently, corporate wireless mes-
`saging devices such as the Blackberry™ wireless pager
`developed by Research In Motion (“RIM”).™
`With advances in silicon processing technology, data
`processing devices and cellular phones continue to decrease
`in size. Smaller size, however, creates new challenges
`related to usability. For example, as data processing devices
`get smaller, the real estate available on the device available
`for data input decreases. As such, it may be necessary to
`reduce the amount of input required from a user to perform
`tasks on the data processing device. An additional challenge
`is that smaller data processing devices typically require
`smaller displays which maybedifficult to read. Accordingly,
`data may needto be presented to the user in a more compact,
`intelligent, efficient manner.
`Accordingly, what is needed is an improveduserinterface
`for a wireless data processing device.
`
`SUMMARY
`
`A userinterface for a data processing device is described
`comprising: an input wheel rotatably mounted to the data
`processing device and configured to generate input signals to
`the data processing device when rotated or clicked down,
`wherein clicking and holding down the input wheel for less
`than a threshold amountof time causesa first function to be
`
`executed by the data processing device, and wherein click-
`ing and holding down the input wheel for greater than the
`threshold amount of time causes a second function to be
`
`executed by the data processing device.
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`A better understanding of the present invention can be
`obtained from the following detailed description in conjunc-
`tion with the following drawings, in which:
`FIG. 1 illustrates one embodiment of a data processing
`apparatus on which features of the invention are imple-
`mented.
`
`2
`FIG. 8 illustrates data selection via a widget according to
`one embodiment of the invention.
`
`FIG. 9 illustrates selection of pop-up menu commands
`according to one embodimentof the invention.
`FIG. 10 illustrates a home screen according to one
`embodimentof the invention.
`
`FIGS. 11a—d illustrate task switching according to one
`embodimentof the invention.
`
`FIGS. 124-5illustrate folder navigation according to one
`embodimentof the invention.
`FIG. 13 illustrates data selection from a contact field
`according to one embodimentof the invention.
`FIG. 14illustrates a quick menu according to one embodi-
`ment of the invention.
`
`DETAILED DESCRIPTION
`
`the purposes of
`for
`In the following description,
`explanation, numerousspecific details are set forth in order
`to provide a thorough understanding of the present inven-
`tion. It will be apparent, however, to one skilled in the art
`that the present invention may be practiced without some of
`these specific details. In other instances, well-knownstruc-
`tures and devices are shown in block diagram form to avoid
`obscuring the underlying principles of the present invention.
`
`An Exemplary Handheld Device
`FIG. 1 illustrates a handheld data processing device 100
`for implementing embodiments of the invention. In one
`embodiment, the data processing device 100 is a wireless
`messaging device which maintains complete synchroniza-
`tion with a user’s email, electronic calendar, contacts, tasks
`and notes (and/or any other type of user information) when
`the user is out of the office. However, the data processing
`device 100 may serve various other functions while still
`complying with the underlying principles of the invention
`(e.g., the device may be a standard personaldigital assistant
`(“PDA”) or cellular phone with data processing
`capabilities).
`As illustrated, the data processing device 100 includes a
`housing 110, display 120, keyboard 130, thumbwheel 140,
`navigation buttons 150, and light sensor 160. The housing
`110 encloses a printed circuit board that includes various
`electronic components mounted thereon including,
`for
`example, a volatile memory (e.g., RAM) and/or a non-
`volatile memory (e.g., ROM, Flash memory, .
`.
`. etc) and a
`processor for processing data and program code. In one
`embodiment, housing 110 is an elongated structure that fits
`in the palm of a user. The display 120 is mounted within the
`housing 110 and includes an image projecting mechanism
`that generates text and graphic imagesas described in detail
`below.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`In one embodiment, the display 120 is implemented with
`a liquid crystal display (“LCD”).
`In yet
`a further
`embodiment,
`the LCD is a reflective-transmissive LCD
`(c.g., 30% transmissive and 70% reflective). However, one
`of ordinary skill in the art will appreciate that the underlying
`principles of the invention are not limited to any particular
`display type.
`The keyboard 130 mounted on the housing 110, is the
`selecting an address.
`primary text input device. In one embodiment, the keyboard
`FIGS. 5a—c illustrate different embodiments of the inven-
`includes a standard arrangementof alphabetic keys (e.g., the
`tion used for address selection.
`“QWERTY”keyboard). Also, in one embodiment, the key-
`FIG. 6 illustrates an embodimentof the invention used for
`board 230 includes standard function keys, such as an
`selection of a contact name fromalist.
`65
`Escape key, a tab key, shift and/or control keys. As
`FIG. 7 illustrates one embodiment of the invention for
`illustrated, in one embodiment, the keyboard 130 has an
`upward slant, center spine configuration.
`
`FIG. 2 illustrates a user interface employing a dual
`function selection element according to one embodimentof
`the invention.
`FIGS. 3a—b illustrate one embodiment of the invention
`employed within an electronic calendar application.
`FIG. 4 illustrates one embodiment of the invention for
`
`60
`
`selecting a check-box.
`
`Page 21 of 25
`
`Page 21 of 25
`
`

`

`US 6,741,232 B1
`
`3
`The upward slant configuration enables a user to easily
`access all of the keys on keyboard 130 with minimal hand
`movement. For example, a user may easily makea transition
`from a key in the middle of keyboard 130 (e.g., the Y key)
`to a key on the outside of keyboard 130 (e.g., the P key) with
`natural thumb movement.In addition, the keyboard 130 may
`include backlighting that enables a user of handheld device
`100 to view the keys of keyboard 130 in dark or dim
`lighting.
`In one embodiment, the thumbwheel 140 and navigation
`buttons 150 provide a cursor control mechanism, allowing a
`user to scroll up and down and select information from a
`graphical user interface (“GUI”) generated on the display
`120.
`In one embodiment,
`the thumbwheel 140 may be
`depressed and released as a button. In one embodiment,
`simply clicking and releasing the thumbwheel performs a
`first type of function (e.g., like a Windowsleft mouse click)
`whereas clicking and holding the thumbwheel performs a
`second type of function (e.g., like a Windowsright button
`mouse click). For example, clicking the thumbwheel may
`open an item or activate a widget whereas holding the
`thumbwheel may bring up a menu of commands (e.g.,
`context and/or application-level commands). Incorporating
`two functions in a single selection element provides for a
`moreefficient use of the selection elementand is particularly
`beneficial on a small device with a small display screen.
`
`Embodiments of a Graphical User Interface
`Various GUIfeatures will now be described with respect
`to FIGS. 2 through 14. It should be noted, however, that
`many of the specific details set forth below are for the
`purposeofillustration only and are not necessarily required
`for practicing the underlying principles of the invention.
`An exemplary group of email message headersareillus-
`trated in screen 210 of FIG. 2. In one embodiment,clicking
`the thumbwheel 140 performs a default action associated
`with the highlighted message such as, for example, opening
`the message, as illustrated in screen 220. By contrast,
`holding the thumbwheel 140 may display a context-sensitive
`menuofother actions as indicated in screen 230 (e.g., open,
`reply, reply all, forward, .. . etc). Various other email-related
`actions may be included within the context-sensitive action
`menu while still complying with the underlying principles of
`the invention.
`
`In one embodiment, within a ‘Create New Appointment’
`screen 310 illustrated in FIG. 3a, when the cursor is located
`in a simple text field (i.e., with no special widget), holding
`the thumbwheel opensa context-sensitive action menu 321,
`shownin screen 320. The action menu 321 includes various
`
`action items associated with the new appointmentincluding,
`but not limited to, save, delete, paste, cancel, .
`.
`. etc.
`As illustrated in the screen shots 330, 340, and 350 in FIG.
`3b, in a field 331 which contains a special widget (e.g., in
`this case, a time selection widget) clicking on the thumb-
`wheel 140 brings up the list of choices associated with the
`field. Thus, clicking on thumbwheel whenthe timefield 331
`is highlighted in screen 330 bringsupa list of potential times
`341 shownin screen 340. In one embodiment, holding the
`thumbwheel
`in the same situation brings up a context-
`sensitive menu 351 shown in screen 350 (e.g., including
`action items save, delete, paste and cancel). Various other
`data selection choices and/or action items may be used while
`still complying with the underlying principles of the inven-
`tion.
`
`Email Addressing and Address Book Name Lookup
`Addressing messages is a complex part of composing
`email messages. The task is more difficult on small form
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`factor devices with limited screens and input devices. To
`ease this task, one embodiment of the invention allows the
`user to type the fewest keystrokes possible to generate a list
`of names from which to choose from the user’s address
`book. At the same time, the user is also provided with the
`ability to enter the address of a user not found in the address
`book. By contrast, other systems require more keystrokes
`and/or menu choices to enter a name and often require the
`user to know whether the name is already stored in the
`address book oris a new entry before addressing begins.
`One embodiment of the invention employs “type-down
`addressing” in which matching namesare continually gen-
`erated from the address book. As each character is typed, the
`list of possible matches is refined and the user can choose
`from the list of names or simply keep typing. If no matching
`names are found,
`the user simply types the complete
`address. Type down addressing may be employed in any
`application containing a list of names or addresses(e.g., to
`find the entry of a contact in a contactlist, to find an email
`address, .
`.
`. etc).
`Onespecific example of type down addressing will now
`be described with respect
`to FIG. 4. Screen 410 is a
`“compose new message” screen in which the address field
`411 is completely blank. On screen 420, after a “J” is typed,
`all names starting with “J,” whether first names or last
`names, are automatically generated in an address list 421.
`Thus,
`the name “Bob Jones” would be included in the
`address list even though the first name “Bob” begins with a
`“B.” In one embodiment, “Bob Jones” and otherfirst names
`not beginning with a “J,” would appearafter all of the entries
`having “J” as the first letter of the first name. However, as
`described below,in one embodiment, typing a spaceafter the
`“J’ would refine the list to remove Bob since it would be
`clear that the “J’ was for the first name only.
`As indicated in screen 430, having typed the single
`character “J,” the user may now pick a name from the list.
`In one embodiment, this is accomplished by scrolling down
`with the thumbwheel 140 and clicking the thumbwheel to
`select the highlighted name 431.
`Instead of scrolling into the list as described above, the
`user may type a space and then a “P” following the “J” as
`shown in FIG. 5a. There is only one entry in the address
`book with a first name that starts with “J” and a last name
`that starts with “P” (John Pinto). That name is displayed and
`the user may select it as described above(i.e., scrolling into
`the list and clicking via the thumbwheel).
`In addition, instead of narrowing on first and last names
`simultaneously, the user can simply type additional charac-
`ters of the first name and the suggested list is immediately
`refined as illustrated in FIG. 5b. As shown in FIG. 5c,if the
`user wants to send the message to an address not in the
`address book, the user simply keeps typing the complete
`address and the match list automatically disappears.
`In one embodiment, for addedefficiency, certain easy-to-
`type shortcuts for common address elements are provided.
`For example,
`instead of having to type complex shift
`sequences to get the “@” character, the user simply types
`space (or another designated key) twice. Then, instead of
`having to type “.” “c” “o” “m”, the user can type space twice
`again. For example, to enter the address john@good.com,
`the user would type “john,” space-space “good,” space-
`space. In addition, in one embodiment, each additional space
`typed after the “.com” appears will cycle through “.net”,
`“ gov” and “org”
`FIG. 6 illustrates the name finding techniques in an
`address bookitself rather than in an email header. Note that,
`
`Page 22 of 25
`
`Page 22 of 25
`
`

`

`US 6,741,232 B1
`
`5
`in this embodiment, the refined names aren’t shown in a pop
`up, but rather the list of address entries shrinks on the main
`screen. In addition, in one embodiment, the partial match
`may include a company nameas well as the person’s first
`and last names. Accordingly, it would find “Tom Smith”at
`“Jones Corporation” in addition to “John Friend” and “Bob
`Jones.”
`
`Widget Interactions
`
`One embodiment of the invention provides improved
`techniques for
`interacting with User Interface elements
`(“widgets”) on a small handheld device with limited input
`options. The widget set
`includes, but
`is not
`limited to,
`checkboxes, dropdowns, and navigation buttons. As illus-
`trated in FIG. 7,
`in an options screen 710 for an email
`application, the user has scrolled using the thumbwheel 140
`onto a check field widget 711 (i.e., the checkbox for turning
`automatic signatures on and off). In one embodiment, click-
`ing the thumbwheel 140 toggles the check field 711, check-
`ing and un-checking it, as indicated in screen 720.
`As illustrated in FIG. 8, in a notifications screen 810,
`using the scroll thumbwheel 140 to move down, a user may
`select the widget 811 that controls ring volumeof the data
`processing device. Clicking the thumbwheel 140 activates
`the widget 811 allowing the user to scroll
`through the
`choices for the field until the desired choice 821 is high-
`lighted (as shown in screen 820). Clicking the thumbwheel
`140 again selects the highlighted entry.
`As illustrated in FIG. 9, in a “Find Messages” pop-up 910,
`the Cancel button 911 is highlighted. In one embodiment,
`scrolling the thumbwheel 140 movesto the other(or through
`multiple in sequence) buttons (e.g., the Find button 912). In
`one embodiment, clicking the thumbwheel 140 then acti-
`vates the highlighted button.
`
`Home Screen
`
`As illustrated in FIG. 10, one embodiment of a home
`screen 1000 for the data processing device offers multiple
`features in a compact space. Specifically, the home screen
`1000 provides for efficient selection from a plurality of
`available applications. One embodimentof the home screen
`includes a time and date area 1010. In addition, a person-
`alization area 1020 may be defined for continually display-
`ing certain user-selectable data. For example, in the particu-
`lar embodimentillustrated in FIG. 10, the personalization
`area 1020 includes the nameof the user 1030 and upcoming
`appointments 1040 (e.g.,
`those programmed within the
`user’s electronic calendar application).
`Various other types of conveniently-displayed informa-
`tion maybe provided in the homescreen 1000, including, for
`example, radio signal strength (“RSSI’) 1001, battery power
`1002, the number of unread messagesin the inbox 1003 and
`number of messages in the outbox (not shown), awaiting
`transmission.
`
`Task Switching
`
`One embodimentof the invention provides for improved
`application switching by preserving application context and
`by displaying the taskbar under certain conditions to select
`another application. In one embodiment, a dedicated hard-
`ware key is provided so that the user may access the taskbar
`at any point in time.
`Referring to FIG. 11a, from the home screen 1000 a user
`may click the thumbwheel 140 to open the inbox 1007. As
`indicated in the inbox screen 1110, from the inbox, the user
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`may scroll down to a message and click the thumbwheel 140
`to open it. On the subsequent message screen 1120, a
`question is asked that
`the user cannot answer without
`lookingat his/her electronic calendar, a separate application.
`In one embodiment, holding and/or clicking the thumb-
`wheel 140 brings up a context-sensitive menu 1130 shown
`in FIG. 11b. Scrolling down the menu 1130, the user may
`click the thumbwheel 140 to expose an applicationlist 1140.
`Alternatively, or in addition, a specified control key or
`combination of keys may be provided to bring up the
`application list 1140 (e.g., such as CTRL+Tab in Windows).
`In screen 1150, the user scrolls down to the calendar icon
`1151 in the application list 1140. Clicking the calendar icon
`1151 with the thumbwheel 140 causes the calendar 1160 to
`appear on the current date as illustrated in FIG. 11c. Having
`the answer to the question from screen 1160,
`the user
`exposes the menu 1130 again (or, alternatively, brings up the
`taskbar 1140 directly as described above). The user scrolls
`down the menu to highlight the taskbar 1140 andclicks the
`thumbwheel. The taskbar 1140 appears over the exposed
`application (in this case the calendar 1160). The user scrolls
`up the taskbar 1140 with the thumbwheel selecting the inbox
`application 1161 as illustrated in FIG. 11d. Clicking the
`inbox application icon 1161 re-exposes the inbox, with the
`message 1120 that was being viewedstill opened.
`
`Folder Navigator
`Unlike other GUIs which do not allow users to file
`information from a handheld device, one embodiment of the
`invention allows users to manage messages in a mobile
`filing system that mirrors their server-based information
`hierarchies.
`
`As illustrated in FIG. 12a, on the inbox email headerlist,
`the user has selected the folder list pop up widget(e.g., by
`using the thumbwheel 140 to navigate upward beyond the
`first message). The current folder name (“Inbox”) is shown
`in the collapsed folder popup 1210. Clicking the popup
`expands it into a menu 1211. The popup 1211 showsthe
`standard folders and/or the user’s individual folders. In one
`embodiment, the standard folders are shown above a dotted
`line in the popup menu 1211.
`On screen 1220, the thumbwheel 140 has been used to
`scroll down to the Projects folder 1221. The “+” on the
`folder indicates that there are sub-folders. Clicking on a “+”
`folder opens the list of subfolders, as illustrated. In screen
`1230 shown in FIG. 125, the user has scrolled down to one
`of the sub-folders 1231 with a “+” and opened it as well. In
`one embodiment, clicking the thumbwheel on a folder that
`doesn’t have sub-folders (or whose sub-folders have already
`been exposed) selects the folder and collapses the popup.
`The message headerlist may then reflect the contents of that
`new folder.
`
`Notification Override
`
`One embodiment of the system allows a user to assign a
`specific notification tone to a user to indicate that a message
`from the user hasarrived. As illustrated in FIG. 13, the user
`opens the “Address Book” application and selects the con-
`tact entry 1310 for whom special notification is desired. The
`userscrolls to the “Special Notification”field 1311. Clicking
`the thumbwheel opensthelist of special ring tones 1312 that
`can be associated with this contact.
`
`Quick Settings
`
`In one embodiment, quick access is provided to certain
`critical settings via a quick access icon 1410 from the
`
`Page 23 of 25
`
`Page 23 of 25
`
`

`

`US 6,741,232 B1
`
`7
`taskbar. For example, as indicated in the quick settings menu
`1411, the notification settings may be efficiently switched
`between normal(e.g., “on”), silent or off (e.g., from a tonal
`ring to a quiet vibration, including for special notifications).
`For reasons of safety and/or courtesy, radios or tones must
`often be controlled (e.g., on an airplane, during a meeting,
`in a library, .. . etc). The quick settings menu provides a
`quick, efficient way to control the tones which is not found
`in other handheld data processing devices and systems.
`Embodiments of the invention may include various steps
`as set forth above. The steps may be embodied in machine-
`executable instructions. The instructions can be used to
`
`cause a general-purpose or special-purpose processor to
`perform certain steps. Alternatively,
`these steps may be
`performed by specific hardware components that contain
`hardwired logic for performing the steps, or by any combi-
`nation of programmed computer components and custom
`hardware components.
`Elements of the present invention mayalso be provided as
`a machine-readable medium for storing the machine-
`executable instructions. The machine-readable medium may
`include, butis not limited to, floppy diskettes, optical disks,
`CD-ROMs, and magneto-optical disks, ROMs, RAMs,
`EPROMs, EEPROMs, magnetic or optical cards, propaga-
`tion media or other type of media/machine-readable medium
`suitable for storing electronic instructions. For example, the
`present invention may be downloaded as a computer pro-
`gram which may be transferred from a remote computer
`(e.g., a server) to a requesting computer(e.g., a client) by
`way of data signals embodied in a carrier wave or other
`propagation medium via a communication link (e.g., a
`modem or network connection).
`Throughout the foregoing description, for the purposes of
`explanation, numerous specific details were set forth in
`order to provide a thorough understanding of the invention.
`It will be apparent, however, to one skilled in the art that the
`invention may be practiced without someof these specific
`details. For example, while the embodiments described
`above use a selection wheel for selecting data, various other
`data input devices may be used while still complying with
`the underlying principles of the invention (e.g., a standard
`mouse).
`In addition, as mentioned above, all of the functions and
`modules described herein may be implemented in software
`(e.g., and executed on a general purpose processor), hard-
`ware (e.g., such as an application specific integrated circuit
`(“ASIC”)), or any combination thereof.
`It is also important to note that the apparatus and method
`described herein may be implemented in environments other
`than a physical integrated circuit (“IC”). For example, the
`circuitry may be incorporated into a format or machine-
`readable medium for use within a software tool for design-
`ing a semiconductor IC. Examples of such formats and/or
`media include, but are