!"#$$%%$&%'%()!
`

ÿÿ
`  
`ÿ


` 
`
`  
` ÿ


`ÿ
`
`+,

-ÿ

.-.ÿ

/01.0-
`
`ÿ
`  
`ÿ
`ÿ
`
`
`*
`LMA6ÿN>OPBQRGS TÿUV2WX*2P
`234567ÿ9:ÿ;<=>?@56?9AB
`CDD E FF
` G
`*H;;>?@56?9AÿA<I=7JBCCD
`**4567ÿ9:ÿ:?>?AKB DD 
`Y247Z?KA567[ÿN9A6J5@6?AKÿ\6567ZB
`l_ nÿ1  
`Shÿ1 
` o
`ÿeÿi^_j
`.E1Q1]^^_`a0a,bEb,00./0/+
`l`F
`
`onÿRm
`R1ÿ-/ÿ

.ÿ`ÿ.,
` ÿQ
`Fmÿia0j
`
`47Z?KA567[ÿcd67AZ?9Aÿ\6567ZB
`lQ
`FF
`nÿ`
`
`/ÿ/.ÿ/eÿR_ÿ,ÿ`0
` Cÿ

 ÿia0j
`3VfJ?9J?6gB DDhhh+`hS
`lpm
`onÿQ 
` ÿQ
`Fmÿia0j
`
`PH;;>?@5A6B-_0ÿRE0/ÿ

Q-`ÿ/.^D
`l. mm 
`nÿ.
`hqÿ F ÿia0j
` ÿ ÿia0j
`l_Fr 
`nÿQ 
`P*MAk7A69JZB
` ÿ ÿia0j
`
`l

m 
`nÿQ 
`P2s7;J7Z7A656?k7B,
` nÿR 
`tÿ1 F
`ÿ
`ÿ F
`hÿ F ÿia0j
`le F 
`nÿ.
`e
`
`ÿ` F
`uÿvÿ1 D
` Sÿ`  ÿia0j
` ÿ/F
`ÿE 
`
`/  ÿ1ÿS^QÿibEj
`L2R F
`   o 
` 
`
` 
` o F    o
`
`  
`
`  
`LPHI76w9[?Z[?Z@>9Z7[:9J9;7J56?AK5I9=?>7
`6?9AZy5A[T?AJ7Z;9AZ769:<J6w7J?A;<6:J9I6w7<Z7JT[
`[?Z;>5g?AK5>?Z69:z;6?9AZ6w565J75k5?>5=>7:9J6w7Z7x
`Z656?9AVT@9I;J?Z?AKZ67;Z9:5;J9k?[?AK6w7I9=?>7
`>7@67[H;;>?@56?9AO{w?Z?Ak7A6?9A;J9k?[7Z5A9k7><Z7J
`Z656?9A69w5k75<Z7J?A67J:5@7@9I;J?Z7[9:5[?Zx
`?A67J:5@7:9J5I9=?>7Z656?9AT|w7J7?A5<Z7J?ZK?k7A
`;>5g*V5A[56>75Z69A7<Z7J?A;<6[7k?@7**T*3y=
`@9A6J9>9k7J6w7H;;>?@56?9AZ9:6w7I9=?>7Z656?9A?A5
`[?Z;>5g?AK696w7<Z7J5A?[7A6?:?@56?9A9:5;><J5>?6g9:
`J75[?>g@9I;J7w7A[7[k?Z<5>I5AA7JT5A[|w7J7?A[565
`H;;>?@56?9AZ6w566w7I9=?>7Z656?9A?Z@5;5=>79:7d7x
`9:k5J?9<Z6g;7Z?Z6J7567[Z?I;>g5Z5A9=}7@66w56@5A
`@<6?AKT6w7?[7A6?:?@56?9AZ=7?AKZ?I<>65A79<Z>g[?Zx
`=7:J77>gI9k7[=76|77A5A[X9JZw5J7[=gH;;>?@56?9AZT
`;>5g7[?A5KJ?[9J>?Z6:9JI56y@I5A?;<>56?AK6w7?A;<6
`|?6w[565:9JI56@9Ak7JZ?9AZ=7?AKI5[75ZJ7~<?J7[
`[7k?@769Z7>7@69A79:6w7[?Z;>5g7[H;;>?@56?9A?A[?@5x
`7OKOTÿ@w5J5@67JÿZ6J?AKÿ69ÿA<I7J?@ÿZ6J?AKO
`
`

ÿÿ
`
`1
`
`Exhibit 1019
`Apple v. Qualcomm
`IPR2018-01279
`
`

`

`[0001] This invention relates generally to mobile stations, such as cellular radio telephones and personal communi-
`cators, and more particularly relates to user interfaces for mobile stations.
`
`BACKGROUND OF THE INVENTION:
`
`[0002] Modern radio telephones, referred to herein generally as mobile stations, typically have a display, a keypad
`and associated software drivers for providing a user interface. With the aid of the user interface a user of the mobile
`station is enabled to place telephone calls and program various features of the mobile station. For those mobile stations
`that operate with a digital wireless network the user may also have the ability to receive text messages, compose and
`transmit text messages, receive and transmit e-mail, forward calls, access voice mail, as well as take advantage of a
`number of other valuable communication features.
`
`It can thus be appreciated that the user interface is a key component of the mobile station, and that the
`[0003]
`flexibility, ease of use, and functionality of the user interface are important features that relate to the overall operation
`of the mobile station. In that the quality of the user interface is directly perceived and experienced by the user of the
`mobile station, the user interface is an important feature of the overall mobile station design and implementation.
`
`OBJECTS AND ADVANTAGES OF THE INVENTION:
`
`It is a first object and advantage of this invention to provide an improved user interface for a mobile station.
`[0004]
`It is a further object and advantage of this invention to provide an improved user interface for a mobile station
`[0005]
`that enables one hand operation of a manipulator to gain access to and interact with all applications.
`[0006]
`It is a further object and advantage ofthis invention to provide a multimedia user interface for a mobile station
`that enables input data from different sources, such as text input, recorded voice input, and image input, to be combined
`together into a unified whole for presentation to an operator.
`[0007]
`It is a further object and advantage ofthis invention to display user-selectable options using a "pop-up" menu
`technique wherein available options may be partitioned into different logical groups of options.
`[0008]
`It is a further object and advantage of this invention to provide a user of a mobile station with an ability to
`"bookmark" certain objects, such as selectable strings and application icons, and to enable the bookmarked objects
`to form a separate view of user-preferred objects.
`[0009]
`It is another object and advantage of this invention to provide a mobile station object handling method wherein
`there is displayed a menu of functions operable in the context of a currently displayed object, and enabling the user
`to activate a selected function, such as by editing, erasing, copying, moving, and making a query.
`SUMMARY OF THE INVENTION
`
`[0010] The foregoing objects and advantages are realized by methods and apparatus in accordance with embodi-
`ments of this invention.
`
`EP 1 104 151 A2
`
`Description
`
`FIELD OF THE INVENTION:
`
` ÿÿ
`
`ÿÿÿ !
`"#$%&'&()*(+&,(-*./+*'0*(*-/..1+,2,3&.*'+/+&,('4'56%/'6*..5./--/7&,+*.*8%,(*'/(78*-',(/.6,225(&9
`6/+,-'4ÿ/(7ÿ2,-*ÿ8/-+&65./-.1ÿ-*./+*'ÿ+,ÿ5'*-ÿ&(+*-;/6*'ÿ;,-ÿ2,3&.*ÿ'+/+&,('<
`=>?@ABÿÿÿ !
`"#C,7*-(-/7&,+*.*8%,(*'4-*;*--*7+,%*-*&(0*(*-/..1/'2,3&.*'+/+&,('4+18&6/..1%/)*/7&'8./14/D*18/7
`/(7/'',6&/+*7',;+E/-*7-&)*-';,-8-,)&7&(0/5'*-&(+*-;/6*<F&+%+%*/&7,;+%*5'*-&(+*-;/6*/5'*-,;+%*2,3&.*
`'+/+&,(&'*(/3.*7+,8./6*+*.*8%,(*6/..'/(78-,0-/2)/-&,5';*/+5-*',;+%*2,3&.*'+/+&,(<G,-+%,'*2,3&.*'+/+&,('
`+%/+,8*-/+*E&+%/7&0&+/.E&-*.*''(*+E,-D+%*5'*-2/1/.',%/)*+%*/3&.&+1+,-*6*&)*+*H+2*''/0*'46,28,'*/(7
`+-/('2&++*H+2*''/0*'4-*6*&)*/(7+-/('2&+*92/&.4;,-E/-76/..'4/66*''),&6*2/&.4/'E*../'+/D*/7)/(+/0*,;/
`(523*-ÿ,;ÿ,+%*-ÿ)/.5/3.*ÿ6,225(&6/+&,(ÿ;*/+5-*'<
`"I#J+6/(+%5'3*/88-*6&/+*7+%/++%*5'*-&(+*-;/6*&'/D*16,28,(*(+,;+%*2,3&.*'+/+&,(4/(7+%/++%*
`;.*H&3&.&+14*/'*,;5'*4/(7;5(6+&,(/.&+1,;+%*5'*-&(+*-;/6*/-*&28,-+/(+;*/+5-*'+%/+-*./+*+,+%*,)*-/..,8*-/+&,(
`,;+%*2,3&.*'+/+&,(<J(+%/++%*K5/.&+1,;+%*5'*-&(+*-;/6*&'7&-*6+.18*-6*&)*7/(7*H8*-&*(6*731+%*5'*-,;+%*
`2,3&.*ÿ'+/+&,(4ÿ+%*ÿ5'*-ÿ&(+*-;/6*ÿ&'ÿ/(ÿ&28,-+/(+ÿ;*/+5-*ÿ,;ÿ+%*ÿ,)*-/..ÿ2,3&.*ÿ'+/+&,(ÿ7*'&0(ÿ/(7ÿ&28.*2*(+/+&,(<
`=L>Mÿÿ @Mÿÿÿ !
`"#J+ÿ&'ÿ/ÿ;&-'+ÿ,3N*6+ÿ/(7ÿ/7)/(+/0*ÿ,;ÿ+%&'ÿ&()*(+&,(ÿ+,ÿ8-,)&7*ÿ/(ÿ&28-,)*7ÿ5'*-ÿ&(+*-;/6*ÿ;,-ÿ/ÿ2,3&.*ÿ'+/+&,(<
`"#J+&'/;5-+%*-,3N*6+/(7/7)/(+/0*,;+%&'&()*(+&,(+,8-,)&7*/(&28-,)*75'*-&(+*-;/6*;,-/2,3&.*'+/+&,(
`+%/+ÿ*(/3.*'ÿ,(*ÿ%/(7ÿ,8*-/+&,(ÿ,;ÿ/ÿ2/(&85./+,-ÿ+,ÿ0/&(ÿ/66*''ÿ+,ÿ/(7ÿ&(+*-/6+ÿE&+%ÿ/..ÿ/88.&6/+&,('<
`"O#J+&'/;5-+%*-,3N*6+/(7/7)/(+/0*,;+%&'&()*(+&,(+,8-,)&7*/25.+&2*7&/5'*-&(+*-;/6*;,-/2,3&.*'+/+&,(
`+%/+*(/3.*'&(85+7/+/;-,27&;;*-*(+',5-6*'4'56%/'+*H+&(85+4-*6,-7*7),&6*&(85+4/(7&2/0*&(85+4+,3*6,23&(*7
`+,0*+%*-ÿ&(+,ÿ/ÿ5(&;&*7ÿE%,.*ÿ;,-ÿ8-*'*(+/+&,(ÿ+,ÿ/(ÿ,8*-/+,-<
`"P#J+&'/;5-+%*-,3N*6+/(7/7)/(+/0*,;+%&'&()*(+&,(+,7&'8./15'*-9'*.*6+/3.*,8+&,('5'&(0/Q8,8958Q2*(5
`+*6%(&K5*ÿE%*-*&(ÿ/)/&./3.*ÿ,8+&,('ÿ2/1ÿ3*ÿ8/-+&+&,(*7ÿ&(+,ÿ7&;;*-*(+ÿ.,0&6/.ÿ0-,58'ÿ,;ÿ,8+&,('<
`"R#J+&'/;5-+%*-,3N*6+/(7/7)/(+/0*,;+%&'&()*(+&,(+,8-,)&7*/5'*-,;/2,3&.*'+/+&,(E&+%/(/3&.&+1+,
`Q3,,D2/-DQ6*-+/&(,3N*6+'4'56%/''*.*6+/3.*'+-&(0'/(7/88.&6/+&,(&6,('4/(7+,*(/3.*+%*3,,D2/-D*7,3N*6+'
`+,ÿ;,-2ÿ/ÿ'*8/-/+*ÿ)&*Eÿ,;ÿ5'*-98-*;*--*7ÿ,3N*6+'<
`"S#J+&'/(,+%*-,3N*6+/(7/7)/(+/0*,;+%&'&()*(+&,(+,8-,)&7*/2,3&.*'+/+&,(,3N*6+%/(7.&(02*+%,7E%*-*&(
`+%*-*&'7&'8./1*7/2*(5,;;5(6+&,(',8*-/3.*&(+%*6,(+*H+,;/65--*(+.17&'8./1*7,3N*6+4/(7*(/3.&(0+%*5'*-
`+,ÿ/6+&)/+*ÿ/ÿ'*.*6+*7ÿ;5(6+&,(4ÿ'56%ÿ/'ÿ31ÿ*7&+&(04ÿ*-/'&(04ÿ6,81&(04ÿ2,)&(04ÿ/(7ÿ2/D&(0ÿ/ÿK5*-1<
`MBTTAUÿÿÿ 
`"#$%*;,-*0,&(0,3N*6+'/(7/7)/(+/0*'/-*-*/.&V*7312*+%,7'/(7/88/-/+5'&(/66,-7/(6*E&+%*23,7&9
`2*(+'ÿ,;ÿ+%&'ÿ&()*(+&,(<
`"#W2*+%,7&'7&'6.,'*7;,-,8*-/+&(0/2,3&.*'+/+&,(46,28-&'&(0'+*8',;X/Y8-,)&7&(0+%*2,3&.*'+/+&,(+,
`%/)*/5'*-&(+*-;/6*6,28-&'*7,;/7&'8./1/(7/+.*/'+,(*5'*-&(85+7*)&6*ZX3Y7&'8./1&(0+,+%*5'*-/(&7*(+&;&6/+&,(
`,;/8.5-/.&+1,;W88.&6/+&,('+%/++%*2,3&.*'+/+&,(&'6/8/3.*,;*H*65+&(04+%*&7*(+&;&6/+&,('3*&(0'&25.+/(*,5'.1
`7&'8./1*7&(/0-&7,-.&'+;,-2/+ZX6Y2/(&85./+&(0+%*&(85+7*)&6*+,'*.*6+,(*,;+%*7&'8./1*7W88.&6/+&,(&(7&6/+&,('Z
`/(74&(-*'8,('*+,;5-+%*-&(85+;-,2+%*5'*-4X7Y7&'8./1&(0/.&'+,;[8+&,('+%/+/-*/)/&./3.*;,-+%*'*.*6+*7W88.&9
`6/+&,(<$%*'+*8,;7&'8./1&(0+%*/)/&./3.*W88.&6/+&,('6/(&(6.57*/'+*8,;0-,58&(0+%*7&'8./1*7&7*(+&;&6/+&,('
`&(+,ÿ5'*-9'8*6&;&*7ÿW88.&6/+&,(ÿ0-,58'<
`"#$%*[8+&,('/-*8-*;*-/3.17&'8./1*7&(/8,89582*(5;,-2/++%/+&'7&'8./1*7,)*-+%*65--*(+.17&'8./1*7
`W88.&6/+&,('6-**(<W+.*/'+',2*,;+%*7&'8./1*7[8+&,('/-*.,0&6/..10-,58*7+,0*+%*-&([8+&,(6/+*0,-&*'4+%*
`6/+*0,-&*'3*&(06,28-&'*7,;6,(+*H+'8*6&;&6[8+&,('4'+/+*'8*6&;&6[8+&,('4W88.&6/+&,('8*6&;&6,8+&,('4/(70*(*-/.
`[8+&,('<
`"I#$%*2,3&.*'+/+&,('+,-*'7/+/-*./+*7+,/;&-'+W88.&6/+&,(4/(7+%*2*+%,7;5-+%*-&(6.57*''+*8',;X*Y
`2/(&85./+&(0+%*&(85+7*)&6*+,7*'&0(/+*/..,-/8,-+&,(,;+%*'+,-*77/+/Z/(7X;Y;5-+%*-2/(&85./+&(0+%*&(85+
`7*)&6*+,/'',6&/+*+%*7*'&0(/+*77/+/E&+%/+.*/'+,(*,+%*-47&;;*-*(+W88.&6/+&,(4,-E&+%/7&;;*-*(+.,6/+&,(&(+%*
`'/2*W88.&6/+&,(<$%*'+,-*77/+/6,5.73*&2/0*7/+/4-*6,-7*7),&6*7/+/4+*H+5/.7/+/4,-/(17/+/+%/+6/(3*
`'5&+/3.1'+,-*7E&+%&(/2*2,-1+%/+&'.,6/..1,--*2,+*.1/66*''&3.*31+%*2,3&.*'+/+&,(<J(,(**23,7&2*(++%*
`'+,-*77/+/&'6,28-&'*7,;/2*''/0*+%/+E/'-*6*&)*7;-,2/E&-*.*''(*+E,-D4'56%/'/\%,-+C*''/0*\*-)&6*
`
`[0011] A method is disclosed for operating a mobile station, comprising steps of (a) providing the mobile station to
`have a user interface comprised of a display and at least one user input device; (b) displaying to the user an identification
`of a plurality of Applications that the mobile station is capable of executing, the identifications being simultaneously
`displayed in a grid or list format; (0) manipulating the input device to select one ofthe displayed Application indications;
`and, in response to further input from the user, (d) displaying a list of Options that are available for the selected Appli-
`cation. The step of displaying the available Applications can include a step of grouping the displayed identifications
`into user-specified Application groups.
`[0012] The Options are preferably displayed in a pop-up menu format that is displayed over the currently displayed
`Application screen. At least some of the displayed Options are logically grouped together in Option categories, the
`categories being comprised of context specific Options, state specific Options, Application specific options, and general
`Options.
`[0013] The mobile station stores data related to a first Application, and the method further includes steps of (e)
`manipulating the input device to designate all or a portion of the stored data; and (f) further manipulating the input
`device to associate the designated data with at least one other, different Application, or with a different location in the
`same Application. The stored data could be image data, recorded voice data, textual data, or any data that can be
`suitably stored within a memory that is locally or remotely accessible by the mobile station. In one embodiment the
`stored data is comprised of a message that was received from a wireless network, such as a Short Message Service
`
`10
`
`15
`
`20
`
`25
`
`
`
`



  
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`2
`
`

`

`EP 1 104 151 A2
`
`In general, this invention provides a novel user interface for a mobile station, wherein a user is given control
`[0014]
`over the Applications of the mobile station in a readily comprehended visual manner, and wherein data of various types
`is treated simply as an object that can be freely moved between and/or shared by Applications, with data format con-
`versions being made as required (e.g., character string to numeric string).
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0015] The above set forth and other features of the invention are made more apparent in the ensuing Detailed
`Description of the Invention when read in conjunction with the attached Drawings, wherein:
`
`Fig. 1 is a block diagram of a mobile station that is constructed and operated in accordance with this invention;
`
`Fig. 2 is an elevational view of the mobile station shown in Fig. 1, and which further illustrates a cellular commu-
`nication system to which the mobile station is bidirectionally coupled through wireless RF links;
`
`Fig. 3A illustrates a display screen format for Applications arranged in a grid format;
`
`Fig. 3B illustrates a display screen format for Applications arranged in a list format;
`
`Figs. 3C and 3D are examples of displayed check boxes and radio buttons, respectively;
`
`Fig. SE is an example of a displayed slider;
`
`Fig. 4 depicts several display screens and shows a logical progression of screens in response to input from a user,
`the Figure being particularly useful in explaining the Application management ofthe mobile station of Figs. 1 and 2;
`
`(SMS) or E-mail message, wherein the designated data is comprised of a character string that represents a telephone
`number, and wherein the at least one other different Application is an Application that uses a numerictelephone number.
`By example, the different Application could be an Application that originates a call to the telephone number, or it may
`be a speed dial or a call barring Application. In another embodiment the user is enabled to Bookmark certain data and
`store an identifier for the Bookmarked data in a separate Application. Subsequently selecting the separate Application,
`and then selecting one of the identifiers, results in the associated data being recalled from memory and displayed to
`the user.
`
` ÿÿ
` !" #!"##"$%#&$ $""!" "%!""% !
`!'(!# !" ""!" #&&!")%%$"!!)%%$"!" "'!'$"% !!'(*
`+,-%" #&&!")%%$"!$'#(!)%%$"!" "!"$"" "% !!'(",
`(%##$(!)%%$"!*.!!" (#!"" '!(#"+//$"!#"!#
`"!#!"&&" +//##"!%")%%$"!*'(0'!",$"!" %")%%$"!
`
`!#" !$"!!&" #!"&'"!" $"##"(!$#&,!##%,#"
`" ÿ'*
`23.!!" !4!"!%4#!4'!"&$&(""! !'4!$!"
`4" )%%$"!&" (""!!#,$% !##4'!!!# !#"&4'",%
`""#%,!(5$"" "$!(&,4#("!!#6 #(,)%%$"!" #"&"$!
`4!ÿ(!ÿ#ÿÿ0'#ÿ**ÿ$ $"ÿ"!ÿ"ÿ!'$ÿ"!*
`789:ÿ;<=89 >9?@ÿ?:ÿ>Aÿ;8B9@C<
`23D (4"&" !#" &"'&" !4!"!#%%!"!" !'!E"#
`E$%"!ÿ&ÿ" ÿ.!4!"!ÿ !ÿ#ÿ!ÿ$!5'!$"!ÿ" ÿ" ÿ""$ #ÿE!ÿ !F
`G*ÿHÿÿÿ($/ÿ#ÿ&ÿÿ(ÿ""!ÿ" "ÿÿ$!"'$"#ÿ!#ÿ%"#ÿ!ÿ$$#!$ÿ" ÿ" ÿ!4!"!I
`G*J!4"!4&" (""! !!G*H!# $ &'" '""$'$'
`!$"!ÿ,"ÿ"ÿ $ ÿ" ÿ(ÿ""!ÿÿ(#$"!,ÿ$'%#ÿ" ' ÿÿKGÿ!/I
`G*ÿL)ÿ'""ÿÿ#%,ÿ$!ÿ&"ÿ&ÿ)%%$"!ÿ!#ÿ!ÿÿ#ÿ&"I
`G*ÿL+ÿ'""ÿÿ#%,ÿ$!ÿ&"ÿ&ÿ)%%$"!ÿ!#ÿ!ÿÿ"ÿ&"I
`G*ÿLMÿ!#ÿLEÿÿ-%ÿ&ÿ#%,#ÿ$ $/ÿ(-ÿ!#ÿ#ÿ('""!ÿ%$"4,I
`G*ÿLÿÿ!ÿ-%ÿ&ÿÿ#%,#ÿ#I
`G*N#%$"4#%,$!!# $%!&$!!%!"!%'"&'
`" G'(!%"$','&'!-%!!" )%%$"!!!"&" (""!&G*H!#JI
`G*ÿOÿ#%$"ÿ4ÿ#%,ÿ$!ÿ!#ÿ ÿ-%ÿ&ÿ$"!ÿ"I
`G*ÿPÿ#%$"ÿ"ÿ#%,ÿ$!ÿ!#ÿ ÿ!ÿ-%ÿ&ÿÿ'"$"!ÿ"I
`G*ÿQÿ#%$"ÿ4ÿ#%,ÿ$!ÿ!#ÿ ÿ-%ÿ&ÿ$"!ÿ#I
`G*ÿRÿ#%$"ÿ4ÿ#%,ÿ$!ÿ!#ÿ ÿ-%ÿ&ÿS!ÿ!#ÿ$!ÿ#"I
`G*ÿTÿ#%$"ÿ"ÿ#%,ÿ$!ÿ!#ÿ ÿ!ÿ-%ÿ&ÿ$!"-"ÿ!"4ÿU%"!I
`G*HV#%$"4#%,$!!# $%!&$!!%!"!%'"&
`'ÿ" ÿG'ÿ(!ÿ%"$',ÿ'&'ÿ!ÿ-%!!ÿ" ÿ#"!ÿ&ÿ#"ÿ!ÿÿ&#I
`G*ÿHHÿÿ!ÿ-%ÿ&ÿÿ%%'%ÿ!'I
`G*HJ#%$""#%,$!!# $%!&$!!%!"!%'"&'
`" ÿG'ÿ(!ÿ%"$',ÿ'&'ÿ!ÿ-%!!ÿ" ÿ##"!ÿ&ÿÿ+//ÿ"ÿÿG4"ÿ"I
`G*HL#%$""#%,$!!# $%!&$!!%!"!%'"&'
`" ÿG'ÿ(!ÿ%"$',ÿ'&'ÿ!ÿ-%!!ÿ" ÿ$!ÿ&ÿÿ+//ÿ&ÿ" ÿG4"ÿ"I
`G*ÿHNÿÿÿ&'" ÿ-%ÿ&ÿÿ%%'%ÿ!'I
`G*ÿHOÿÿÿ  ÿ4ÿ#ÿ&ÿ!ÿ.!"!"ÿ4$ÿ)$ "$"'ÿ" !ÿ $ ÿ" ÿ!4!"!ÿ#I
`
`Fig. 5 depicts several display screens and shows examples of selection lists;
`
`Fig. 6 depicts two display screens and shows an example of a multi-selection list;
`
`Fig. 7 depicts several display screens and shows examples of selection grids;
`
`Fig. 8 depicts several display screens and shows examples of zooming and scrolling data;
`
`Fig. 9 depicts two display screens and shows an example of context sensitive Options;
`
`Fig. 10 depicts several display screens and shows a logical progression of screens in response to input from a
`user, the Figure being particularly useful in explaining the editing of data in a field;
`
`Fig. 11 is an example of a pop-up menu;
`
`Fig. 12 depicts two display screens and shows a logical progression of screens in response to input from a user,
`the Figure being particularly useful in explaining the addition of a Bookmark to a Favorites list;
`
`Fig. 13 depicts two display screens and shows a logical progression of screens in response to input from a user,
`the Figure being particularly useful in explaining the recalling of a Bookmark from the Favorites list;
`
`Fig. 14 is a further example of a pop-up menu;
`
`Fig. 15 is a high level diagram of an Intelligent Service Architecture within which this invention resides;
`
`10
`
`15
`
`20
`
`25
`
`
`
`



  
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`3
`
`

`

`EP1 104151 A2
`
`Fig. 16 is a high level diagram of a mobile station hardware/software architecture in accordance with an aspect of
`this invention;
`
`Fig. 17 depicts a relationship between a Personal Number Directory (PND) server and various database entries;
`
` ÿÿ
` !!"#$!#%!%!&"%%"%#!"'%!
`!ÿ""!")
`ÿ*ÿ'%!ÿÿ!"'ÿ !#"ÿÿ+"ÿ,& ÿ-%!.ÿ/+,-0ÿÿ"ÿ&ÿ! ÿ"!)
`ÿ1ÿ'%!ÿÿ!"'ÿ !#"ÿ"ÿ2"ÿÿ"ÿ&ÿ! ÿ"!)ÿ"
`ÿ3ÿ'%!ÿÿ!"'ÿ !#"ÿÿ4%ÿ5%ÿÿ"ÿ&ÿ! ÿ"!
`-678296-ÿ-6:;52+72<,ÿ<ÿ7=6ÿ2,46,72<,
`>?@5"%!"A&!!"#&!" !!"BC&% &!
`"!!!%&!'"'"%&"%!C!!&! '%!%"!""!"7
` !!"B"%&""!""A!"!!""!"%"" ! 
`
`!!"DB7 !!"DB'!%&"!#E%'"F:!!"$G :#!%";"!$
`2"!#E"&"%!"/FG20DA!!"%& #!%"%"!/G:;0DH7G:;DH'%""%!"
`!ÿ""ÿ!&"Eÿ#"ÿ!ÿ ÿ!!"ÿBÿÿ"ÿ"ÿÿ%
`>I@7 !!""%&&!/G<-0H8C!"!!HC%C&!/-6G<-0
`8C"%"!1!!'"!"%"!!"!!H"%C'%J
`!.7""%&"""!""%%"%#!!"!%!"!''% %&
`.!C"&'%"$&"!!7"!%!".".C&%"
` "!"&!'%%/7-G80%"&!'%%/;-G80C!!%"!
`""!"ÿÿ"!ÿ%"!"ÿÿ&ÿ#!ÿ".ÿ"ÿ'!%&ÿÿ"!%
`>K@2!&!& &"!!!! !!"B%" %&"!"%C"
`!!! !!"B%" %' '!"#!""!%!"C&!"!.'C"
`%%ÿ!.'
`>L@2!&"!!!!%"!1"%&!%%&!.M&'"!"!&"%
`&"%!"! !!"F.N'C!%"!1. %'!"'%%C
`%'%%C"&"!!%"!C!!"%"!C"!&''!%J
`%&!7%"!""'%"&"%!"! !!"%! !#"!%%%"
`!ÿ!ÿ'%!ÿ%' !
`>@8&"!%"%&%""!"'"'E*C%""!"%'"3C'"!
` '.AB/' ." "!'.%""C#!N!0C"&"'&!%C
`!.'%.E.'AAC#%%&'!!%"!17E.'AA"%&!%""!""&%
`/BJ30"!E./OCP0AAC"!E.AA &'!"! !!"B7!E.AA
`.ÿ"%&Cÿ .ÿN'Cÿÿ:6,-ÿE.Cÿ&ÿ"&ÿ%"ÿ"ÿ!ÿE.Cÿ"ÿÿ+Q5ÿE.
`>@7&"!%&!%'C"' "!!""!"C""!!'"!"
`'."!"%AD7"!"%AD%' !!!#!"C&%!"
`#!""NJ.%"!.!!!'.%"ABNJ.%"!.!7%"!1%"'&!
`!"!"%AD"%"!"!%&AB'!""!'.%"ABC"$!%!.
`
`!'%""F.N'C!"!"%AD.&"%!""""!R.!%EC
` C&7"!"%AD&!"%&!!"#!%AD# .CN'CJ
`
`'"!"&.'!'!"%&#!%%&!!!%!  .!%"!1&%J
`E"#"!S<TSN'C .'."!"!"%AD!&" !"!
`NJ.%!""!'.%"ABC"!"%&%&!#!%AD#%"!'! .!%"!
`1%"!!E!.'%!"!!!"!%"%!"7&!"!"
`%ÿADÿÿ&!ÿ!ÿ #ÿ"ÿ!ÿ%'!"ÿÿ'"!.ÿ'ÿ "!ÿÿ&ÿ"!%ÿ!
`>@7"!"%AD%& '"!&"&%JE.#!'!<TJE.%!"!
`
`!&E.C .&"HJ%!"R.!%E#!%!/<T0&"%!"!.#"'2""!
` "!!"!"%AD'"!#!!#!$!E.'%R%"!!"N/&'J#"0
`
`'!"2!&!& ''%!!!!"!"%AD%& '"!"!."!
`&! ÿ "!
`>U@2!"!!!"' "!!"!"%AD%'  "'! .!&
`#!".""C! .'."!&V"!%!"#!!"&!&"!%!""!"
`>@7 !!"B"%& !!.A'#"!&%%&!!!M&!'!
`!ÿ ÿ!!"
`>@7 !!"B"%&&C#"%%!.!.AHC#"
`!'&!.%"!"!" !!& .!%"!1&"!'!"! !!"
`
`[0017] The mobile station includes a modulator (MOD) 14A, a transmitter 14, a receiver 16, a demodulator (DEMOD)
`16A, and a controller 18 that provides signals to and receives signals from the transmitter 14 and receiver 16, respec-
`tively. These signals include signalling information in accordance with the air interface standard ofthe applicable cellular
`system, and also user speech and/or user generated data. The air interface standard may have any form, such as one
`based on time division multiple access (TDMA) or code division multiple access (CDMA), as the teachings of this
`invention are not constrained for use with any one particular air interface.
`[0018]
`It should thus be understood that the mobile station 10 can be a vehicle mounted or a handheld device, and
`that the mobile station 10 can be capable of operating with one or more air interface standards, modulation types, and
`access types.
`[0019]
`It is understood that the controller 18 also includes the circuitry required for implementing the audio and logic
`functions of the mobile station. By example, the controller 18 may be comprised of a digital signal processor device,
`a microprocessor device, and various analog to digital converters, digital to analog converters, and other support cir-
`cuits. The control and signal processing functions ofthe mobile station are allocated between these devices according
`to their respective capabilities.
`[0020] A user interface 11 includes a conventional earphone or speaker 17, a conventional microphone 19, a point
`addressable display 20 (preferably enabling the display of icons and images, as well as text), and a user input device,
`typically a keypad 22, all of which are coupled to the controller 18. The keypad 22 includes the conventional numeric
`(0-9) and related keys (#,*) 22a, and other keys 22b used for operating the mobile station 10. These other keys 22b
`may include, by example, a SEND key, various menu scrolling and soft keys, and a PWR key.
`[0021] The user interface 11 further comprises, in a preferred embodiment of this invention, an integrated pointing
`or display navigation device 23. The navigation device 23 is capable of at least two degrees of motion, such as motion
`within an x-y coordinate system related to a display screen 20 x-y coordinate system. The controller 18 receives inputs
`from the navigation device 23 and converts same into cursor 20a positions on the display screen 20, and/orto selectively
`highlight a specified line or region. By example, the navigation device 23 may function in a manner similar to ajoystick,
`rollerball, or a mouse. The navigation device 23 further includes at least one switch 23a whereby, for example, de-
`pressing the manually operated portion causes a switch closure that is detectable by the controller 18 as a user ac-
`knowledgement or "OK". For example, by employing the navigation device 23 the user is enabled to designate a desired
`x-y location on the display screen 20, and then cause a closure of the switch 23a which is interpreted by the controller
`18 as a command to take some type of action related to the designated screen location. The use of the navigation
`device 23 is further detailed below in the description of presently preferred embodiments of user interface methods.
`[0022] The navigation device 23 could be implemented using four scroll-keys with a separate OK-key located in the
`middle of the four keys, or by using a 4-directional joystick with select (OK) functionality when depressed. In another
`embodiment the navigation device 23 is implemented with two right/left keys placed adjacent to a single axis (up-down)
`roller portion. It should thus be appreciated that the navigation device 23 could be implemented in a variety of different
`suitable embodiments.
`
`Fig. 18 depicts a relationship between an Imaging server and various database entries; and
`
`Fig. 19 depicts a relationship between a Voice Recorder server and various database entries.
`
`DETAILED DESCRIPTION OF THE INVENTION
`
`[0016] Reference is made to Figs. 1 and 2 for illustrating a wireless user terminal or mobile station 10, such as but
`not limited to a cellular radiotelephone or a personal communicator, that is suitable for practicing this invention. The
`mobile station 10 includes an antenna 12 for transmitting signals to and for receiving signals from a base site or base
`station 30. The base station 30 is a part of a cellular network comprising a Base Station/Mobile Switching Center/
`lnterworking function (BMI) 32 that includes a mobile switching center (M80) 34. The MSC 34 provides a connection
`to landline trunks when the mobile station 10 is involved in a call.
`
`It is noted that in a preferred embodiment the navigation device 23 is capable of being operated by the user
`[0023]
`with only one hand, thereby simplifying the user‘s interaction with the novel multimedia user interface 11 ofthis invention.
`[0024] The mobile station 10 also includes a battery 26 for powering the various circuits that are required to operate
`the mobile station.
`
`[0025] The mobile station 10 also includes various memories, shown collectively as the memory 24, wherein are
`stored a plurality of constants and variables that are used by the controller 18 during the operation of the mobile station.
`
`10
`
`15
`
`20
`
`25
`
`
`
`



  
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`4
`
`

`

`For example, the memory 24 stores the values of various cellular system parameters and the number assignment
`module (NAM). An operating program for controlling the operation of controller 18 is also stored in the memory 24
`(typically in a ROM device). The memory 24 may also store data, including user messages, that are received from the
`BMI 32 prior to the display of the messages to the user. Various display screen presentations, text, and images are
`also stored in the memory 24, as will be discussed below.
`[0026] The operating program in the memory 24 includes routines to present messages and message-related func-
`tions to the user on the display 20, typically as various menu items. The memory 24 also includes routines for imple-
`menting the methods described below.
`[0027] By way of introduction, the user interface 11 in accordance with the teaching of this invention allows features
`and keys to be added and removed easily without having to change the basic architecture or design of the mobile
`station 10. Preferably, the user interface 11 is such that the user can operate the mobile station 10 using one hand,
`including accessories.
`[0028] The user interface 11 generally supports two methods of operation: a fast method for advanced users (using
`shortcuts, etc.) and an step-by-step simplified method for new users.
`[0029] When the user presses a key in the idle mode, the display 20 responds in a way that informs the user of the
`key's primary function, which could be a shortcut.
`[0030] During the operation of the user interface 11 the phone function is always available. A primary application is
`one referred to as Phonebook, and the basic state of the phone is Phone Idle.
`[0031] The user interface 11 embodies an application centricity approach, wherein multitasking possibilities exist,
`and wherein a dedicated Application-key ensures all applications are available at all times, and furthermore enables
`the userto easily swap between different functions/applications. Each application has a clearly recognizable application
`idle state. A separate clear-key is preferably placed together with the numeric keys.
`[0032] The user interface 11 also embodies an intuitive navigation and selection approach, wherein the manually
`operated navigation device 23 is employed as primary control device. The press capability of the navigation device 23
`is used to Select/Zoom consistently through the user interface 11.
`[0033]
`Further in accordance with this invention, all available functions/commands in any state can be found in an
`options list (accessed via a Left-softkey designated as Options). The options list displays as a pull-down menu, which
`visually has a close relation to the displayed functions/commands.
`[0034] The keypad 22 preferably contains at least the following keys: two softkeys (Left and Right), the navigation
`device 23 (e.g., roller + ScrollLeft + ScrollRight with press capability=OK), the Application-key, the Send-key, the End-
`key, the Clear-key, and an ITU-T compatible alpha/numeric keypad.
`[0035] The Left soft-key is generally used for options; both general options (options applying to a certain situation,
`e.g. application options and settings) and to context-sensitive options, such as those options that apply to a currently
`selected item (e.g. delete a highlighted message).
`[0036] The Right soft-key is generally used for cancel, backstep, or quit operations. In the application Idle state the
`Right soft key is generally used for backstepping.
`[0037]
`In Edit situations, scrolling the navigation device 23 up/down is used for moving the cursor 20a up and down
`one line. The Right/Left soft-keys are used in Edit situations to move the cursor 23a right and left.
`[0038]
`In situations where data are being viewed in a Details mode, e.g. memory entries, the Right/Left soft-keys
`are used to move the view to respectively the next and the previous item. In a Calendar View situation, the Right/Left
`soft-keys are similarly used to move to the next/previous day, week, month or day; depending on what is currently
`being viewed. By pressing the navigation device 23 the user selects the highlighted item.
`[0039]
`In situations where a highlighted entry is a specific text str