a2, United States Patent
`US 7,007,239 B1
`(10) Patent No.:
`
` Hawkinsetal. (45) Date of Patent: Feb.28, 2006
`
`
`US007007239B1
`
`(54) METHOD AND APPARATUS FOR
`ACCESSING A CONTACTS DATABASE AND
`TELEPHONE SERVICES
`
`(75)
`
`.
`.
`Inventors: Jeffrey Charles Hawkins, Atherton,
`CA (US); Robert Yuj Haitani, Menlo
`Park, CA (US)
`
`(73) Assignee: Palm, Inc., Sunnyvale, CA (US)
`
`.......... 455/464
`8/1998 Schroederet al.
`5,797,098 A *
`6/1999 Whipple etal. ....... 379/356.01
`5,917,905 A *
`5/2002 Schnarelet al.
`..... 379/93.17 X
`6,389,124 B1 *
`6/2002 Bakeret al. wo. 707/5 X
`6,405,172 Bl *
`6,502,090 B1 * 12/2002 Raisanen oo... 707/3
`6,557,004 Bl *
`4/2003 Ben-Shacharet al.
`...... 707/102
`
`* cited by examiner
`
`(*) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`US.C. 154(b) by 496 days.
`
`Primary Examiner—Raymond J. Bayerl
`(74) Attorney, Agent, or Firm—Fenwick & West LLP
`
`(57)
`
`ABSTRACT
`
`(21) Appl. No.: 09/977,871
`
`(22)
`
`Filed:
`
`Oct. 14, 2001
`
`Related U.S. Application Data
`
`(63) Continuation-in-part of application No. 09/668,123,filed on
`Sep. 21, 2000, now Pat. No. 6,781,575.
`
`(51)
`
`Int. Cl.
`GO6F 3/14
`HO4M 1/247
`
`(2006.01)
`(2006.01)
`
`(52) US. Ch. ceececccccccccsssee 715/780; 715/864; 715/776;
`707/3; 707/7; 379/93.23
`(58) Field of Classification Search ................. 345/781;
`7107/3, 7, 5, 104.1; 359/356; 715/780, 864,
`715/963, 776, 781, 779, 777, 840, 968, 835;
`455/414, 418, 564, 344; 379/90.01, 93.17,
`379/93.19, 93.23
`See application file for complete search history.
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`Sophisticated computer-enhanced mobile telephones require
`intuitive user interfaces in order to allow a user to take
`
`advantageofall the available features. The present invention
`discloses an intuitive telephone system user interface that
`provides both simple familiar and new powerful user inter-
`faces to the user. In one embodiment, the user is presented
`with four permanently available user interface views and a
`fifth user interface view that is available when there is an
`active telephonecall. The first permanently available view is
`a dial pad view that is similar to a common touch tone dial
`pad. A second permanently available view is a speed dial
`view that allows users to easily create their own customized
`speed dial buttons that are easy to navigate between and can
`be edited at any time. The third view is the call history view
`that displaysa list of previous incoming, outgoing, or missed
`calls and may befiltered as desired by the user. The final
`permanently available view is a contacts view that provides
`a filtering mechanism that allows the user to quickly search
`through a large personal contacts database. The fifth user
`interface view is the active call view that displays a set of
`commandbuttons for accessing advanced telephone features
`during a telephone call such as hold, three way calling,
`DTMFtouch tones, hang-up, speakerphone, etc.
`
`5,745,904 A *
`
`4/1998 King et al. eccccccee 707/200
`
`37 Claims, 16 Drawing Sheets
`
`Contacts
`
`wAll all 4g
`
`JK
`
`Arnold, Chevy
`
`Arnold, Clint
`
`Carnack, Mike
`
`Carter, Jimmy
`Harris, Carmine
`Lamb, Carmen
`
`1-650-555-3335 W
`1-650-408-3310 M
`
`1-925-330-9250 H
`
`1-650-408-3301 W
`
`1-408-925-3332 H
`1-650-330-3352 W
`
`1-408-408-9252 H
`
`1-650-330-3341 W
`
`1315
`
`4325
`
`S
`
`1-925-330-3333 W |
`
`
`1330
`
`~—Y
`1321
`
`1322 1323
`
`Page | of 29
`
`GOOGLEEXHIBIT 1007
`
`Page 1 of 29
`
`GOOGLE EXHIBIT 1007
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 1 of 16
`
`US 7,007,239 B1
`
`Figure 1A
`
`Figure 1B
`
`Page 2 of 29
`
`Page 2 of 29
`
`
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 2 of 16
`
`US 7,007,239 B1
`
`
`
`Page 3 of 29
`
`Page 3 of 29
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 3 of 16
`
`US 7,007,239 B1
`
`
`
`Page 4 of 29
`
`Page 4 of 29
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 4 of 16
`
`US 7,007,239 B1
`
`Page 5 of 29
`
`Page 5 of 29
`
`

`

`Principal TelephoneInterface Views 405
`Dial
`Call
`pad view
`History
`410
`view 420
`
`Active
`
`|
`
`Contacts
`
`
`
`Call
`details
`421
`
`Check
`SMS
`
`entry
`details
`
`preferences
`
`
`Telephone Application 401|
`
`
`
`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 5 of 16
`
`US 7,007,239 B1
`
`
`
`
`
`
`Edit
`list 432
`
`Edit
`entry
`434
`
`Lookup
`number
`436
`
`
`
` Contacts
`view 440
`
`Call 450 |
`
`
`
` Phone
`
`Figure 4
`
`Page 6 of 29
`
`Page 6 of 29
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 6 of 16
`
`US 7,007,239 B1
`
`Network 123
`
`all a.
`
`Soom
`oaog Figure5A
`
`Bag
`Sace Figure5B
`
`Network 123
`
`atl
`
`hl :
`
`aooe
`
`Page 7 of 29
`
`Page 7 of 29
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 7 of 16
`
`US 7,007,239 B1
`
`> Adam Blak..WN)
`
` Call History
`
`> Maura(W)
`> HSVoicemail
`> Lisa Best(W)
`> HSVoicemail
`> Home Voic...(W) |
`> Home Voic...(W) |
`> 16505551234
`> 16505551234
`> 16505551234
`
`> HSVoicemail
`
`Figure 6
`
`Page 8 of 29
`
`Page 8 of 29
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 8 of 16
`
`US 7,007,239 B1
`
`Figure 7
`
`725
`
`0 791 7
`
`Network 123
`
`rr )
`
`ATi
`
` A
`
`
`710
`
`Page 9 of 29
`
`Page 9 of 29
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 9 of 16
`
`US 7,007,239 B1
`
`felines
`
`
`Name:._.__---------
`
`
`
`Numbert.__..-----------ee
`
`
`Extra Digits:
`
`[_] Make Speed Dial mydefault view
`
`
`
`
`
`
`Figure 9A
`
`Fiqure 9B
`
`961
`
`962
`
`963
`
`
`
`col] maneT
`
`Name:..Gre9
`
`Number:.650-555-7894
`
`Extra Digits:
`
`[] Make Speed Dial my default view
`
`961
`
`962
`
`963
`
`Page 10 of 29
`
`Page 10 of 29
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 10 of 16
`
`US 7,007,239 B1
`
`OebLv
`
`Day
`
`EeeBis)
`
`Q0EE-Sss-0g9WPAN
`
`Page 11 of 29
`
`
`leiqpoadsupg
`suondg=pS
`TTTaeemenBsale)1BWEN
`
`
`
`palajInegepAuryeigpaedsonswoO
`9961-9b£-099
`UE|
`suondg=pal
`bEeanbi4
`DUEEErenee
`“ooBSeTTN
`3¥£zL
`
`
`matayInesepAw[ekgPoodgyewOl
`
`saequunn
`
`taeoom
`
`
`
`eres)(WN82100,
`
`eeIUy suondgpa
`
`Page 11 of 29
`
`
`
`
`
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 11 of 16
`
`US 7,007,239 B1
`
`
`
`
`
`MainyNeyapAwjegpasdsayewCT
`
`g+tzL
`
`
`
`Tonosrene95Tecowen
`
`LL22-Pbe-0S9
`
`
`
`FASOoeeneeerowlions][FIGpeadsupg
`
`Page 12 of 29
`
`Page 12 of 29
`
`
`
`
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 12 of 16
`
`US 7,007,239 B1
`
`wAll ool] fe ‘
`
`
` Arnett, Cand
`ere)
`
`
`
`
`
`
`
`
`
`
`
`
`1-650-330-3341 W
`
`1-925-330-3333 W
`
`
`
`
`
`4315
`
`~
`>
`_/
`
`-
`
`»
`
`1325
`
`
`
`_/
`=
`1335
`
`Arnold, Chevy
`
`Arnold, Clint
`
`Carnack, Mike
`
`1-650-555-3335 W
`1-650-408-3310 M
`
`1-925-330-9250 H
`
`1-650-408-3301 W
`
`1-408-925-3332 H
`1-650-330-3352 W
`
`
`
`Carter, Jimmy
`Harris, Carmine4-408-408-9252 H
`Lamb, Carmen
`
`
`
`1322
`
`1323
`
`a 1
`
`321
`
`Figure 13
`
`Page 13 of 29
`
`Page 13 of 29
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 13 of 16
`
`US 7,007,239 B1
`
`Network 123
`
`Vv All all ‘a } 1415
`
`—™\
`
`oy *
`
`Active
`Voicemail
`1-650-555-1234 00:24
`
`1425
`
`|
`
`|
`
`1463
`
`1464
`
`Page 14 of 29
`
`Page 14 of 29
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 14 of 16
`
`US 7,007,239 B1
`
`
`
`Active
`Voicemail
`1-650-555-1234 00:24
`
`>
`
`1525
`
`Xpoupi—/
`Hang
`Cancel
`Up
`Hold
`Spkr
`
`t
`
`1563
`
`1564
`
`Page 15 of 29
`
`Page 15 of 29
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 15 of 16
`
`US 7,007,239 B1
`
`PhoneCall
`
`Home
`1-650-555-1234
`
`
`
`4
`Answer
`
`x
`Ignore
`
`1625
`
`>
`
`
`
`Figure 16
`
`Page 16 of 29
`
`Page 16 of 29
`
`

`

`U.S. Patent
`
`Feb. 28, 2006
`
`Sheet 16 of 16
`
`US 7,007,239 B1
`
`PhoneCall
`
`1715
`
`Home
`1-650-555-1234
`
`
`
`‘1725
`
`Answer
`2/
`
`Open Lid
`
`Press Scroll Up
`Button
`
`Figure17
`
`Page 17 of 29
`
`Page 17 of 29
`
`

`

`US 7,007,239 B1
`
`2
`pad. However, the dial pad view has added functionality and
`may automatically switch to other views as needed.
`A second permanently available user interface view is a
`speed dial view. The speed dial view allowsusers to easily
`create their own customized speed dial buttons that are easy
`to navigate between and can be edited at any time. The
`system may automatically switch from the speed dial view
`in certain circumstances.
`
`The third user interface view is the call history view. The
`call history view displays a list of previous incoming,
`outgoing, or missed calls and maybefiltered as desired. As
`with the previous two views, the system may automatically
`switch from the call history view to another user interface
`view as necessary.
`The final permanently available user interface view is a
`contacts view. The contacts view provides a powerful fil-
`tering mechanism that allows the user to quickly and intu-
`itively search through a large personal contacts database.
`The fifth user interface view is the active call view. The
`
`active call view displays a set of command buttons for
`accessing advanced telephone features during a telephone
`call such as hold, three way calling, DIMF touch tones,
`hang-up, speakerphone, etc.
`Other objects, features, and advantages of present inven-
`tion will be apparent from the company drawings and from
`the following detailed description.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`10
`
`15
`
`20
`
`25
`
`30
`
`invention is
`A preferred embodiment of the present
`described in detail hereinafter, by way of example only and
`with reference to the accompanying drawings, in which:
`FIG. 1A is a front isometric view of a handheld computer
`system on which an embodiment of the present invention
`may be implemented;
`FIG. 1B is rear isometric view of the handheld computer
`system of FIG. 1;
`FIG. 2 is a front isometric view of the handheld computer
`system of FIGS. 1A and 1B equipped with a wireless
`communications peripheral attachment;
`FIG. 3A is a front isometric view of an integrated stylus-
`based handheld computer and cellular telephone system;
`FIG. 3B is a rear
`isometric view of an integrated
`keyboard-based handheld computer and cellular telephone
`system;
`FIG. 3C illustrates one embodimentof a keyboard layout
`for the handheld computer and cellular telephone system of
`FIGS. 3A and 3B;
`FIG. 4 is a functional block diagram of a telephone user
`interface software application;
`FIG. 5Aillustrates one possible embodimentfor a display
`arrangementfor a telephone dial pad user interface view;
`FIG. 5B illustrates the telephone dial pad user interface
`view of FIG. 5A when there is an active telephone call;
`FIG. 6 illustrates one possible embodimentfor a display
`arrangementfor a telephonecall history user interface view;
`The present invention discloses a powerful yet simple and
`FIG. 7 illustrates one possible embodimentfor a display
`intuitive telephone system user interface. The telephone
`arrangementfor a telephone speed dial user interface view;
`system user interface of the present invention provides both
`FIG. 8 illustrates. one possible embodimentfor a display
`familiar and powerful user interfaces to the user. In one
`embodiment, the user is presented with four permanently
`arrangement for a telephone speed dial page editing user
`available user interface viewsandafifth user interface view
`interface;
`65
`that is available when there is an active telephonecall.
`FIG. 9Aillustrates one possible embodimentfor a display
`The first permanently available user interface view is a
`arrangementfor a telephone speed dial record creating user
`interface;
`dial pad view that is similar to a commontouch tone dial
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`1
`METHOD AND APPARATUS FOR
`ACCESSING A CONTACTS DATABASE AND
`TELEPHONE SERVICES
`
`RELATED APPLICATIONS
`
`This patent application is a continuation-in-part of the
`US. patent application entitled “Method and Apparatus for
`Organizing Addressing Elements”, having Ser. No. 09/668,
`123,filed Sep. 21, 2000, now USS. Pat. No. 6,781,575 B1.
`
`FIELD OF THE INVENTION
`
`The present invention relates to the field of computer-
`human interfaces. In particular the present invention relates
`to a graphical
`interface for operating a computer based
`telephony device and an interface for accessing names and
`telephone numbers from a contacts database.
`
`BACKGROUND OF THE INVENTION
`
`Handheld information organization and communications
`devices are becoming increasingly popular for both business
`users and more general users. For example, handheld com-
`puter systems such as the 3Com line of Palm handheld
`computers, the Handspring Visor line of handheld computer
`systems, and the Microsoft PocketPC have found wide-
`spread acceptance amongst people for the purpose of orga-
`nizing their calendars and storing personal contact informa-
`tion. Typically, these handheld computer systems contain
`Personal Information Management (PIM)applications such
`as an address book, a calendar application, a memo
`application, and a To-Do list application. Such handheld
`computer systems are very popular because they are small
`enough to be carried all the time and do not require any
`“boot” time before entering an operational state. Thus, such
`handheld computer systems allow constant easy access to a
`large amount of personal information.
`Sales research has indicated that having a simple intuitive
`methodof quickly accessing the personal information datais
`one of the most important aspects of a handheld computer
`system. Due to its simple elegant design and efficient
`operation, handheld computer systems based upon the Palm
`Operating System (PalmOS) have captured a large propor-
`tion of the handheld computer system market. With the
`PalmOS, a user can select and manipulate data in a number
`of different ways. For example, a user may use up/down
`scroll buttons, a user may select an item displayed on a touch
`screen, and a user mayscroll through different category lists
`by repeatedly pressing an application button.
`One of the most
`important applications of handheld
`computer systems is to hold personal
`information. For
`example, an addressbook application is used to store and
`access a list of acquaintances and contact details. To satisfy
`consumers,
`it would be desirable to create new useful
`interfaces that allow a user to select and arrange items in
`such lists quickly and in a simple manner.
`
`SUMMARYOF THE INVENTION
`
`Page 18 of 29
`
`Page 18 of 29
`
`

`

`US 7,007,239 B1
`
`3
`FIG. 9B illustrates one possible embodimentfor a display
`arrangement for a telephone speed dial record editing user
`interface;
`FIG. 10 illustrates a series of user interface screens
`navigated by a user whencreating a new speed dial entry in
`an empty speed dial slot;
`FIG. 11 illustrates a series of user interface screens
`navigated by a user whencreating a new speed dial entry in
`a speed dial slot that already has a current speed dial record;
`FIG. 12 illustrates a series of user interface screens
`
`navigated by a user when editing an existing speed dial entry
`from a different speed dial page;
`FIG. 13 illustrates one possible embodimentfor a display
`arrangement for a telephone contacts user interface view;
`FIG. 14 illustrates a first view of a display arrangement
`for a telephone active call user interface view;
`FIG. 15illustrates a second view of a display arrangement
`for a telephone active call user interface view;
`FIG. 16 illustrates an alert screen that may be display
`when an incoming call
`is received and the lid of the
`telephone is open; and
`FIG. 17 illustrates an alert screen that may be display
`when an incoming call
`is received and the lid of the
`telephone is closed.
`
`DETAILED DESCRIPTION OF THE
`PREFERRED EMBODIMENT
`
`A method and apparatus for accessing a contacts database
`and telephoneservices is herein disclosed. In the following
`description, for purposes of explanation, specific nomencla-
`ture is set forth to provide a thorough understanding of the
`present invention. However,it will be apparent to one skilled
`in the art that these specific details are not required in order
`to practice the present invention. For example, the present
`invention has been described with reference to handheld
`computer and cellular telephone systems. However,
`the
`same techniques can easily be applied to other types of
`telephony devices such as non mobile telephone systems.
`Handheld Computer and Wireless Communication Devices
`FIGS. 1A and 1B illustrate a first handheld computer
`system 100. As illustrated in FIG. 1A,
`the front of the
`handheld computer system includes a display area 120 and
`several physical buttons 130. The display area 120 includes
`a visual display device, such as a liquid crystal display for
`presenting information to the user. A user may manipulate
`the physical buttons 130 to input
`information into the
`handheld computer system 100 and make selections of
`information presented on the display area 120. In a preferred
`embodiment, the display area 120 may also be covered with
`a digitizer pad that can be utilized by the user to enter
`information to the computer system using a stylus (not
`shown)ora finger.
`In operation of the preferred embodiment, the display area
`120 displays information to the user of the handheld com-
`puter system 100. The user is then able to employ a stylus
`or a finger to manipulate and interact with the displayed
`information by touching the digitizer pad overlaid on top of
`the display device. In one mode of operation, the stylus can
`be used in the manner of a writing pen to enter characters
`and figures by drawingthe stylus across the digitizer pad. In
`one embodiment, the user is instructed to enter text into a
`specific area 125 of the digitizer pad. The stylus and digitizer
`may function like a computer mouse to operate and manipu-
`late interactive elements on the display. For example, the
`computer system may present a virtual button in a location
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`on the display that can be activated to perform an associated
`function by the user tapping the stylus or a finger on the
`digitizer pad at the virtual button location. The stylus can
`also be used to perform “drag and drop” operations in the
`fashion known in the use of a computer mouse.
`The handheld computer system 100 also includes an
`expansion connector slot 110, seen in the rear view of FIG.
`1B. The expansion connector slot allows peripheral devices
`to be connected to the computer system to interact therewith.
`Many kinds of peripheral devices can be connected to the
`handheld computer system 100 through the expansion con-
`nector slot 110 including, GPS receivers, memory modules,
`pager modules, and cellular telephone transceivers.
`FIG. 2 illustrates an isometric view of a handheld com-
`
`puter system 100 as described above, with a cellular tele-
`phone transceiver 150 coupled thereto by the expansion
`connector slot 130. The cellular telephone transceiver 150
`comprisesa first portion 152 that is fixed to the body of the
`handheld computer system and a second portion 154. The
`second portion 154 of the radio telephone device is hingedly
`coupled to the first portion 152 to allow it to pivot from a
`closed position where it covers the display area 120 to an
`open position as shown in FIG. 2. Whenin the open position,
`a speaker 156 in the second portion of the cellular telephone
`transceiver 150 can be held proximate to the ear of the user
`while the user speaks into a microphone 112 providedin the
`handheld computer system 100.
`The cellular telephone transceiver 150 includes circuitry
`for enabling communications with a cellular telecommuni-
`cations network and processing circuitry that, together with
`onboard software or firmware, allows the cellular telephone
`transceiver 150 to interact with the handheld computer
`system 100. Various aspects of a handheld computer system
`and interconnected cellular radio telephone are described in
`co-pending patent Application Ser. No. 09/374,095 filed
`Aug. 12, 1999 and entitled “A Mobile Computer System
`Designed for Wireless Communication Expansion”. The
`disclosure of that co-pending patent application is hereby
`expressly incorporated herein by reference.
`It will be appreciated that the handheld computer system
`100 and functions of the cellular telephone transceiver 150
`operate principally under the control of computer software.
`The handheld computer system 100 includes a micropro-
`cessor and built-in software that provides application pro-
`grams for the user. The cellular telephone transceiver 150
`may also include a microprocessor, together with software
`code and data specifically required for the telephone func-
`tions.
`In a preferred embodiment, a computer software
`phoneapplication that provides the user interface functions
`for the cellular telephone transceiver peripheral 150
`executes on the handheld computer system microprocessor.
`However, the software code may be permanently stored in
`either the handheld computer or
`the cellular telephone
`transceiver peripheral 150. Similarly, data used by the phone
`application can be stored in either device, although it is
`preferred that acquaintance contact data and the like be
`stored in the handheld computer system so that it may be
`accessible by the user even when the cellular telephone
`transceiver peripheral 150 is coupled to the handheld com-
`puter system 100.
`Integrated Handheld Computer and Wireless Communica-
`tion Devices
`To reduce the numberof devices that a user needsto carry
`around, a numberof integrated handheld computer systems
`and cellular
`telephones have recently been introduced.
`FIGS. 3A and 3B illustrate one embodimentof an integrated
`handheld computer and cellular telephone system 300. The
`
`Page 19 of 29
`
`Page 19 of 29
`
`

`

`US 7,007,239 B1
`
`6
`5
`With the advent of more sophisticated combined handheld
`integrated handheld computer and cellular telephone system
`computer and cellular telephone systems,
`the telephone
`300 includes a keyboard 330 such that the user may easily
`dialing aids can become muchbetter. The present invention
`enter names, addresses, phone numbers, and email messages
`introduces telephone directory methods for quickly and
`into application programs running on the integrated hand-
`intuitively allowing the user of a combined handheld com-
`held computer and cellular telephone system 300.
`puter and cellular telephone system to locate and dial the
`FIG. 3C illustrates one possible embodiment for a key-
`telephone number of a desired. Specifically,
`the present
`board that may be used in the handheld computer and
`invention provides a telephone application having a user
`cellular telephone system 300 of FIGS. 3A and 3B. The
`interface that gives a user multiple different views of infor-
`keyboard of FIG. 3C includes an option key that is used to
`mation that allow a user to make telephonecalls in a simple
`generate secondary characters from the various keys. For
`intuitive manner.
`example, the “E” key 361 normally generates an “E” char-
`invention
`The telephone user interface of the present
`acter. But if the “E” key 361 is pressed while simultaneously
`holding the option key 301, then the “$” character will be
`comprises four permanently available views andafifth view
`generated.
`that is available when there is an active incoming or outgo-
`The keyboard of FIG. 3C also includes a digit dial pad
`ing telephone call. The five different views consist of: a
`area 391. The digit dial pad area 391 is laid out like a
`speed dial view, a dial pad view, a contacts view, a call
`conventional touch-tone telephone dial pad. In this manner,
`history view, and an active call view. FIG. 4 illustrates a
`a user may dial
`telephone numbers using the familiar
`conceptual diagram of the telephone application 401. As
`mechanical touch-tone telephone dial pad. Note that the
`illustrated in FIG. 4, the telephone application 401 consists
`digit dial pad area 391 uses the same Keys used for various
`of a set of principal telephone interface views 405 that
`letters. To explicitly generate a number, a user should press
`include the dial pad view 410, call history view 420, speed
`dial view 430, contacts view 440, and active call view 450.
`the option key 301 in order to generate a numerical digit
`from the keys in the digit dial pad area 391. However, the
`In a preferred embodiment, certain events will cause the
`software in the handheld computer and cellular telephone
`telephone application to automatically switch between dif-
`system 300 may interpret any key press in the digit dial pad
`ferent views. For example, when an incomingtelephonecall
`area 391 as a numerical digit in certain contexts whether or
`is detected,
`the telephone application will automatically
`switch to the active call user interface view in order to show
`not the option key 301 is depressed. For example,if the user
`is entering a telephone numberin a telephone numberinput
`field of a contact record, any key press from the digit dial
`pad area 391 will be interpreted as a numerical digit whether
`or not the option key 301 is depressed.
`In an alternate integrated handheld computer and cellular
`telephone embodiment(not shown), the alternate integrated
`handheld computer and cellular telephone system lacks the
`keyboard 330 of FIG. 3A. In such an embodiment, the user
`enters text and numerical information using a stylus as set
`forth in the handheld computer system of FIGS. 1A and 2.
`Telephone Terminal User Interfaces
`It has been found that cellular telephone users are very
`dependent upon “speed dial” features in their cellular tele-
`phones. A typical cellular telephone has a non-volatile
`memory for storing the names and associated telephone
`numbers for a plurality of the user’s acquaintances. The
`telephone speed dial user interface then allows the user to
`place a telephonecall to one of the stored telephone numbers
`relatively quickly and easily.
`Existing mobile telephone speed dial systems can operate
`in a variety of ways. One such speed dial system allows the
`user to associate a telephone number with a unique one or
`two digit code. The user can then dial
`the number by
`entering the one or two digit code followed by the “SEND”
`key to place the speed dial call. Other systemsallow a single
`digit speed dial numberto be dialed by pressing and holding
`the associated digit key. In order for this system to be
`effective, the user must memorize the codes associated with
`the telephone numbers.
`Another existing speed dial system allows the user to
`utilize letters associated with keys on the telephone keypad
`to spell out the name of the person associated with a stored
`telephone number. This can be a tedious process since
`typically three or four letters are assigned to each button on
`the telephone keypad, which necessitates several key presses
`for each of the letters in the name spelt. Once names have
`been entered, the names may be displayed on the telephone
`screen. The user may then use an input device to scroll up
`and downthelist to select a desired name and thereby dial
`the associated telephone number. With a long list of names,
`it becomes very cumbersometo scroll through the list.
`
`The dial pad user interface view 410 provides a conven-
`tional DIMF (Dual Tone Multiple Frequency) touch tone
`dial pad interface to users such that users may make outgo-
`ing telephone calls with a familiar interface. FIG. 5A illus-
`trates one embodiment of the dial pad view. Although the
`dial pad user interface view is probably the most familiar
`telephone application view to new users, the dial pad user
`interface view is probably the least efficient of the various
`different telephone application user interface views. In one
`embodiment, the dial pad user interface view is set up as the
`initial user interface view for the telephone application in the
`handheld computer and cellular telephone system since most
`users will be very familiar with the dial pad user interface
`view. However, the user may later select another view for
`moreefficient telephone numberdialing.
`When a user is in the dial pad user interface view, a user
`can touch the touch-tone buttons presented on the screen as
`illustrated in FIG. 5A to dial a telephone number. Pressing
`the telephone icon will send the entered digits to the cellular
`telephone networkto initiate a telephone call.
`The dial pad view of FIG. 5A may be invoked even when
`there is an active telephonecall. In this manner, the dial pad
`view may be used to enter DTMFtouch-tones in order to
`access interactive telephone response system such as a
`voicemail system or a telephone banking system.
`
`the user information about the incoming telephonecall.
`Another event that may cause the telephone application to
`automatically switch between different viewsis the entry of
`characters from an input device such as a keyboard orstylus
`and digitizer pad.
`In one embodiment,
`the entry of an
`alphabetic character will cause the telephone application to
`move to the contacts user interface view that is used to
`
`information. The
`search a database of personal contact
`contact user interface view will then begin tofilter through
`the contact database using the entered character(s) as a
`search string. Similarly, the entry of a digit may cause the
`telephone application to automatically switch to the dial pad
`user interface view. Additional information on the various
`automatic user interface view switches can be found in the
`sections on each different interface view.
`Dial Pad View
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`Page 20 of 29
`
`Page 20 of 29
`
`

`

`US 7,007,239 B1
`
`7
`In one embodiment, when a user begins entering a tele-
`phone number, the telephone numberbeing dialed is placed
`in the title bar 590. The user may also access the last ten
`dialed telephone numbers by scrolling up or down.
`Specifically, hitting the scroll up or down key will move
`through the last ten numbers dialed and individually display
`each numberin thetitle bar area 590.
`
`In the lower left corner of the dial pad view illustrated in
`FIG. 5A,the user interface includes four buttons for access-
`ing the four permanently available user interface views.
`Specifically, the buttons include a speed dial view button
`510, a dial pad view button 520, a contacts view button 530,
`and a call history view button 540. Note that the dial pad
`view button 520 is shown highlighted by inverted graphic
`colors since the dial pad view is the current active view. To
`select any of the other telephone application user interface
`views, the user merely selects the associated view button
`510, 530, or 540. The user may also repeatedly press an
`application button associated with the telephone application
`to rotate through the various telephone application user
`interface views (including the active call view if there is an
`active call.).
`As previously set forth, a fifth user interface view is
`available when there is an active telephone call. FIG. 5B
`illustrates a fifth user interface view button known as the
`active call view button 550 used to access an active call user
`interface view (that will be described later). Active call view
`button 550 is only available when there is an active tele-
`phonecall.
`If the handheld computer and cellular telephone embodi-
`mentincludes a keyboard 330 as illustrated in FIG. 3A,then
`the user may dial a telephone number using the keyboard
`330. If the keyboard contains keys that may be interpreted
`as a letter or a digit, as is the case with the dial pad area 391
`of the keyboard illustrated in FIG. 3C, then the keystrokes
`entered from the keys in the dial pad area 391 of the
`keyboard will be interpreted as numbers whenin the dial pad
`view in the preferred embodiment. Letter keystrokes will be
`ignored.
`In an alternate embodiment, the dial pad user interface
`view is used to provide the user with an easy means of
`entering telephone numbers that use letter mnemonics. For
`example, 1-800-FLOWERSis a floral service that uses the
`letter mnemonic 1-800-FLOWERSin order to have poten-
`tial customers easily rememberthe contact telephone num-
`ber. However, dialing a telephone numbers with letter mne-
`monics can be quite difficult since the user must search the
`telephone dial pad in order to locate the DTMFkey with the
`desiredletter. In order to allow the user to quickly enter such
`telephone numbers, one embodimentallowsthe user to enter
`the letters directly and the computer will translate theletters
`into the proper associated DTMFtones. For example, if the
`text for “FLOWERS?”were entered, the DTMF tones asso-
`ciated with dial pad numbers “3549377” would be gener-
`ated. (See the alphabet to DTMF key mappingillustrated in
`FIGS. 5A and 5B.)
`Certain aliasing may occur in such an alternate embodi-
`ment. However, an intelligent program could use certain
`heuristics to determine the desire number in most circum-
`
`stances. For example, if the user wereto dial the full number
`“1800FLOWERS” without using the option key 301 to
`specify the “1800” portion as numbers, the system would not
`knowif the first four digits should be numbers (“1800”) or
`letters that should be translated into associated DTMF tones
`(“YNOO” equivalent to dial pad numbers “9400”). But a
`heuristic could be used to always translate the “YNOO”
`patter into the common 1800 prefix for eleven digit numbers.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`8
`The “FLOWERS?”portion would easily be recognized as a
`letter mnemonic in an embodimentthat uses the keyboard of
`FIG. 3C since none ofthe letters in “FLOWERS”is on the
`
`same key as a number. However, the letter mnemonic of
`“LAWYERS”is ambiguous since the letter “Y” and the
`number“1” are on the same key on the keyboard of FIG. 3C.
`In such circumstances, the system could use the heuristic
`that “All ambiguous letter/number keystrokes located
`between twocertainly letter keystrokes s