(12)
`
`United States Patent
`Schnarel et al.
`
`(10) Patent N0.:
`(45) Date of Patent:
`
`US 7,225,409 B1
`May 29, 2007
`
`US007225409B1
`
`(54) GRAPHICAL USER INTERFACE FOR A
`SCREEN TELEPHONE
`(75) Inventors: Charles P. Schnarel, Woodinville, WA
`(Us); Mauricio Lomelin, Redmond’
`WA (US); Peter G. Chin, Seattle, WA
`(US); Derek S. Graham, Seattle, WA
`(US); Kate Welker, San Francisco, CA
`(US); Robert C. Murdock, Oakland,
`CA (U S); Suzanne Walsh, San
`
`
`
`Francisco, Oakland, CA (US); Laurence Golding, JllStlIl COOPGI‘,
`
`Fremont, CA (US)
`(73) Assignee: Microsoft Corporation, Redmond, WA
`(Us)
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U~S~C- 15403) by 0 days-
`(21) App1_ No; 09/383,038
`
`( * ) Notice:
`
`(22) Filed;
`
`Aug 25, 1999
`
`Related US. Application Data
`(60) Provisional application No. 60/098,187, ?led on Aug.
`26, 1998, provisional application No. 60/122,975,
`?led on Mar. 3, 1999.
`
`(51) Int. Cl.
`H04M 1/56
`(2006.01)
`(52) as. C]. ..................................... .. 715/747; 715/751
`(58) Field of Classi?cation Search .............. .. 345/752
`345/755 753 75 4 756 757 758 759 715’
`3 4 5 /808l809’ 719L720’ 734L736’ 771L773’
`3 4 5 H78 779*780’ 786*787’ 7 4 4*7 47’ 173*176’
`34’5/863 86
`707/10’ 513_ 379’ 000*201’
`379/142'01 14235 1’42'17 20103? 710/302i304f
`709628 331 ’217 20’2 203 2’27 218i 715 /7 4 4*7 47’
`’
`’ 71’5/77ii77é 74éi74é 802 80 4 805’
`See application ?le for com’plete searéh history.’
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`7/1996 Pinard et a1.
`5,533,110 A
`4/1997 Goodwin et a1. ........... .. 710/62
`5,619,684 A *
`8/1997 Haddock et a1~
`5,657,378 A
`5,689,708 A * 11/1997 Regnier et a1. ........... .. 709/229
`5,724,412 A
`3/1993 SfiIliV?S?Il
`
`_
`(Commued)
`
`W0
`
`WO 96/02409
`
`1/ 1996
`
`OTHER PUBLICATIONS
`
`CIDCO and Sun Announce LicensingAgreement Intended to Create
`New Consumer Internet Appliances Based on JavaOS for Consum
`ersTM Software, Sun Press Releases, Apr. 13, 1998, http://WWW.sun.
`com/java0s/c0nsumers/press498.htrnl printed from the Internet
`Feb. 16, 1999.
`
`(Continued)
`
`_
`_
`Prlmary Exammeristeven P Sax
`(57)
`ABSTRACT
`
`_
`_
`A graphlcal 11?“ Interface for ?‘ Web ‘61913119116 andether
`telephony devlces Brow?“ a umque Combmanon of dlsplay
`elements that provlde 1nformat1on and enable the user to
`access funct1onal1ty of the dev1ce. The dlsplay elements
`lnclude customlzab'le screen areas called panes, an apphca
`t1on program selectlon area, and call state area for d1splay1ng
`telephone l1ne status 1nformat1on. A software platform ofthe
`user 1nterface provldes a'set of default user interface features
`and exposes an appl1cat1on programmlng ~1nterface. System
`lmplementers may customlze the default dlsplay elements or
`create entirely neW custom panes that ?t Within a uniform
`user interface framework using the application program
`ming interface.
`
`5,455,854 A 10/1995 Dilts et a1.
`
`41 Claims, 7 Drawing Sheets
`
`Wednesday 12/31/98
`1oo\
`IMPLEMENTER, INC.
`12:00 PM
`102,45 M
`Speed dial
`@)
`
`I
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`E
`
`
`
`Och") . .
`
`. .
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`. ..
`
`I
`
`I
`
`I
`
`I
`
`I
`
`I
`
`I
`
`I
`
`I @ Take a note
`
`()Kate .
`
`,
`
`,
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`,
`
`.
`
`.
`
`.
`
`. @ E
`
`W (m Use directory service
`104»; """""""
`"""""" "
`) (The Web)-_(Messages)' semrrge
`we»; 1 @ Check the line!
`H
`Checkthe ?ne,
`
`'''''' I.
`
`LG Exhibit 1003, Page 1
`LG Electronics, Inc. v. Core Wireless Licensing S.A.R.L.
`
`

`
`US 7,225,409 B1
`Page 2
`
`US. PATENT DOCUMENTS
`
`5/1998 Bayless et a1.
`5,754,636 A
`8/1998 Kikinis et al.
`5,799,068 A
`9/1998 Stone ....................... .. 709/227
`5,802,304 A
`5,850,433 A * 12/1998 Rondeau
`379/21801
`5,877,695 A *
`3/1999 Kubes et al. ..
`340/815.4
`5,974,468 A 10/1999 Taylor et al.
`6,009,469 A 12/1999 Mattaway et al.
`6,014,137 A *
`1/2000 Burns .................... .. 345/747
`6,035,019 A
`3/2000 Hara
`6,049,334 A *
`4/2000 Bates et al. ............... .. 345/744
`6,091,808 A
`7/2000 Wood et al.
`6,134,017 A 10/2000 Schlank et al.
`6,151,620 A * 11/2000 Madsen et al. ........... .. 709/204
`6,178,432 B1
`1/2001 Cook et al.
`6,192,118 B1* 2/2001 Bayless et a1.
`6,208,879 B1 *
`3/2001 Iwata et al. ............... .. 345/864
`6,268,924 B1* 7/2001 Koppolu et al. ..
`358/1.13
`6,331,864 B1* 12/2001 Coco et al. ........ ..
`345/763
`6,334,157 B1* 12/2001 Oppermann et al. ...... .. 719/310
`6,389,124 B1 *
`5/2002 Schnarel et al. ..... .. 379/142.01
`6,429,882 B1 *
`8/2002 Abdelnur et al. ......... .. 345/763
`6,469,713 B2 * 10/2002 Hetherington et al.
`345/740
`6,496,202 B1* 12/2002 PrinZing ......... ..
`345/762
`6,496,578 B1* 12/2002 Chen et al.
`379/21102
`
`6,504,555 B1* 1/2003 Slupe et al. . . . . . .
`. . . . . .. 345/762
`6,516,202 B1* 2/2003 Hawkins et al. ....... .. 455/5562
`6,611,878 B2* 8/2003 De Armas et al.
`719/328
`6,675,204 B2* 1/2004 De Boor et al. ..
`709/217
`6,678,365 B1* 1/2004 Kinoshita
`.. 379/201.01
`6,711,645 B1* 3/2004 Chari et al. ............... .. 710/302
`6,735,208 B1
`5/2004 Riemann et al.
`6,975,712 B1* 12/2005 Schnarel et a1. ..... .. 379/14201
`2006/0015819 A1* 1/2006 Hawkins et al. .......... .. 715/780
`
`OTHER PUBLICATIONS
`
`Telephones & Equipment, CST 2100 Corded Screenphone, http://
`www.swbell.com/ printed from the Internet Feb. 10, 1999.
`AT &T Personal Communications Center User Guide, Graphics ©
`AT&T 1995.
`Teleport, Teleport 33.6 Speakerphone Edition User ’s Guide, Global
`Village Communication, 1144 East Arques Ave, Sunnyvale, CA
`94086, 1996.
`CIDCO iPhone Screen Phone, http://www.cidco.com/iphone/
`intro2.html printed from the Internet Feb. 10, 1999.
`One Touch TM Alcatel Internet Screenphone, http://www.alcatel.
`com/telecom/mbd/products/products/detailed/term/otouch.htm
`printed from the Internet Feb. 16, 1999.
`Technical Specs, Alcatel Internet Screenphone, http://www.alcatel.
`com/telecom/mbd/products/products/detailed/term/techhtm,
`printed from the Internet Feb. 16, 1999.
`Alcatel’s Internet Screenphone Based on Sun ’s PersonalJava TM
`and JavaOS for Consumers TM Wins CeBIT Oscar Best Communi
`cations Product 1998, http://www.sun.com/javaos/consumers/
`oscar98.html printed from the Internet Feb. 16, 1999.
`“Uniden’s Axis Telephone Terminal,” p. 1-2, http://www.uniden.
`com/au.
`“Alternative Web Access Via TV and Telephone,” p. 1-4, http://
`pimall.com/nais/n.ephon.html.
`“This is the Cordless Version of Your Mother’s Email Machine,” p.
`1-2, http://www.telephone-guys.com/axis2.htm.
`“Powertouch 350 Kit Charcole Speci?cation,” p. 1, http://wwwgy.
`com/spec/uxaj .htm.
`“Northern Telecom PowerTouch 350,” p. 1-2, http://www.com
`msourcecom/ntpt350.html.
`
`“BellSouth Telephone Products,” p. 1-3, http://www.bellsouth.com/
`blsc/maestro.html, 1997.
`“PowerTouch,” p. 1, http://ltlcs.gtecom/power.htm.
`“PowerTouch Speci?cations,” p. 1-3, http://ltlcsgtecom/ptspec.
`htrn.
`“PowerTouch Phones,” p. 1, http://widts.gtecom/Shopping/pwrtch.
`htm, 1999.
`“Press Releases Archive, Jan. 9, 1997,” p. 1-2, http://www.news.
`philips.com/archief/199701092.html, Jan. 9, 1997.
`“Tek Discount Warehouse,” p. 1-2, http://www.discountwarehouse
`com/tekgallery/norpow350.html.
`Teleport 33.6 Speakerphone Edition, User’s Guide, pp. I-105,
`Global Village Communication, Inc. 1996.
`CIDCO iPhone- Introduction, p. 1, http://www.cidco.com/iphone/
`intro2.html, visited on Feb. 10, 1999.
`CIDCO iPhone- Introduction, p. 1, http://www.cidco.com/iphone/
`intro2.html, visited on Feb. 10, 1999.
`Alcatel Telecom- Technical Specs, p. 1-2, http://www.alcatel.com/
`telecom/mbd/products/products/detailed/term/tech.htrn, visited on
`Feb. 16, 1999.
`Alcatel’s Internet Screenphone Based on Sun’s PersonalJavaTM and
`JavaOS for ConsumersTM Wins CeBIT Oscar Best Communications
`Product 1998, p.
`1-2, http://www.sun.com/javaos/consumers/
`oscar98.html, visited on Feb. 16, 1999.
`CIDCO and Sun Announce Licensing Agreement Intended to Create
`New Consumer Internet Appliances Based on JavaOS for Consum
`ersTM Software, p. 1-4, http://www.sun.com/javaos/consumers/
`press4.98.html, visited on Feb. 16, 1999.
`Southwestern Bell Catalog, p. 1-2, http://www.swbell.com/, visited
`on Feb. 10, 1999.
`Frazier, “Plug-in for Graphics Apps Adds Power to Special Effects,”
`Government Computer News, vol. 16, No. 26, pp. 36-37, Sep. 1,
`1997.
`Amadio, “Phone Ahead: A New Breed of High-Tech Telephones
`Makes Doing Business Easier Than Ever,” Entrepreneur, vol. 25,
`No. 12, pp. 56-58, Nov. 1997.
`“Cool Stu?C ’98,” Computerworld, vol. 31, No. 51, pp. 62-67, Dec.
`22, 1997.
`Rupley, “Feed Your E-mail Addiction,” PC Magazine, vol. 16, No.
`2, p. 10, Jan. 21, 1997.
`“Uniden Spins Axis E-mail Telephone,” PC Week, vol. 13, No. 45,
`p. 47, Nov. 11, 1996.
`Bowles et al., “US West Brings Display-Based Telephony to Resi
`dential Customers with Nortel System,” Telecommunications, vol.
`30, No. 3, p. 82, Mar. 1996.
`Kopf, “Perking Consumer Internet Use: Are Java-Powered Screen
`Phones the Answer?” America's Network, vol. 100, No. 12, pp.
`108-110, Jun. 15, 1996.
`Davey, Nortel Dialing Up Web Phones, PC Week, vol. 13, No. 21,
`p. 10, May 27, 1996.
`Getting Results with Microsoft Oj?ce 97, Microsoft Corporation, pp.
`113-126 and 348-352, 1997.
`“OL97: How to Add an Address to Your Contacts Folder from an
`E-mail Message,” http://support.microsoft.com/support/kb/articles/
`Q258/6/17.ASP?LN:EN-US&SD:gn&FR:0&, p. 1, 2001.
`Doan, “Add-ins Give Outlook a Boost,” InfoWorld, vol. 19, No. 32,
`p. 26, Aug. 11, 1997.
`“Outlook Frequently Asked Questions,” http://www.usi.edu/
`usihelp/outhelp/cntctfaq.htm, pp. 1-3, last modi?ed Mar. 1, 1999.
`“Sun Microsystems: JavaBeansTM,” Version 1.01, Graham
`Hamilton (Ed), Sun Microsystems Inc., pp. 1-114, Jul. 24, 1997.
`
`* cited by examiner
`
`LG Exhibit 1003, Page 2
`LG Electronics, Inc. v. Core Wireless Licensing S.A.R.L.
`
`

`
`U.S. Patent
`
`May 29, 2007
`
`Sheet 1 0f 7
`
`US 7,225,409 B1
`
`
`
`@259 $828;
`
`AJ
`
`
`
`n0 0 ..................... ..,_@0
`
`J E Md E . . . . . . . . . . . . . .. BmxO
`
`@ =ms¢ 25> wgmwwgg 2% @z . . . . . . . . .>EE=, O
`
`
`
`
`
` J E md . . . . . . . . . . . . . . . . 12200 Row 5% 83m h $3822; TIN?
`
`
`
`
`
`
`
`A wmc?ow V nwmmmwmosw A325 05V A mwv?ww< vow
`
`LG Exhibit 1003, Page 3
`LG Electronics, Inc. v. Core Wireless Licensing S.A.R.L.
`
`

`
`U.S. Patent
`
`May 29, 2007
`
`Sheet 2 0f 7
`
`US 7,225,409 B1
`
`8%
`
`SE comm?
`
`@ =80 25> m
`@ Eu 26% m
`® 8.23 E2026 3: k m
`
`
`mmv 20c m oxmk m
`
`k
`, M
`
`J m
`
`x n
`
`J W
`
`2
`
`Q My ................ 1260
`
`m®©®mm®€ $2 @2 . . . . . . . . . >EE=, Q
`
`
`
`A wmEzww V mmwmmmmmso Anm>> mcPV mmwxmhumé
`
`
`
`
`@9505 x0050 @ _
`
`
`00
`
`
`
`.2: 228.6 @
`
`LG Exhibit 1003, Page 4
`LG Electronics, Inc. v. Core Wireless Licensing S.A.R.L.
`
`

`
`U.S. Patent
`
`May 29, 2007
`
`Sheet 3 0f 7
`
`US 7,225,409 B1
`
`302
`
`3
`
`310
`
`
`
`\g . . . . . . . . . . . . . . . . . . . . . . ../ . . . . . . . _ . . . . . . . . _ _ _ . _ . . _ . _ _ . . . . . . . E M
`
`
`
`I
`
`=_..[_.i$??9?i .% ..............................
`:
`
`312
`K
`
`
`
`
`
`
`
`308 5 f; @Jimmy - Chris . . . -
`
`
`
`
`
`
`
`. -
`
`
`
`. -
`
`
`
`. -
`
`
`
`. -
`
`
`
`_ -
`
`-
`
`-
`
`
`
`. -
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`. . . . . - [N10 mw nmssams . . l2’
`
`3045
`
`
`
`E ochip . .
`
`§
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`. .. Q?
`
`320
`
`
`
`/ 3 06' -------------------------------------------- --\ ------------- - (@QMGIT LQg I ) (volcemail (
`
`
`326
`328
`
`FIG. 4
`
`/
`
`400
`
`\
`
`402
`
`LG Exhibit 1003, Page 5
`LG Electronics, Inc. v. Core Wireless Licensing S.A.R.L.
`
`

`
`U.S. Patent
`
`May 29, 2007
`
`Sheet 4 0f 7
`
`US 7,225,409 B1
`
`FHG, 5
`( Messages for: (Q [@ )
`JBEIWFZEWWOMW
`
`Tylor Garland
`
`(415)283-1618
`
`Today11:42 AM 00:30
`
`Steve Gordon
`502 \@
`Debra Coelho
`
`278-4968
`
`Today11z50 AM 00:53
`
`(425)215-6897
`
`Today11z54AM 00:12
`
`Kate Walker
`
`(614)695-3598
`
`12/19/9711:00 PM 00:41
`
`59:01 :
`:
`EXT, !
`500 I
`i
`*1-
`|
`Franklyn Hogarthe r
`'
`'
`41 4 2- 171
`|
`(
`6 9
`Add contact]‘[ Move
`Callback ]]
`l
`Button B @
`l
`l
`
`12/19/9712z47 PM 00:24
`
`@l
`
`’
`
`Connected
`
`
`
`- ( Edit Contact > ( 2-way memo) _ _ _ _ _ ..l
`
`Connected
`General Information
`
`Franklyn Hogarthe
`(415)462-9171
`
`I
`|
`|
`:
`
`LG Exhibit 1003, Page 6
`LG Electronics, Inc. v. Core Wireless Licensing S.A.R.L.
`
`

`
`U.S. Patent
`
`May 29, 2007
`
`Sheet 5 0f 7
`
`US 7,225,409 B1
`
`o
`Operator Agent
`E \4
`Telephony Container
`gw
`Voice Transport
`3
`§\ Other Transport (FAX v-mail)
`RrI \.
`E-mail Transport
`N N
`Q \_|_
`Answering Machine
`00 : Settings 3
`I Settings 2
`2 _/1 Settings 1
`8+ ?x 3rd Party Apphcatlon
`
`_ _ _ _ _ — _ _ _ _ _ _ _ _ _ '1
`
`1|
`:
`l
`
`N
`
`Q
`
`Settings
`
`.
`
`.
`
`3 S
`I\
`|\
`/
`/
`
`O
`
`2
`g
`
`._
`
`E
`
`S\_
`
`N
`
`N
`Ex
`
`o
`K \_
`
`Help
`
`Internet
`Browser
`
`> 5
`U,
`c
`o
`C
`'5-
`"3
`g ‘g
`
`Address Book
`
`_
`E
`
`U 0
`g
`
`(\l
`
`r- — — — — — — — — — — -1
`
`(D
`
`E
`
`3* Telco Add-on
`o |
`E“- OEM Add-on
`00 I
`§\L
`
`Built-in
`
`| Q6
`i
`m
`| = g
`I m m
`| 0E ‘\
`
`co ,4 _ _ _ _ _ _ _ _ _ ___.1
`
`.
`E 10
`2\ Fax V|ewer
`
`w h
`
`;<_
`
`g2
`<1-
`.
`% 5
`N Q\ E-mall Veiwer
`(D f)‘,
`Answering Machine 2
`E I\\
`Viewer
`
`'
`
`O
`
`708
`
`744 r 706
`
`LG Exhibit 1003, Page 7
`LG Electronics, Inc. v. Core Wireless Licensing S.A.R.L.
`
`

`
`LG Exhibit 1003, Page 8
`LG Electronics, Inc. v. Core Wireless Licensing S.A.R.L.
`
`

`
`LG Exhibit 1003, Page 9
`LG Electronics, Inc. v. Core Wireless Licensing S.A.R.L.
`
`

`
`US 7,225 ,409 B1
`
`1
`GRAPHICAL USER INTERFACE FOR A
`SCREEN TELEPHONE
`
`RELATED APPLICATION DATA
`
`This patent application claims priority to US. provisional
`patent application No. 60/098,187, ?led Aug. 26, 1998, and
`US. provisional patent application No. 60/122,975, ?led
`Mar. 3, 1999, which are hereby incorporated by reference.
`
`FIELD OF THE INVENTION
`
`The invention relates to telephony systems, and more
`particularly, relates to graphical user interfaces and software
`architectures for telephony devices.
`
`BACKGROUND OF THE INVENTION
`
`Today’s telephony devices are becoming increasingly
`more sophisticated. A driving force of this trend is the
`convergence of functionality typically found in computers
`with functionality found in conventional telephones. One
`signi?cant example of the convergence of phones and com
`puters is a class of devices called smart screen phones.
`Though the speci?c hardware con?guration of these devices
`varies widely, they typically share common elements such as
`a screen display, hardware buttons, telephone line interface
`hardware and a processor. Despite the advanced features that
`many of these devices provide, there is still need for
`improvement in many areas.
`First, some screen phones available today have a small
`text-based display, typically arranged in a matrix of charac
`ters, and hardware buttons around the screen that are asso
`ciated with speci?c screen areas to create virtual or soft
`buttons. This allows new functions to be programmed into
`the buttons over time, or as a result of navigating through
`menu choices with the buttons. Usability testing and
`research have shown that the mapping of a physical button
`and the on-screen text is often confusing and hard to follow.
`Another problem is that traditional enhanced telephony
`services are di?icult to use (such as call forwarding) because
`they require the user to remember arbitrary sequences of
`key-presses, and remember sequences of operations without
`explicit feedback (feedback tones or clicks).
`An additional problem with the screen phone industry is
`the lack of an extendable, ?exible software architecture that
`allows others to build a rich array of functions and appli
`cation programs. Screen phones tend to be highly special
`iZed devices constructed with special hardware and software
`to support a set of features. As such, they are di?icult to
`customiZe or extend to support new features.
`This lack of ?exibility is particularly problematic in view
`of the lack of uniformity in the telephone networkiwhere
`infrastructure components vary from region to region, coun
`try to country, and service provider to service provider. Each
`area may provide Caller ID, but supply it using different
`technologies, or supply Call Forwarding, but use different
`access codes.
`The problems associated with architectural ?exibility
`extend beyond the challenges raised by differences in the
`central o?ice switching, hardware, and con?guration. The
`underlying telecommunication network infrastructure is
`changing as well, and telephony devices must be adaptable
`to these infrastructures. For example, the telephone archi
`tecture should support choices between conventional infra
`structures such as PSTN and ISDN. Looking to the future,
`the use of the Internet Protocol may become more common
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`place as a telephone network infrastructure, and thus, there
`is a need to make telephony architectures readily adaptable
`to a variety of network infrastructures.
`
`SUMMARY
`
`The invention provides a user interface and related tele
`phony program architecture for telephony devices. While
`aspects of the invention are particularly well suited for
`telephones with screen displays (e.g., screen phones), they
`apply to other telephony devices as well such as modems,
`answering machines and personal digital assistants.
`One aspect of the invention is a visual user interface for
`a telephony device. The visual user interface includes a
`display screen with a variety of display elements for dis
`playing information, receiving user input, or both. The
`visual interface may include various combinations of the
`following display elements: an application program selec
`tion area, a call slip area, a branding pane, a date/time pane
`for displaying date or time, a message pane, and a task pane
`for enabling the user to initiate a task in the telephony
`device.
`The application program selection area provides a display
`of user interface controls that enable a user to select an
`application program, such as a web browser, address book,
`or answering machine/e-mail message retrieval application.
`In one implementation, the selection area is a button bar with
`control buttons that the user may select to initiate application
`programs or device features visually identi?ed by the but
`tons.
`The call slip area provides a call slip user interface for
`displaying telephone line state information. Call slips
`present a user interface for telephony applications. They
`have display elements that respond to changes in the phone
`line state by displaying user interface controls and informa
`tion dependent on that state.
`The branding pane displays a brand graphic. This feature
`allows an implementer of the telephony device to customiZe
`the interface for its product by displaying a brand bitmap, for
`example.
`The message pane displays answering machine, e-mail or
`fax messages for one or more users. The message pane, in
`one implementation, is the visual representation of an appli
`cation program for managing user messages created or
`received in the telephony device.
`The task pane enables a user to initiate tasks executed in
`the telephony device directly by actuating a user interface
`control within the pane. These tasks may include, for
`example, a speed dial service, a service for composing an
`e-mail, a service for recording a note, or an on-line directory
`service.
`Another aspect of the invention relates to the program
`ming modules that control the display of the user interface
`for a screen phone. These modules include a shell program
`that controls the display of a user interface on a display
`screen of the phone, and pane programs that each control the
`display of a display element called a “pane” in the user
`interface. Default pane programs control the display of
`information and/or user interface controls in their respective
`panes. One or more of these panes may be associated with
`a parent application program that communicates state
`changes to a pane program, which in turn, updates the
`display to re?ect these state changes.
`One example of a default pane program is a message pane
`program that displays an indicator of user messages received
`in the phone. A parent application program noti?es the
`message pane program when state changes occur, such as the
`
`LG Exhibit 1003, Page 10
`LG Electronics, Inc. v. Core Wireless Licensing S.A.R.L.
`
`

`
`US 7,225 ,409 B1
`
`3
`arrival of a fax, e-mail or answering machine message. The
`message pane displays an indicator of the type of message
`that has arrived in the pane. For example, in one implemen
`tation, it displays a graphical icon representing fax, e-mail or
`answering machine message. The user can select the icon to
`access a viewer program for displaying and accessing the
`message.
`Another aspect of the invention is a method for develop
`ing a user interface for a screen phone. The software
`platform for the user interface of the screen phone is
`distributed to implementers of the screen phone, e.g., equip
`ment manufactures, telephone companies, etc. This platform
`includes program modules that provide some default user
`interface elements and programming interfaces. The imple
`menter may customiZe the user interface by modifying a
`default user interface element or by creating custom pro
`gram modules. The custom program modules may imple
`ment programming interfaces de?ned in the software plat
`form, and may interact with default program modules
`through their programming interfaces.
`In one implementation, an implementer receives a soft
`ware platform, including a shell program and default pane
`programs. The shell program is responsible for displaying
`the user interface on the display screen of the phone. Each
`of the default pane programs display default panes in the
`user interface. The user may customiZe the user interface by
`selecting the default panes and creating custom panes.
`Further features of the invention will become apparent
`with reference to the following detailed description and
`accompanying drawings.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 illustrates an example of a graphical user interface
`for a screen phone.
`FIG. 2 shows the default panes in the user interface of
`FIG. 1 enclosed in dashed lines.
`FIG. 3 illustrates a default pane in the user interface of
`FIG. 1 called the “messages pane.”
`FIG. 4 illustrates an example of two user interface control
`states that depict the presence or absence of messages of a
`particular type.
`FIG. 5 illustrates an example of a user interface display
`element called a “call slip.”
`FIG. 6 illustrates a call slip display element in more detail.
`FIG. 7 is a block diagram illustrating the application level
`software architecture in a software platform that implements
`the invention.
`FIG. 8 is a block diagram illustrating the application level
`telephony components in the software platform of FIG. 7.
`FIG. 9 is a block diagram of a screen phone that may
`utiliZe the graphical user interface of FIG. 1.
`
`DETAILED DESCRIPTION
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`1.0 Introduction
`The invention is implemented in a software platform for
`a category of products referred to as “Web Telephones.” A
`60
`Web Telephone integrates voice telephony, Internet access
`including e-mail and Web browsing, an answering machine,
`and possibly other communications media such as fax and
`voice mail, into a single device. While this platform is
`designed for web telephones it also applies to a variety of
`telephony devices, including virtually any device that has
`access to a telephone network line (cable modem, ISDN,
`
`65
`
`4
`DSL, wireless, plain old telephone line, packet switched
`networks or Wide Area Networks that support telephone
`calls such as the Internet).
`The software platform provides a fully functional user
`interface, and application programs, and also exposes pro
`gramming interfaces and customiZable features that allow
`others to modify its software components and user interface
`as well as add new software applications. The current
`implementation of the software platform interfaces with the
`Windows® CE Operating System, a subset of the Telephony
`Application Programming Interface (TAPI) and device driv
`ers. Building on these components, it further provides a
`shell, application-level telephony applications, integrated
`application programs such as e-mail, address book, web
`browser, and a message center.
`2.0 Home Page Graphical User Interface
`The invention is implemented as a “start” or “home”
`screen of a telephony device. The terms “start” or “home”
`refer to a graphical user interface displayed on the device’s
`display screen that provides a starting point for accessing
`features of the telephony device. This user interface also
`provides a place that the user returns to after ?nishing some
`task. For example, the user may access a feature of the
`device such as composing an e-mail, reviewing a message
`(e.g., answering machine, fax or e-mail message), browsing
`the Internet, or making a telephone call. The user initiates
`these tasks from the start screen, and these tasks display their
`own screens that partially or fully occlude the start screen.
`When the user completes a task, the display returns to the
`start screen. To be consistent throughout the remainder of
`the description, we refer to this user interface as the “start”
`screen.
`FIG. 1 illustrates an example of the start screen (100). The
`start screen is composed of the following display elements:
`1) a pane(s) area (102); 2) an application selection area (104)
`called the application button bar; and a call slip area (106).
`The panes area (102) is a portion of the display screen that
`may be divided into multiple display elements called panes.
`The software architecture de?nes programming interfaces
`that allow the system implementer to provide custom panes
`that can be incorporated into the software platform of the
`telephony device. These programming interfaces allow the
`implementer to supply a custom pane that displays itself
`within the start screen and that interacts with other software
`components in the platform. The current implementation
`includes a default set of panes. These default panes may be
`modi?ed or replaced with custom panes.
`The application selection area (104) displays user inter
`face controls that enable the user to launch an application
`program via an input device such as a touch screen or other
`cursor control device such as a mouse, trackball, joystick,
`etc. The implementation shown in FIG. 1 has a scrolling
`application button bar located beneath the panes area. The
`user interface controls are selectable buttons.
`The call slip area (106) displays user interface elements
`called call slips (e.g., display elements (108, 110)). In the
`current implementation, the user interface displays a call slip
`for each telephone line in the device. It displays call state
`information associated with the telephone line. For more
`information about the call slip interface, see co-pending
`patent application Ser. No. 09/383,039 entitled “A COM
`MON VISUAL AND FUNCTIONAL ARCHITECTURE
`FOR PRESENTING AND CONTROLLING ARBITRARY
`TELEPHONE LINE FEATURES” ?led concurrently here
`with by Charles P. Schnarel, Maurcio Lomelin, Peter G.
`Chin, Derek S. Graham, Kate Welker, Robert C. Murdock,
`
`LG Exhibit 1003, Page 11
`LG Electronics, Inc. v. Core Wireless Licensing S.A.R.L.
`
`

`
`US 7,225 ,409 B1
`
`5
`Justin C. Cooper, Laurence Golding, and Suzanne Walsh,
`Which is hereby incorporated by reference.
`Having provided an overvieW of the start screen, We noW
`provide additional information about each of the display
`elements in the current implementation.
`
`2.1 Panes Area
`Apane is a display element of an application program on
`the start screen (100). A pane displays itself as a child
`WindoW of the start screen. Each pane appears as a rectilin
`ear portion of the pane area on the start screen. HoWever, the
`shape, number and size of the panes may vary.
`The pane area is designed to alloW customization of the
`start screen. A system implementer can create one or more
`custom panes and place these panes in the pane area. In
`addition, the implementer may use one or more default
`panes in combination With its custom panes.
`2.1.1 Default Panes
`FIG. 2 illustrates an example of the default panes in the
`current implementation. These include a branding pane
`(202), a date and time pane (204), a message pane (206), and
`a task pane (208). While the system implementer may use
`these default panes Without modi?cation, they also alloW
`some level of customization. In particular, the implementer
`may reposition the panes Within the pane area, and may
`resize and localize each default pane.
`2.1.2 The Branding Pane
`The branding pane (202) alloWs the implementer to
`supply a graphic, Which the start screen displays in a
`designated portion of the display. For example, an imple
`menter may Want to establish brand identity by displaying a
`graphic of its brand name, logo or trademark. The graphic
`may be provided in the form of a bitmap. The branding pane
`acts as a URL hyperlink to alloW the user to access the
`implementer’ s Webpage. When the user presses the branding
`pane, it displays a text message, such as “Would you like to
`connect to the Internet to learn more about this product?”
`This text message is displayed along With yes/no/cancel
`buttons. If the user selects “yes”, the pane launches the
`broWser and establishes a modem connection With the
`Internet Service Provider, Whose telephone number is stored
`in the device’s memory.
`2.1.3 The Date and Time Pane
`The data and time ?elds display the data and time,
`respectively. These ?elds initiate pre-programmed actions
`When the user selects them. In particular, the ?elds launch a
`settings application program that prompts the user to edit the
`date and time in response to user selection of the data and
`time ?elds.
`2.1.4 The Task Area
`The task area is a portion of the display that enables the
`user to access features of the device quickly. The task pane
`(208) shoWn in FIG. 2 illustrates default buttons that launch
`the folloWing program tasks in response to user selection: 1)
`speed dialing, 2) Writing an e-mail, 3) taking a note, and 4)
`using an on-line directory service. When the user selects one
`of these buttons, the softWare platform launches the task
`associated With the button.
`The system implementer may customize the task pane by
`removing one or more default buttons;
`adding a custom task button that can launch an application
`and pass a command line to perform a speci?c function
`Within a particular application;
`organize the buttons in any order; or
`localize any of the default buttons.
`The default buttons provide examples of the type of
`functionality that may be implemented in the task pane.
`
`20
`
`25
`
`30
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`When the user selects the speed dial button, it opens another
`screen representing the user interface of the speed dial
`feature. This screen enables the user to instruct the device to
`dial a party’s phone number by selecting the name of that
`party on the screen.
`The Write e-mail button enables the user to access a user
`interface screen for composing an e-mail. The behavior of
`the Write-e-mail button depends on Whether an Internet
`e-mail account is already established. If an account is
`established, the e-mail button procedure launches a task for
`composing an e-mail message, Which in turn displays a user
`interface for composing the message. If not, the button
`procedure invokes a task and its associated user interface for
`setting up an e-mail account. In cases Where the device
`currently has tWo or more accounts, the button procedure
`prompts the user to enter his/her name to identify the
`appropriate account to be used.
`When the user selects the Take a note button, its procedure
`launches an application for composing a note, Which in turn,
`displays in interface for composing the note.
`When the user selects the Use On-line Directory button,
`its button procedure launches a Web broWser application
`program, Which displays its user interface and proceeds to
`establish an Internet connection and doWnload a Directory
`Web page using a URL associated With the button.
`
`2.2 Messages Pane
`The messages pane is a portion of the start screen dedi
`cated to displaying the names of the user accounts estab
`lished in the device, as Well as the presence of user-speci?c
`messages (such as ansWering machine messages and e-mail
`messages) and general-user messages (such as faxes, caller
`logs, and voice mail messages.) Users can quickly discover
`Whether or not they have neW messages and