Declaration of Jacob Robert Munford
`
`IPR2020-00408
`Apple EX1009 Page 1
`
`

`

`
`
`
`
`
`
`
`1. My name is Jacob Robert Munford. I am over the age of 18, have personal
`
`knowledge of the facts set forth herein, and am competent to testify to the
`
`same.
`
`2. I earned a Master of Library and Information Science (MLIS) from the
`
`University of Wisconsin-Milwaukee in 2009. I have over ten years of
`
`experience in the library/information science field. Beginning in 2004, I
`
`have served in various positions in the public library sector including
`
`Assistant Librarian, Youth Services Librarian and Library Director. I have
`
`attached my Curriculum Vitae as Appendix A.
`
`3. During my career in the library profession, I have been responsible for
`
`materials acquisition for multiple libraries. In that position, I have cataloged,
`
`purchased and processed incoming library works. That includes purchasing
`
`materials directly from vendors, recording publishing data from the material
`
`in question, creating detailed material records for library catalogs and
`
`physically preparing that material for circulation. In addition to my
`
`experience in acquisitions, I was also responsible for analyzing large
`
`collections of library materials, tailoring library records for optimal catalog
`
`IPR2020-00408
`Apple EX1009 Page 2
`
`

`

`search performance and creating lending agreements between libraries
`
`during my time as a Library Director.
`
`
`
`4. I am fully familiar with the catalog record creation process in the library
`
`sector. In preparing a material for public availability, a library catalog record
`
`describing that material would be created. These records are typically
`
`written in Machine Readable Catalog (herein referred to as “MARC”) code
`
`and contain information such as a physical description of the material,
`
`metadata from the material’s publisher, and date of library acquisition. In
`
`particular, the 008 field of the MARC record is reserved for denoting the
`
`date of creation of the library record itself. As this typically occurs during
`
`the process of preparing materials for public access, it is my experience that
`
`an item’s MARC record indicates the date of an item’s public availability.
`
`
`5. I have reviewed Exhibit 1005, “Cyberguide: A mobile context-aware tour
`
`guide” by Gregory D. Abowd, Christopher G. Atkeson, Jason Hong, Sue
`
`Long, Rob Kooper and Mike Pinkerton (hereto referred to as ‘Abowd’) as
`
`presented in Wireless Networks October 1997.
`
`
`6. Attached hereto as Appendix AB01 is a true and correct copy of the cover,
`
`spine, title page, table of contents and complete ‘Abowd’ from Wireless
`
`IPR2020-00408
`Apple EX1009 Page 3
`
`

`

`Networks October 1997 held by the University of Pittsburgh. I secured this
`
`appendix myself in person. In comparing AB01 to Exhibit 1005, it is my
`
`determination that Exhibit 1005 is a true and correct copy of ‘Abowd’.
`
`
`7. Attached hereto as Appendix AB02 is a true and correct copy of the MARC
`
`record describing Wireless Networks as held by the University of Pittsburgh.
`
`I secured this record myself from the library’s online catalog. The 008 field
`
`of this MARC record indicates Wireless Networks was first cataloged by the
`
`University of Pittsburgh as of April 3, 1995. The ‘Holdings Information’
`
`field on page 2 of the library record indicates this journal was held by this
`
`library in perpetuity from 1996 - 2003. This date range indicates the library’s
`
`collection includes the October 1997 publication of IEEE Communications
`
`Magazine containing “Abowd”. The book bindery sticker on page 25 of
`
`AB02 indicates multiple volumes of Wireless Networks owned by the
`
`University of Pittsburgh spanning 1996-1997 were sent off to a book bindery
`
`sometime during January - March 1998.
`
`
`
`8. Attached hereto as Appendix AB03 is a true and correct copy of complete
`
`‘Abowd’ from Wireless Networks October 1997 held by Carnegie Mellon
`
`University as ‘p421-abowd.pdf’. I secured this appendix myself in person. In
`
`IPR2020-00408
`Apple EX1009 Page 4
`
`

`

`comparing AB03 to Exhibit 1005, it is my determination that Exhibit 1005 is
`
`a true and correct copy of ‘Abowd’.
`
`
`9. Attached hereto as Appendix AB04 is a true and correct copy of the MARC
`
`record describing Wireless Networks as held by Carnegie Mellon University.
`
`I secured this record myself from the library’s online catalog. The 008 field
`
`of this MARC record indicates Wireless Networks was first cataloged by the
`
`Carnegie Mellon University as of January 22, 1999. The ‘Holdings
`
`Information’ field on page 3 of the library record indicates this journal has
`
`been held by this library in perpetuity since 1999. This date range indicates
`
`the library’s collection includes the entirety of IEEE Communications
`
`Magazine via ACM Digital Library, including the October 1997 edition
`
`containing “Abowd”.
`
`
`10. Considering the MARC record data of each library in concert with the book
`
`bindery sicker, it is my determination that the October 1997 edition of
`
`Wireless Networks was made available and accessible to the public by the
`
`University of Pittsburgh shortly after initial publication and certainly no later
`
`than March 1998. Based on journal availability, it is my determination that
`
`‘Abowd’ was made available and accessible to the public in October 1997
`
`shortly after initial publication via Wireless Networks October 1997.
`
`IPR2020-00408
`Apple EX1009 Page 5
`
`

`

`
`11. I have reviewed Exhibit 1038, “A Collaborative Wearable System with
`
`Remote Sensing” by Martin Bauer, Timo Heiber, Gerd Kortuem and Zary
`
`Segall (hereto referred to as ‘Bauer’) as presented in The Second
`
`International Symposium on Wearable Computers (1998).
`
`
`12. Attached hereto as Appendix BA01 is a true and correct copy of the cover,
`
`spine, title page, table of contents and complete ‘Bauer’ from The Second
`
`International Symposium on Wearable Computers as held by Carnegie
`
`Mellon University. I secured this appendix myself in person. In comparing
`
`BA01 to Exhibit 1038, it is my determination that Exhibit 1038 is a true and
`
`correct copy of ‘Bauer’.
`
`
`13. Attached hereto as Appendix BA02 is a true and correct copy of the MARC
`
`record describing The Second International Symposium on Wearable
`
`Computers as held by Carnegie Mellon University. I secured this record
`
`myself from the library’s online catalog. The 008 field of this MARC record
`
`indicates The Second International Symposium on Wearable Computers was
`
`first cataloged by Carnegie Mellon University as of August 5, 1998. This
`
`date is prior to the date of the Symposium itself and therefore it is my
`
`determination that CMU cataloged this copy in advance of the formal
`
`IPR2020-00408
`Apple EX1009 Page 6
`
`

`

`publication of the material for the purpose of releasing the material
`
`expediently upon the date of formal release. In my experience as a cataloger,
`
`this is a common practice for time-sensitive materials. Considering this
`
`information, it is also my determination that Carnegie Mellon University
`
`made ‘Bauer’ available to the public shortly after the dates of the
`
`symposium, October 19-20, 1998.
`
`
`14. I have been retained on behalf of the Petitioner to provide assistance in the
`
`above-illustrated matter in establishing the authenticity and public
`
`availability of the documents discussed in this declaration. I am being
`
`compensated for my services in this matter at the rate of $100.00 per hour
`
`plus reasonable expenses. My statements are objective, and my
`
`compensation does not depend on the outcome of this matter.
`
`
`
`15. I declare under penalty of perjury that the foregoing is true and correct. I
`
`hereby declare that all statements made herein of my own knowledge are
`
`true and that all statements made on information and belief are believed to
`
`be true; and further that these statements were made the knowledge that
`
`willful false statements and the like so made are punishable by fine or
`
`imprisonment, or both, under Section 1001 of Title 18 of the United States
`
`Code.
`
`IPR2020-00408
`Apple EX1009 Page 7
`
`

`

`
`
`Dated: 12/19/19
`
`
`
`Jacob Robert Munford
`
`
`
`
`
`
`
`IPR2020-00408
`Apple EX1009 Page 8
`
`

`

`
`
`
`
`Appendix A
`Appendix A
`
`|PR2020-00408
`
`Apple EX1009 Page 9
`
`IPR2020-00408
`Apple EX1009 Page 9
`
`

`

`Appendix A - Curriculum Vitae
`
`Education
`
`University of Wisconsin-Milwaukee - MS, Library & Information Science, 2009
`Milwaukee, WI
`● Coursework included cataloging, metadata, data analysis, library systems,
`management strategies and collection development.
`● Specialized in library advocacy and management.
`
`
`Grand Valley State University - BA, English Language & Literature, 2008
`Allendale, MI
`● Coursework included linguistics, documentation and literary analysis.
`● Minor in political science with a focus in local-level economics and
`government.
`
`
`Professional Experience
`
`Researcher / Expert Witness, October 2017 – present
`Freelance
`Pittsburgh, Pennsylvania
`● Material authentication and public accessibility determination. Declarations
`of authenticity and/or public accessibility provided upon research
`completion. Depositions provided on request.
`● Research provided on topics of public library operations, material
`publication history, digital database services and legacy web resources.
`● Past clients include Apple, Fish & Richardson, Erise IP, Baker Botts and
`other firms working in patent law.
`
`
`
`Library Director, February 2013 - March 2015
`Dowagiac District Library
`Dowagiac, Michigan
`● Executive administrator of the Dowagiac District Library. Located in
`Southwest Michigan, this library has a service area of 13,000, an annual
`
`IPR2020-00408
`Apple EX1009 Page 10
`
`

`

`operating budget of over $400,000 and total assets of approximately
`$1,300,000.
`● Developed careful budgeting guidelines to produce a 15% surplus during the
`2013-2014 & 2014-2015 fiscal years.
`● Using this budget surplus, oversaw significant library investments including
`the purchase of property for a future building site, demolition of existing
`buildings and building renovation projects on the current facility.
`● Led the organization and digitization of the library's archival records.
`● Served as the public representative for the library, developing business
`relationships with local school, museum and tribal government entities.
`● Developed an objective-based analysis system for measuring library services
`- including a full collection analysis of the library's 50,000+ circulating
`items and their records.
`
`
`
`November 2010 - January 2013
`Librarian & Branch Manager, Anchorage Public Library
`Anchorage, Alaska
`● Headed the 2013 Anchorage Reads community reading campaign including
`event planning, staging public performances and creating marketing
`materials for mass distribution.
`● Co-led the social media department of the library's marketing team, drafting
`social media guidelines, creating original content and instituting long-term
`planning via content calendars.
`● Developed business relationships with The Boys & Girls Club, Anchorage
`School District and the US Army to establish summer reading programs for
`children.
`
`
`June 2004 - September 2005, September 2006 - October 2013
`Library Assistant, Hart Area Public Library
`Hart, MI
`● Responsible for verifying imported MARC records and original MARC
`cataloging for the local-level collection as well as the Michigan Electronic
`Library.
`● Handled OCLC Worldcat interlibrary loan requests & fulfillment via
`ongoing communication with lending libraries.
`
`IPR2020-00408
`Apple EX1009 Page 11
`
`

`

`
`Professional Involvement
`
`Alaska Library Association - Anchorage Chapter
`● Treasurer, 2012
`
`
`Library Of Michigan
`● Level VII Certification, 2008
`● Level II Certification, 2013
`
`
`Michigan Library Association Annual Conference 2014
`● New Directors Conference Panel Member
`
`
`Southwest Michigan Library Cooperative
`● Represented the Dowagiac District Library, 2013-2015
`
`
`
`Professional Development
`
`Library Of Michigan Beginning Workshop, May 2008
`Petoskey, MI
`● Received training in cataloging, local history, collection management,
`children’s literacy and reference service.
`
`
`Public Library Association Intensive Library Management Training, October 2011
`Nashville, TN
`● Attended a five-day workshop focused on strategic planning, staff
`management, statistical analysis, collections and cataloging theory.
`
`
`Alaska Library Association Annual Conference 2012 - Fairbanks, February 2012
`Fairbanks, AK
`● Attended seminars on EBSCO advanced search methods, budgeting,
`cataloging, database usage and marketing.
`
`IPR2020-00408
`Apple EX1009 Page 12
`
`

`

`
`
`
`
`Appendix AB01
`Appendix AB01
`
`|PR2020-00408
`
`Apple EX1009 Page 13
`
`IPR2020-00408
`Apple EX1009 Page 13
`
`

`

`
`
`iiliggfiIt;In.‘Itrig-Ill:
`
`IPR2020-00408
`Apple EX1009 Page 14
`
`

`

`WIRELESS
`
`NETWORKS
`
`|PR2020-00408
`
`Apple EX1009 Page 15
`
`IPR2020-00408
`Apple EX1009 Page 15
`
`

`

`R12-M06-S13-T08
`31 735044251 662
`11111111!11111111111111111111111111111!111111111111111111111111
`Hillman Gr.Fl.
`Requestlbz448721
`Pun Date: 2818/11/18 15:59
`Can Nod
`htlezwveless networks
`
`\M
`
`UNFORD,JRCOB R
`ULScrtsyB
`2L9682886416188
`Req. Date: 2619/11/18 13:67:24
`
`\
`
`
`
`
`
`
`
`IPR2020-00408
`Apple EX1009 Page 16
`
`

`

`
`
`
`
`Advances
`
`7-:«n nnn ;
`11’} ‘W llClUbb
`Networking
`
`
`
`Luigi Fratta - Biswanath Mukherjee
`
`0000000000000
`
`IPR2020-00408
`Apple EX1009 Page 17
`
`

`

`Baltzer Science Publishers, Amsterdam. The Netherlands
`
`Wireless Networks. The journal of mobile communication, computation and information. ISSN 1022-0038
`
`Advances in Wireless Networking
`
`(9 J.C. Baltzer AG (I997)
`All rights reserved. No part of this publication may be reproduced. stored in u retriet’0! system or transmitted in un_\‘fnnn or
`by any means. electronic. mechanical. photocopying. reconiing or otherwise. without the prior permission of the publisher:
`
`
`
`|PR2020-00408
`
`Apple EX1009 Page 18
`
`IPR2020-00408
`Apple EX1009 Page 18
`
`

`

`Contents
`
`obile power management for wireless communication networks
`_,.M. Rulnick and N. Bambos
`
`‘ ew call blocking versus handoff blocking in cellular networks
`‘_
`. Sidi and D. Stambinski
`
`- On optimal call admission control in cellular networks
`5!. Ramjee. D. Towsley and R. Nagarajan
`
`Slotted ALOHA and CDPA: A comparison of channel access performance in cellular systems
`5": Borgonom and M. Zorzi
`
`Delay analysis for forward signaling channels in wireless cellular network
`=1. Rubin and C. 0101'
`
`A new model for scheduling packet radio networks
`A. Sen and ML Huson
`
`Unified power control. error correction coding and scheduling for a CDMA downlink system
`Y! Lu and R. Brodersen
`
`Using channel state dependent packet scheduling to improve TCP throughput over wireless LANs
`P. Bhagwat. P. Bhattaclmrya. A. Krishna and SK. Tripathi
`
`IS
`
`29
`
`43
`
`53
`
`71
`
`83
`
`9|
`
`
`
`|PR2020-00408
`
`Apple EX1009 Page 19
`
`
`
`IPR2020-00408
`Apple EX1009 Page 19
`
`

`

`Wireless Networks 3 (I997)
`
`Contents
`
`Transmission policies and traffic management in multimedia wireless networks
`A. Barrel]. H.P. Stern and P. Papunmni-Ix’uzukus
`
`Slow shadowing and macrodivcrsily in the Capture-Division Packet Access (CDPA)
`E Bur‘gmtmw, M. ZUI‘Zi and L. Fl‘tlllu
`
`ASK digital demodulation scheme for noise immune infrared data communication
`H. Una. K. Kunmmni. H. ()kuhum. I. Shim/(mm and T. Chilm
`
`Optical interference produced by artificial light
`A..I.C. Mureiru. R.T. Vulmlux and AM. (’6’ ()Iit't'iru Duane
`
`lnitial estimation of communication efficiency of indoor wireless channels
`0.]. Fast-him and RA. Vulcnawlu
`
`Hybrid diversity combining techniques for DS-CDMA over a multipath fading channel
`MA. Do and S.Y. Wu
`
`Ensemble polling strategies for increased paging capacity in mobile communication
`networks
`
`C. Rose and R. Yates
`
`|03
`
`l l3
`
`I'll
`
`[3|
`
`l4l
`
`l55
`
`l59
`
`
`
`|PR2020-00408
`
`Apple EX1009 Page 20_7AA
`
`
`
`IPR2020-00408
`Apple EX1009 Page 20
`
`

`

`Wireless Networks 3 (1997)
`
`Contents
`
`Cumulated interference power and bit-error—rates in mobile packet radio
`M. Hellebrandt and R. Mathar
`A simplified approach to the performance evaluation of FDMA-CDMA systems
`G. Immovilli. M.L. Merani and M.K. Shahin
`Network architecture and traffic transport for integrated wireless communications over
`enterprise networks
`H.C.B. Chan. V.C.M. Leung and R.W. Donaldson
`
`Paging strategy optimization in personal communication systems
`A. Abutaleb and V.0.K. Li
`
`Location update optimization in personal communication systems
`A. Abutaleb and V.0.K. Li
`Performance modeling of asynchronous data transfer methods of lEEE 802.1] MAC
`protocol
`H.S. Chhaya and S. Gupta
`
`Escrow techniques for mobile sales and inventory applications
`N. Krishnakumar and R. Jain
`
`
`
`169
`
`173
`
`[8|
`
`195
`
`205
`
`2l7
`
`235
`
`
`
`|PR2020-00408
`
`Apple EX1009 Page 21
`
`IPR2020-00408
`Apple EX1009 Page 21
`
`

`

`Wireless Networks 3 (I997)
`
`Contents
`
`247
`
`249
`
`257
`
`267
`
`285
`
`29|
`
`299
`
`Editorial
`
`‘
`
`Design and control of micro—cellular networks with QOS provisioning for data traffic
`M. Nughshineh um! A.S. Acumpnm
`
`A rate-based overload control method for the radio channel in PCN
`NJ. Pus'xus and LE Merukns
`
`.
`
`A control and management network for wireless ATM systems
`SJ". Bush. S. Jugmzm‘uh. R. Sanchez. .I.b‘. Evans, V.S. Frost. GJ. Mimlen and
`KS. Slmnn-mgun
`
`Error correction and error detection techniques for wireless ATM systems
`S. Aikmt'a. Y. Mumyumu and M. Umelu'ru
`
`PHS terminating call control
`S. Suzuki. T. [ham and Y. Sltikulu
`
`Satellite-PCS channel simulation in mobile user environments using photogrammetry
`and Markov chains
`H.-P. Lin. R. Akmran and WJ. Vogel
`
`
`
`
`
`|PR2020-00408
`
`Apple EX1009 Page 22
`
`IPR2020-00408
`Apple EX1009 Page 22
`
`

`

`Wireless Networks 3 (1997)
`
`Editorial
`
`Scheduling techniques for reducing processor energy use in MacOS
`J.R. Lurch and A]. Smith
`
`Spectrum sharing under the asynchronous UPCS etiquette: The performance of collocated
`systems under heavy load
`I. Vukovic and J. McKown
`
`A dynamic load balancing strategy for channel assignment using selective borrowing in
`cellular mobile environment
`
`S.K. Das, S.K. Sen and R. Jayaram
`
`Dependency sequences and hierarchical clocks: Efficient alternatives to vector clocks for
`mobile computing systems
`R. Prakash and M. Singhal
`
`Efficient and flexible location management techniques for wireless communication
`svstems
`
`J. Jannink. D. Lam. N. Shivakumar. .I. Widom and D. C. Cox
`
`Low-loss TCP/1P header compression for wireless networks
`M. Degennark, M. Engan. B. Nordgren and S. Pink
`
`TCP extensions for space communications
`RC. Durst, 0.]. Miller and EJ. Travis
`
`Building reliable mobile-aware applications using the Rover toolkit
`AD. Joseph and MF. Kaashoek
`
`Cyberguide: A mobile context-aware tour guide
`GD. Abowd, CG. Atkeson, J. Hang, S. Long, R. Kooper and M. Pinkerton
`
`309
`
`3] l
`
`325
`
`333
`
`349
`
`361
`
`375
`
`389
`
`405
`
`42!
`
`if
`
`|PR2020-00408
`
`Apple EX1009 Page 23
`
`IPR2020-00408
`Apple EX1009 Page 23
`
`

`

`,;;";‘~ r « 30997)
`
`Contents
`
`l; iological aspects of mobile communication fields
`.31.CLin
`
`3" lood-brain barrier permeability in rats exposed to electromagnetic fields used in wireless communication
`',R.R. Persson, LG. Salford and A. Brun
`
`
`
`
`.rain tumour development in rats exposed to electromagnetic fields used in wireless cellular communication
`f T G. Salford, A. Em» and B.R.R. Persson
`
`i altrexone blocks RFR-induced DNA double strand breaks in rat brain cells
`'. ‘. Lai, M. Carina and N. Singh
`
`Enhancement of the interaction between low-intensity R.F. e.m. fields and ligand binding due to cell basal
`metabolism
`
`
`
`
`
`
`B. Bianca, A. Chiabrera. E. Moggia and 7? Tommasi
`
`Amplitude modulated RF fields stemming from a GSM/DCS-ISOO phone
`GE Pedersefi
`
`.Evaluation of electromagnetic power deposition in a spherical multilayer head in the near field of a linear antenna
`”G. Cerri. R. De Leo and G. Rosellini
`
`Assessment of the potential risk for humans exposed to millimeter-wave wireless LANs: the power absorbed in the
`‘eye
`
`‘1’. Bemardi, M. Cavagnaro and S. Pisa
`
`Author index
`
`
`
`|PR2020-00408
`
`Apple EX1009 Page 24
`
`435
`
`439
`
`455
`
`463
`
`471
`
`477
`
`.500V:
`
`499
`
`511
`
`519
`
`IPR2020-00408
`Apple EX1009 Page 24
`
`

`

`Wireless Networks 3 (1997) 421—433
`
`Cyberguide: A mobile context—aware tour guide
`
`Gregory D. Abowd 3, Christopher G. Atkeson “. Jason l-long“, Sue Long “'b. Rob Koopera and Mike Pinkertonn
`” Graphics. Wruulizution and Usability Centre. College of Computing. Georgia Institute of Technology. Atlanta. GA 30332-0280.USA
`h Wink Communications. Alameda. CA 9450]. USA
`
`
`
`Future computing environments will free the user from the constraints of the desktop. Applications for a mobile environment should
`take advantage of contextual information. such as position. to offer greater services to the user.
`In this paper. we present the Cyberguide
`project. in which we are building prototypes of a mobile context-aware tour guide. Knowledge of the user's current location. as well as a
`history of past locations, are used to provide more of the kind of services that we come to expect from a real tour guide. We describe the
`architecture and features of a variety of Cyberguide prototypes developed for indoor and outdoor use on a number of different hand-held
`platforms. We also discuss the general research issues that have emerged in our context-aware applications development in a mobile
`environment.
`
`1. Introduction
`
`Future computing environments promise to free the user
`from the constraints of stationary desktop computing, yet
`relatively few researchers are investigating what applica-
`tions maximally benefit from mobility. Current use of mo-
`bile technology shows a slow evolution from our current
`desktop paradigm of computing. but the history of inter-
`action shows that the adoption of new technology usually
`brings about a radical revolution in the way humans use
`and view technology [1 1]. Whereas the effective use of
`mobile technology will give rise to an interaction para-
`digm shift, it is difficult to predict what that shift will be.
`We follow the advice of Alan Kay, therefore. and choose
`to predict the future by inventing it. Our approach is to
`think first about what activities could be best supported
`by mobile technology and then determine how the tech-
`nology would have to work. This applications focus is
`important to distinguishing our work in mobile comput-
`mg.
`
`In April 1995, we formed the Future Computing Envi—
`ronments (FCE) Group within the College of Computing
`and the Graphics. Visualization and Usability (GVU Cen-
`ter) at Georgia Tech to promote such an applications focus.
`Our group is committed to the rapid prototyping of appli-
`cations that benefit from the use of emerging mobile and
`ubiquitous computing technologies. Quick development of
`these futuristic applications allows us to predict and shape
`what our everyday lives will be like when today’s novel
`technology becomes commonplace.
`Applications for a mobile environment should take ad-
`vantage of contextual information. such as position. to of-
`fer greater services to the user.
`In this paper. we present
`the Cyberguide project. a series of prototypes of a mobile,
`hand-held context-aware tour guide. Initially, we are con-
`cerned with only a small part of the user‘s context, specif~
`ically location and orientation. Knowledge of the user‘s
`current location. as well as a history of past locations, are
`used to provide more of the kind of services that we come
`
`© .l.C. Baltzer AG. Science Publishers
`
`to expect from a real tour guide. We describe the archi-
`tecture and features of a variety of Cyberguide prototypes
`
`developed for indoor and outdoor use on a number of dif-
`ferent hand-held platforms. We also discuss the general
`research issues that have emerged in our experience of de-
`
`veloping context-aware applications in a mobile environ-
`ment. Some of these research issues overlap with those
`
`that we have considered in applying other applications of
`ubiquitous computing technology.
`The general application domain which has driven the
`development of Cyberguide is tourism, but we have found
`it necessary to be even more focused in our research. The
`initial prototypes of Cyberguide. therefore. were designed
`to assist a very specific kind of tourist — a visitor in a tour
`of the GVU Center Lab during our monthly open houses.
`Visitors to a GVU open house are typically given a map
`of the various labs and an information packet describing
`all of the projects that are being demonstrated at various
`sites. Moving all of the paper-based information into a
`hand-held, position-aware unit provided a testbed for re-
`search questions on mobile. context-aware application de-
`velopment.
`The long-term goal is an application that knows where
`the tourist is, what she is looking at, can predict and answer
`questions she might pose. and provide the ability to inter-
`act with other people and the environment. Our short-tenn
`goal was to prototype versions of Cyberguide on commer-
`cially available PDAs and pen-based PCs in which context-
`awareness simply meant the current physical position and
`orientation of the Cyberguide unit (and since it is hand-held.
`this locates the user as well). Position information improves
`
`the utility of a tour guide application. As the prototypes of
`Cyberguide evolve, we have been able to handle more of
`the user’s context. such as where she and others have been,
`and we have increased the amount in which the tourist can
`
`interact and communicate with the place and people she is
`visiting.
`
`|PR2020-00408
`
`Apple EX1009 Page 25
`
`IPR2020-00408
`Apple EX1009 Page 25
`
`

`

`
`422
`0.0. Abowd et al. / Cyberguide: A mobile context-aware tour guide
`
`1.]. Overview
`
`This paper is an extended version of an earlier report on
`Cyberguide [7], we discuss the evolution of the Cyberguide
`design and prototype as well as what future research areas
`our experience has uncovered. We begin in section 2 by
`describing scenarios for the use of context~aware mobile
`applications.
`In section 3, we provide context for our re—
`search within the area of applications-centered mobile com-
`puting. The generic architecture of Cyberguide is explained
`in section 4. We will describe in section 5 the initial re-
`
`alization of the generic components of the Cyberguide ar-
`chitecture. a series of prototypes developed for the Apple
`MessagePad. We will then describe in section 6 how the
`initial
`indoor prototypes were extended for use outdoors
`and for greater interaction with the environment. We con-
`clude in sections 7 and 8 with a discussion of significant
`issues for context-aware applications development and how
`our past experience will influence our future development
`plans.
`
`2. Scenarios for a mobile context-aware application
`
`This section outlines some possible uses for future mo-
`bile context-aware applications. Some of these uses are
`currently being implemented and some are futuristic. We
`begin with our initial assumptions about what technology
`we expect Cyberguide to use. Tourists are usually quite
`happy to carry around a book that describes the location
`they are visiting. so a reasonable packaging would be in
`the form of a hand—held device. The ideal hand—held de-
`
`vice will have a screen and pen/finger interface. access to
`substantial storage resources — possibly through an internal
`device such as a CD drive, or through substantial commu-
`nication and networking resources (cell phone, pager, data
`radio interface) providing access to other storage servers
`(such as the Web) — an audio input and output interface
`with speech generation and potentially sophisticated voice
`recognition. and a video input and output interface. The
`video input (a video camera) could be pointed at the user
`to interpret user gestures, or pointed at the environment to
`interpret objects or symbols in the environment. The video
`output could be integrated into the main screen or be a sep-
`arate video display device, such as an attached screen or
`heads up display on glasses worn by the user.
`One major application of mobile context-aware devices
`are personal guides. Museums could provide these devices
`and allow users to take personalized tours seeing any ex-
`hibits desired in any order, in contrast to today’s taped tours.
`In fact. many museums now provide portable devices for
`just such a purpose. but what we are envisioning is a device
`that would allow the tourist to go anywhere she pleases and
`be able to receive information about anywhere she is. Walk—
`ing tours of cities or historical sites could be assisted by
`these electronic guidebooks. The hand-held devices could
`use position measurement systems such as indoor beacons
`
`or the Global Positioning System (GPS) to locate the user,
`and an electronic compass or inertial navigation system to
`find user orientation. Objects of interest could be marked
`with visual markers or active beacons or recognized us~
`ing computer vision. Some objects. such as animals at
`a zoo or aquarium. might be difficult to mark but could
`be recognized with simple computer vision and some as-
`sistance from the environment (indications that this is the
`
`elephant cage, for example). The personal guide could also
`assist in route planning and providing directions. Some of
`these functions are currently being provided by automobile
`on-board navigation systems.
`There are other ways to assist users. Consider a traveler
`in Japan that does not speak or read Japanese. The hand-
`held device could act as a pocket multilingual dictionary,
`actually speaking the appropriate phrase with the appro-
`priate pronunciation to a taxi driver. for example (or even
`showing the appropriate Kanji and an associated map on
`the screen). A device that included video input or a scan-
`ner could assist in reading signs or menus. A device that
`could show stored images might be able to show a shop-
`keeper the desired object or favorite meal. Another more
`futuristic use is to assist the user by recognizing faces at a
`cocktail party and reminding the user who people are.
`Real-time communication allows a personal device to
`act as an agent for the user. A personal guide to a theme
`park could make reservations at particular rides. and alert
`the user when the reservation was available. The device
`could also tell the user which rides had the shortest lines.
`
`Similar approaches are currently being used for automobile
`traffic management in major cities.
`An important application of context-aware devices is en—
`hanced reality. A heads up display could provide “X-ray"
`vision for the user. While surveying a building for renova-
`tion, the location of hidden plumbing or electrical conduits
`could be indicated to the user. based on information from
`
`sensors and/or building plans. At an archeological site a
`visitor could be provided with various overlays indicating
`what used to be above the current ground level as well as
`what is below the current ground level.
`Context-aware devices can also be used as tools. Simple
`sonar devices are used to make room measurements today.
`It would not take much to have a hand—held device that
`
`both videotaped and mapped a room along with user com-
`mentary. An ecological field study or an archeological dig
`could be assisted by a device that automatically recorded
`the context of a particular find. including noting the sur-
`rounding objects. Consider an electronic field guide that
`assisted the user in recognizing plants or insects.
`One of the most interesting applications of context-aware
`devices is to support group interaction on a tour or in a
`classroom. for example. Participants in a live demonstra-
`tion of some new technology could use their personal device
`to help steer the demo using majority voting or consensus
`among the viewers. Each participant could run a person-
`alized version of the same demo by expressing their own
`choices.
`In this case context is which demo a participant
`
`|PR2020-00408
`le EX1009 P
`
`IPR2020-00408
`Apple EX1009 Page 26
`
`

`

`G.D. Abowd er al. / Cyberguide: A mobile context-aware tour guide
`
`423
`
`is participating in or attending to. and the personal ma-
`chine may switch to another context if it detects the user is
`attending to that context instead.
`Many tourists take records of some sort of their travel-
`ling experiences. either by taking pictures or videos or by
`composing a travel diary.
`Imagine the possibilities if the
`recording of these experiences could be more efficiently
`and accurately recorded. A drive across the country could
`result in a trail superimposed upon a map. and clicking on
`the trail would reveal an image of what you could see at
`that moment — an automatically-generated spatial index into
`your memories.
`These are but a few of the possibilities we can imagine
`that a context-aware application can provide for the tourist.
`We have