Declaration of Jacob Robert Munford
`
`IPR2020-00409
`Apple EX1009 Page 1
`
`

`

`
`
`
`
`
`
`
`1. My name is Jacob Robert Munford. I am over the age of 18, have personal
`
`knowledge of the facts set forth herein, and am competent to testify to the
`
`same.
`
`2. I earned a Master of Library and Information Science (MLIS) from the
`
`University of Wisconsin-Milwaukee in 2009. I have over ten years of
`
`experience in the library/information science field. Beginning in 2004, I
`
`have served in various positions in the public library sector including
`
`Assistant Librarian, Youth Services Librarian and Library Director. I have
`
`attached my Curriculum Vitae as Appendix A.
`
`3. During my career in the library profession, I have been responsible for
`
`materials acquisition for multiple libraries. In that position, I have cataloged,
`
`purchased and processed incoming library works. That includes purchasing
`
`materials directly from vendors, recording publishing data from the material
`
`in question, creating detailed material records for library catalogs and
`
`physically preparing that material for circulation. In addition to my
`
`experience in acquisitions, I was also responsible for analyzing large
`
`collections of library materials, tailoring library records for optimal catalog
`
`IPR2020-00409
`Apple EX1009 Page 2
`
`

`

`search performance and creating lending agreements between libraries
`
`during my time as a Library Director.
`
`
`
`4. I am fully familiar with the catalog record creation process in the library
`
`sector. In preparing a material for public availability, a library catalog record
`
`describing that material would be created. These records are typically
`
`written in Machine Readable Catalog (herein referred to as “MARC”) code
`
`and contain information such as a physical description of the material,
`
`metadata from the material’s publisher, and date of library acquisition. In
`
`particular, the 008 field of the MARC record is reserved for denoting the
`
`date of creation of the library record itself. As this typically occurs during
`
`the process of preparing materials for public access, it is my experience that
`
`an item’s MARC record indicates the date of an item’s public availability.
`
`
`5. I have reviewed Exhibit 1005, “Cyberguide: A mobile context-aware tour
`
`guide” by Gregory D. Abowd, Christopher G. Atkeson, Jason Hong, Sue
`
`Long, Rob Kooper and Mike Pinkerton (hereto referred to as ‘Abowd’) as
`
`presented in Wireless Networks October 1997.
`
`
`6. Attached hereto as Appendix AB01 is a true and correct copy of the cover,
`
`spine, title page, table of contents and complete ‘Abowd’ from Wireless
`
`IPR2020-00409
`Apple EX1009 Page 3
`
`

`

`Networks October 1997 held by the University of Pittsburgh. I secured this
`
`appendix myself in person. In comparing AB01 to Exhibit 1005, it is my
`
`determination that Exhibit 1005 is a true and correct copy of ‘Abowd’.
`
`
`7. Attached hereto as Appendix AB02 is a true and correct copy of the MARC
`
`record describing Wireless Networks as held by the University of Pittsburgh.
`
`I secured this record myself from the library’s online catalog. The 008 field
`
`of this MARC record indicates Wireless Networks was first cataloged by the
`
`University of Pittsburgh as of April 3, 1995. The ‘Holdings Information’
`
`field on page 2 of the library record indicates this journal was held by this
`
`library in perpetuity from 1996 - 2003. This date range indicates the library’s
`
`collection includes the October 1997 publication of IEEE Communications
`
`Magazine containing “Abowd”. The book bindery sticker on page 25 of
`
`AB02 indicates multiple volumes of Wireless Networks owned by the
`
`University of Pittsburgh spanning 1996-1997 were sent off to a book bindery
`
`sometime during January - March 1998.
`
`
`
`8. Attached hereto as Appendix AB03 is a true and correct copy of complete
`
`‘Abowd’ from Wireless Networks October 1997 held by Carnegie Mellon
`
`University as ‘p421-abowd.pdf’. I secured this appendix myself in person. In
`
`IPR2020-00409
`Apple EX1009 Page 4
`
`

`

`comparing AB03 to Exhibit 1005, it is my determination that Exhibit 1005 is
`
`a true and correct copy of ‘Abowd’.
`
`
`9. Attached hereto as Appendix AB04 is a true and correct copy of the MARC
`
`record describing Wireless Networks as held by Carnegie Mellon University.
`
`I secured this record myself from the library’s online catalog. The 008 field
`
`of this MARC record indicates Wireless Networks was first cataloged by the
`
`Carnegie Mellon University as of January 22, 1999. The ‘Holdings
`
`Information’ field on page 3 of the library record indicates this journal has
`
`been held by this library in perpetuity since 1999. This date range indicates
`
`the library’s collection includes the entirety of IEEE Communications
`
`Magazine via ACM Digital Library, including the October 1997 edition
`
`containing “Abowd”.
`
`
`10. Considering the MARC record data of each library in concert with the book
`
`bindery sicker, it is my determination that the October 1997 edition of
`
`Wireless Networks was made available and accessible to the public by the
`
`University of Pittsburgh shortly after initial publication and certainly no later
`
`than March 1998. Based on journal availability, it is my determination that
`
`‘Abowd’ was made available and accessible to the public in October 1997
`
`shortly after initial publication via Wireless Networks October 1997.
`
`IPR2020-00409
`Apple EX1009 Page 5
`
`

`

`
`11. I have reviewed Exhibit 1038, “A Collaborative Wearable System with
`
`Remote Sensing” by Martin Bauer, Timo Heiber, Gerd Kortuem and Zary
`
`Segall (hereto referred to as ‘Bauer’) as presented in The Second
`
`International Symposium on Wearable Computers (1998).
`
`
`12. Attached hereto as Appendix BA01 is a true and correct copy of the cover,
`
`spine, title page, table of contents and complete ‘Bauer’ from The Second
`
`International Symposium on Wearable Computers as held by Carnegie
`
`Mellon University. I secured this appendix myself in person. In comparing
`
`BA01 to Exhibit 1038, it is my determination that Exhibit 1038 is a true and
`
`correct copy of ‘Bauer’.
`
`
`13. Attached hereto as Appendix BA02 is a true and correct copy of the MARC
`
`record describing The Second International Symposium on Wearable
`
`Computers as held by Carnegie Mellon University. I secured this record
`
`myself from the library’s online catalog. The 008 field of this MARC record
`
`indicates The Second International Symposium on Wearable Computers was
`
`first cataloged by Carnegie Mellon University as of August 5, 1998. This
`
`date is prior to the date of the Symposium itself and therefore it is my
`
`determination that CMU cataloged this copy in advance of the formal
`
`IPR2020-00409
`Apple EX1009 Page 6
`
`

`

`publication of the material for the purpose of releasing the material
`
`expediently upon the date of formal release. In my experience as a cataloger,
`
`this is a common practice for time-sensitive materials. Considering this
`
`information, it is also my determination that Carnegie Mellon University
`
`made ‘Bauer’ available to the public shortly after the dates of the
`
`symposium, October 19-20, 1998.
`
`
`14. I have been retained on behalf of the Petitioner to provide assistance in the
`
`above-illustrated matter in establishing the authenticity and public
`
`availability of the documents discussed in this declaration. I am being
`
`compensated for my services in this matter at the rate of $100.00 per hour
`
`plus reasonable expenses. My statements are objective, and my
`
`compensation does not depend on the outcome of this matter.
`
`
`
`15. I declare under penalty of perjury that the foregoing is true and correct. I
`
`hereby declare that all statements made herein of my own knowledge are
`
`true and that all statements made on information and belief are believed to
`
`be true; and further that these statements were made the knowledge that
`
`willful false statements and the like so made are punishable by fine or
`
`imprisonment, or both, under Section 1001 of Title 18 of the United States
`
`Code.
`
`IPR2020-00409
`Apple EX1009 Page 7
`
`

`

`
`
`Dated: 12/19/19
`
`
`
`Jacob Robert Munford
`
`
`
`
`
`
`
`IPR2020-00409
`Apple EX1009 Page 8
`
`

`

`
`
`
`
`Appendix A
`Appendix A
`
`IPR2020-00409
`Apple EX1009 Page 9
`
`IPR2020-00409
`Apple EX1009 Page 9
`
`

`

`Appendix A - Curriculum Vitae
`
`Education
`
`University of Wisconsin-Milwaukee - MS, Library & Information Science, 2009
`Milwaukee, WI
`● Coursework included cataloging, metadata, data analysis, library systems,
`management strategies and collection development.
`● Specialized in library advocacy and management.
`
`
`Grand Valley State University - BA, English Language & Literature, 2008
`Allendale, MI
`● Coursework included linguistics, documentation and literary analysis.
`● Minor in political science with a focus in local-level economics and
`government.
`
`
`Professional Experience
`
`Researcher / Expert Witness, October 2017 – present
`Freelance
`Pittsburgh, Pennsylvania
`● Material authentication and public accessibility determination. Declarations
`of authenticity and/or public accessibility provided upon research
`completion. Depositions provided on request.
`● Research provided on topics of public library operations, material
`publication history, digital database services and legacy web resources.
`● Past clients include Apple, Fish & Richardson, Erise IP, Baker Botts and
`other firms working in patent law.
`
`
`
`Library Director, February 2013 - March 2015
`Dowagiac District Library
`Dowagiac, Michigan
`● Executive administrator of the Dowagiac District Library. Located in
`Southwest Michigan, this library has a service area of 13,000, an annual
`
`IPR2020-00409
`Apple EX1009 Page 10
`
`

`

`operating budget of over $400,000 and total assets of approximately
`$1,300,000.
`● Developed careful budgeting guidelines to produce a 15% surplus during the
`2013-2014 & 2014-2015 fiscal years.
`● Using this budget surplus, oversaw significant library investments including
`the purchase of property for a future building site, demolition of existing
`buildings and building renovation projects on the current facility.
`● Led the organization and digitization of the library's archival records.
`● Served as the public representative for the library, developing business
`relationships with local school, museum and tribal government entities.
`● Developed an objective-based analysis system for measuring library services
`- including a full collection analysis of the library's 50,000+ circulating
`items and their records.
`
`
`
`November 2010 - January 2013
`Librarian & Branch Manager, Anchorage Public Library
`Anchorage, Alaska
`● Headed the 2013 Anchorage Reads community reading campaign including
`event planning, staging public performances and creating marketing
`materials for mass distribution.
`● Co-led the social media department of the library's marketing team, drafting
`social media guidelines, creating original content and instituting long-term
`planning via content calendars.
`● Developed business relationships with The Boys & Girls Club, Anchorage
`School District and the US Army to establish summer reading programs for
`children.
`
`
`June 2004 - September 2005, September 2006 - October 2013
`Library Assistant, Hart Area Public Library
`Hart, MI
`● Responsible for verifying imported MARC records and original MARC
`cataloging for the local-level collection as well as the Michigan Electronic
`Library.
`● Handled OCLC Worldcat interlibrary loan requests & fulfillment via
`ongoing communication with lending libraries.
`
`IPR2020-00409
`Apple EX1009 Page 11
`
`

`

`
`Professional Involvement
`
`Alaska Library Association - Anchorage Chapter
`● Treasurer, 2012
`
`
`Library Of Michigan
`● Level VII Certification, 2008
`● Level II Certification, 2013
`
`
`Michigan Library Association Annual Conference 2014
`● New Directors Conference Panel Member
`
`
`Southwest Michigan Library Cooperative
`● Represented the Dowagiac District Library, 2013-2015
`
`
`
`Professional Development
`
`Library Of Michigan Beginning Workshop, May 2008
`Petoskey, MI
`● Received training in cataloging, local history, collection management,
`children’s literacy and reference service.
`
`
`Public Library Association Intensive Library Management Training, October 2011
`Nashville, TN
`● Attended a five-day workshop focused on strategic planning, staff
`management, statistical analysis, collections and cataloging theory.
`
`
`Alaska Library Association Annual Conference 2012 - Fairbanks, February 2012
`Fairbanks, AK
`● Attended seminars on EBSCO advanced search methods, budgeting,
`cataloging, database usage and marketing.
`
`IPR2020-00409
`Apple EX1009 Page 12
`
`

`

`
`
`
`
`Appendix AB01
`Appendix AB01
`
`IPR2020-00409
`Apple EX1009 Page 13
`
`IPR2020-00409
`Apple EX1009 Page 13
`
`

`

`
`ETEETEEEEen
`SaacSSSSSSSSSSSSasae
`
`IPR2020-00409
`Apple EX1009 Page 14
`
`

`

`WIRELESS
`NETWORKS
`
`elo) IPR2020-00409
`
`VOL. 2-3
`
`Apple EX1009 Page 15
`
`IPR2020-00409
`Apple EX1009 Page 15
`
`

`

`R12-M@6-S13-Tas
`3173504425 1662
`DTA1
`Hillman Gr.Fl. Lending
`Request ID: 446724
`Pull Date: 2619711718 15:59
`Call No,:
`
`RED
`MUNFORD.Jaen=_—____—____
`MUNFORD, JACOB R
`ULSortsyB
`2L66862000410168
`a
`Req. Date: 2019711718 13:07:24
`
`tsAeeee
`
`
`
`
`
`
`
`IPR2020-00409
`Apple EX1009 Page 16
`
`

`

`
`Advances
`in Wireless
`
`WP Networkingo
`
`A Tt Lae
`
`|
`
`
`
`
`
`Luigi Fratta —- Biswanath Mukherjee
`
`IPR2020-00409
`
`
`IPR2020-00409
`Apple EX1009 Page 17
`
`

`

`Baltzer Science Publishers, Amsterdam. The Netherlands
`
`© J.C. Baltzer AG (1997)
`All rights reserved. No part ofthis publication maybe reproduced, stored in a retrieval System or transmitted in any form or
`by any means, electronic, mechanical, photocopying, recording or otherwise, without the prior permission of the publisher,
`
`Apple EX1009 Page 18
`
`Wireless Networks, The journal of mobile communication, computation and information, ISSN 1022-0038
`
`Advances in Wireless Networking
`
`IPR2020-00409
`
`IPR2020-00409
`Apple EX1009 Page 18
`
`

`

`s Networks 3 (1997)
`
`
`
`Contents
`
`obile power managementfor wireless communication networks
`J.M. Rulnick and N. Bambos
`New call blocking versus handoff blocking in cellular networks
`M. Sidi and D. Starobinski
`On optimal call admission control in cellular networks
`R. Ramijee, D. Towsley and R. Nagarajan
`Slotted ALOHA and CDPA: A comparison of channel access performance in cellular systems
`FF. Borgonovo and M. Zorzi
`Delay analysis for forward signaling channels in wireless cellular network
`I. Rubin and C. Choi
`
`A new model for scheduling packet radio networks
`A. Sen and M.L. Huson
`Unified power control, error correction coding and scheduling for a CDMA downlink system
`¥. Lu and R. Brodersen
`Using channel state dependent packet scheduling to improve TCP throughput over wireless LANs
`P. Bhagwat, P. Bhattacharya, A. Krishna and S.K. Tripathi
`
`29
`
`43
`
`53
`
`7
`
`83
`
`9]
`
`
`
`IPR2020-00409
`Apple EX1009 Page 19
`
`
`
`IPR2020-00409
`Apple EX1009 Page 19
`
`

`

`Wireless Networks 3 (1997)
`
`Contents
`
`
`
`Transmission policies and traffic management in multimedia wireless networks
`A. Burrell, H.P. Stern and P. Papantoni-Kazakos
`
`Slow shadowing and macrodiversity in the Capture-Division Packet Access (CDPA)
`F. Borgonovo, M. Zorzi and L. Fratta
`
`ASK digital demodulation scheme for noise immune infrared data communication
`H. Uno, K. Kumatani, H. Okuhata, l. Shirakawa and T. Chiba
`
`Optical interference produced by artificial light
`A.J.C. Moreira, R.T. Valadas and A.M. de Oliveira Duarte
`
`Initial estimation of communicationefficiency of indoor wireless channels
`G.J. Foschini and R.A. Valenzuela
`
`Hybrid diversity combining techniques for DS-CDMA over a multipath fading channel
`M.A. Do and S.Y. Wu
`
`Ensemble polling strategies for increased paging capacity in mobile communication
`networks
`C. Rose andR. Yates
`
`103
`
`113
`
`121
`
`13]
`
`141
`
`155
`
`159
`
`
`
`IPR2020-00409
`Apple EX1009 Page 20
`
`th ae
`
`IPR2020-00409
`Apple EX1009 Page 20
`
`

`

`Wireless Networks 3 (1997)
`
`Contents
`
`Cumulated interference power and bit-error-rates in mobile packet radio
`M. Hellebrandt and R. Mathar
`A simplified approach to the performance evaluation of FDMA-CDMAsystems
`G. Immovilli, M.L. Merani and M.K. Shahin
`Network architecture and traffic transport for integrated wireless communications over
`enterprise networks
`H.C. Chan, V.C.M. Leung and R.W. Donaldson
`Paging strategy optimization in personal communication systems
`A. Abutaleb and V.O.K. Li
`Location update optimization in personal communication systems
`A. Abutaleb and V.O.K. Li
`Performance modeling of asynchronous data transfer methods of IEEE 802.11 MAC
`protocol
`H.S. Chhaya and S. Gupta
`Escrow techniques for mobile sales and inventory applications
`N. Krishnakumar and R. Jain
`
`169
`
`173
`
`181
`
`195
`
`205
`
`217
`
`235
`
`
`
`vs)
`
`
`
`
`
`
`Mis.
`<4)
`oO 0 aa (fo
`Oo
`YnditspRan
`
`SE
`OF p Ens, Hay,
`Cr
`'Trg Wry
`
`
`IPR2020-00409
`Apple EX1009 Page 21
`
`IPR2020-00409
`Apple EX1009 Page 21
`
`

`

`Wireless Networks 3 (1997)
`
`
`
`247
`
`249
`
`267
`
`285
`
`29]
`
`Contents
`
`Editorial
`Design and control of micro-cellular networks with QOS provisioning for data traffic
`M. Naghshineh and A.S. Acampora
`A rate-based overload control method for the radio channel in PCN
`N.IL. Passas and L.F. Merakos
`
`A control and management network for wireless ATM systems
`S.F. Bush, S. Jagannath, R. Sanchez, J.B. Evans, V.S. Frost, G.J. Minden and
`K.S. Shanmugan
`
`Error correction and error detection techniques for wireless ATM systems
`S. Aikawa, Y. Motoyama and M. Umehira
`
`PHSterminating call control
`S. Suzuki, T. Ihara and Y. Shikata
`
`Satellite-PCS channel simulation in mobile user environments using photogrammetry
`and Markov chains
`H.-P. Lin, R. Akturan and WJ. Vogel
`
`
`
`
`
`IPR2020-00409
`Apple EX1009 Page 22
`
`IPR2020-00409
`Apple EX1009 Page 22
`
`

`

`Wireless Networks 3 (1997)
`
`Contents
`
`Editorial
`Scheduling techniques for reducing processor energy use in MacOS
`J.R. Lorch and A.J. Smith
`Spectrum sharing underthe asynchronous UPCSetiquette: The performanceofcollocated
`systems under heavy load
`I, Vukovic and J, McKown
`A dynamicload balancing strategy for channel assignmentusing selective borrowing in
`cellular mobile environment
`S.K. Das, S.K. Sen and R. Jayaram
`Dependency sequences and hierarchicalclocks: Efficient alternatives to vector clocks for
`mobile computing systems
`R. Prakash and M. Singhal
`Efficient and flexible location managementtechniques for wireless communication
`systems
`J. Jannink, D. Lam, N. Shivakumar, J. Widom and D.C. Cox
`Low-loss TCP/IP header compression for wireless networks
`M. Degermark, M. Engan, B. Nordgren and S. Pink
`TCP extensions for space communications
`R.C. Durst, G.J. Miller and E.J. Travis
`Building reliable mobile-aware applications using the Rovertoolkit
`A.D. Joseph and M.F. Kaashoek
`Cyberguide: A mobile context-aware tour guide
`G.D. Abowd, C.G. Atkeson, J. Hong, S. Long, R. Kooper and M.Pinkerton
`
`309
`
`311
`
`325
`
`333
`
`349
`
`361
`
`375
`
`389
`
`405
`
`421
`
`b
`
`IPR2020-00409
`
`Apple EX1009 Page 23
`
`IPR2020-00409
`Apple EX1009 Page 23
`
`

`

`, Nety orks 3 (1997)
`
`Contents
`
`Biological aspects of mobile communication fields
`
`Blood-brain barrier permeability in rats exposed to electromagnetic fields used in wireless communication
`B.R.R. Persson, L.G. Salford and A. Brun
`Brain tumour developmentin rats exposed to electromagnetic fields used in wireless cellular communication
`LG. Salford, A. Brun and B.R.R. Persson
`;Naltrexone blocks RFR-induced DNA doublestrand breaksin rat brain cells
`H. Lai, M. Carino and N. Singh
`
`Enhancementof the interaction between low-intensity R.F. e.m. fields and ligand binding due to cell basal
`metabolism
`B. Bianco, A. Chiabrera, E. Moggia and T. Tommasi
`
`
`Amplitude modulated RF fields stemming from a GSM/DCS-1800 phone
`G.F. Pedersen
`
`
`
`
`
`
`
`
`
`Evaluation of electromagnetic power deposition in a spherical multilayer head in the near field of a linear antenna
`G. Cerri, R. De Leo and G. Rosellini
`
`Assessmentof the potential risk for humans exposed to millimeter-wave wireless LANs: the power absorbed in the
`eye
`P. Bernardi, M. Cavagnaro and S. Pisa
`
`Author index
`
`IPR2020-00409
`Apple EX1009 Page 24
`
`435
`
`439
`
`455
`
`463
`
`471
`
`477
`
`>ooNO
`
`499
`
`511
`
`519
`
`IPR2020-00409
`Apple EX1009 Page 24
`
`

`

`Wireless Networks 3 (1997) 421-433
`
`Cyberguide: A mobile context-aware tour guide
`
`Gregory D. Abowd®, Christopher G. Atkeson*, Jason Hong*, Sue Long*®, Rob Kooper®* and Mike Pinkerton *
`“ Graphics, Visualization and Usability Centre, College of Computing, Georgia Institute of Technology, Atlanta, GA 30332-0280,USA
`» Wink Communications, Alameda, CA 94501, USA
`
`
`
`Future computing environments will free the user from the constraints of the desktop. Applications for a mobile environment should
`take advantage of contextual information, such as position, to offer greater services to the user.
`In this paper, we present the Cyberguide
`project, in which weare building prototypes of a mobile context-aware tour guide. Knowledge ofthe user's current location, as well as a
`history of past locations, are used to provide more of the kind of services that we come to expect from a real tour guide. We describe the
`architecture and features of a variety of Cyberguide prototypes developed for indoor and outdoor use on a numberof different hand-held
`platforms. We also discuss the general research issues that have emerged in our context-aware applications development in a mobile
`environment.
`
`1. Introduction
`
`Future computing environments promise to free the user
`from the constraints of stationary desktop computing, yet
`relatively few researchers are investigating what applica-
`tions maximally benefit from mobility. Current use of mo-
`bile technology shows a slow evolution from our current
`desktop paradigm of computing, but the history of inter-
`action showsthat the adoption of new technology usually
`brings about a radical revolution in the way humans use
`and view technology [11]. Whereas the effective use of
`mobile technology will give rise to an interaction para-
`digm shift, it is difficult to predict what that shift will be,
`We follow the advice of Alan Kay, therefore, and choose
`to predict the future by inventing it. Our approach is to
`think first about what activities could be best supported
`by mobile technology and then determine how the tech-
`nology would have to work. This applications focus is
`important to distinguishing our work in mobile comput-
`ing.
`In April 1995, we formed the Future Computing Envi-
`ronments (FCE) Group within the College of Computing
`and the Graphics, Visualization and Usability (GVU Cen-
`ter) at Georgia Tech to promote such an applications focus.
`Our group is committed to the rapid prototyping of appli-
`cations that benefit from the use of emerging mobile and
`ubiquitous computing technologies. Quick development of
`these futuristic applications allows us to predict and shape
`what our everyday lives will be like when today’s novel
`technology becomes commonplace.
`Applications for a mobile environment should take ad-
`vantage of contextual information, such as position, to of-
`fer greater services to the user.
`In this paper, we present
`the Cyberguide project, a series of prototypes of a mobile,
`hand-held context-aware tour guide. Initially, we are con-
`cerned with only a small part of the user’s context, specif-
`ically location and orientation, Knowledge of the user's
`current location, as well as a history of past locations, are
`used to provide more of the kind of services that we come
`
`© J.C. Baltzer AG, Science Publishers
`
`to expect from a real tour guide. We describe the archi-
`tecture and features of a variety of Cyberguide prototypes
`developed for indoor and outdoor use on a numberofdif-
`ferent hand-held platforms. We also discuss the general
`research issues that have emerged in our experience of de-
`veloping context-aware applications in a mobile environ-
`ment. Some ofthese research issues overlap with those
`that we have considered in applying other applications of
`ubiquitous computing technology.
`The general application domain which has driven the
`development of Cyberguide is tourism, but we have found
`it necessary to be even more focused in our research. The
`initial prototypes of Cyberguide, therefore, were designed
`to assist a very specific kind oftourist — a visitor in a tour
`of the GVU Center Lab during our monthly open houses.
`Visitors to a GVU open house are typically given a map
`of the various labs and an information packet describing
`all of the projects that are being demonstrated at various
`sites, Moving all of the paper-based information into a
`hand-held, position-aware unit provided a testbed for re-
`search questions on mobile, context-aware application de-
`velopment.
`The long-term goal is an application that knows where
`the tourist is, what she is looking at, can predict and answer
`questions she might pose, and provide the ability to inter-
`act with other people and the environment. Ourshort-term
`goal was to prototype versions of Cyberguide on commer-
`cially available PDAs and pen-based PCsin which context-
`awareness simply meant the current physical position and
`orientation of the Cyberguide unit (andsinceit is hand-held,
`this locates the user as well). Position information improves
`the utility of a tour guide application. As the prototypes of
`Cyberguide evolve, we have been able to handle more of
`the user’s context, such as where she and others have been,
`and we have increased the amount in which the tourist can
`interact and communicate with the place and people sheis
`visiting.
`
`IPR2020-00409
`Apple EX1009 Page 25
`
`IPR2020-00409
`Apple EX1009 Page 25
`
`

`

`
`
`422
`
`G.D. Abowdet al. / Cyberguide: A mobile context-aware tour guide
`
`1.1. Overview
`
`This paper is an extended version ofan earlier report on
`Cyberguide [7], we discuss the evolution of the Cyberguide
`design and prototype as well as what future research areas
`our experience has uncovered. We begin in section 2 by
`describing scenarios for the use of context-aware mobile
`applications.
`In section 3, we provide context for our re-
`search within the area of applications-centered mobile com-
`puting. The generic architecture of Cyberguide is explained
`in section 4. We will describe in section 5 the initial re-
`alization of the generic components of the Cyberguide ar-
`chitecture, a series of prototypes developed for the Apple
`MessagePad. We will then describe in section 6 how the
`initial
`indoor prototypes were extended for use outdoors
`and for greater interaction with the environment. We con-
`clude in sections 7 and 8 with a discussion of significant
`issues for context-aware applications development and how
`our past experience will influence our future development
`plans.
`
`2. Scenarios for a mobile context-aware application
`
`This section outlines some possible uses for future mo-
`bile context-aware applications. Some of these uses are
`currently being implemented and some are futuristic. We
`begin with our initial assumptions about what technology
`we expect Cyberguide to use. Tourists are usually quite
`happy to carry around a bookthat describes the location
`they are visiting, so a reasonable packaging would bein
`the form of a hand-held device. The ideal hand-held de-
`vice will have a screen and pen/finger interface, access to
`substantial storage resources — possibly through an internal
`device such as a CD drive, or through substantial commu-
`nication and networking resources (cell phone, pager, data
`radio interface) providing access to other storage servers
`(such as the Web) — an audio input and output interface
`with speech generation and potentially sophisticated voice
`recognition, and a video input and output interface. The
`video input (a video camera) could be pointed at the user
`to interpret user gestures, or pointed at the environmentto
`interpret objects or symbols in the environment. The video
`output could be integrated into the main screen or be a sep-
`arate video display device, such as an attached screen or
`heads up display on geeworn By the user.
`One major application of mobile context-aware devices
`are personal guides. Museumscould provide these devices
`and allow users to take personalized tours seeing any ex-
`hibits desired in any order, in contrast to today’s tapedtours.
`In fact, many museums now provide portable devices for
`just such a purpose, but what we are envisioning is a device
`that would allow the tourist to go anywhere she pleases and
`be able to receive information about anywhereshe is. Walk-
`ing tours of cities or historical sites could be assisted by
`these electronic guidebooks. The hand-held devices could
`use position measurement systems such as indoor beacons
`
`or the Global Positioning System (GPS)to locate the user,
`and an electronic compassorinertial navigation system to
`find user orientation. Objects of interest could be marked
`with visual markers or active beacons or recognized us-
`ing computer vision. Some objects, such as animals at
`a zoo or aquarium, might be difficult to mark but could
`be recognized with simple computer vision and someas-
`sistance from the environment(indications that this is the
`elephant cage, for example). The personal guide could also
`assist in route planning and providing directions. Some of
`these functions are currently being provided by automobile
`on-board navigation systems.
`There are other ways to assist users. Consider a traveler
`in Japan that does not speak or read Japanese. The hand-
`held device could act as a pocket multilingual dictionary,
`actually speaking the appropriate phrase with the appro-
`priate pronunciation to a taxi driver, for example (or even
`showing the appropriate Kanji and an associated map on
`the screen). A device that included video input or a scan-
`ner could assist in reading signs or menus. A device that
`could show stored images might be able to show a shop-
`keeper the desired object or favorite meal. Another more
`futuristic use is to assist the user by recognizing facesat a
`cocktail party and reminding the user who people are.
`Real-time communication allows a personal device to
`act as an agent for the user. A personal guide to a theme
`park couid make reservations at particular rides, and alert
`the user when the reservation was available. The device
`could also tell the user which rides had the shortest lines.
`Similar approachesare currently being used for automobile
`traffic managementin majorcities.
`An importantapplication of context-aware devicesis en-
`hanced reality. A heads up display could provide “X-ray”
`vision for the user. While surveying a building for renova-
`tion, the location of hidden plumbingorelectrical conduits
`could be indicated to the user, based on information from
`sensors and/or building plans. At an archeological site a
`visitor could be provided with various overlays indicating
`what used to be above the current ground level as well as
`what is below the current groundlevel.
`Context-aware devices can also be used as tools. Simple
`sonar devices are used to make room measurements today.
`It would not take much to have a hand-held device that
`both videotaped and mapped a room along with user com-
`mentary. An ecological field study or an archeological dig
`could be assisted by a device that automatically recorded
`ine context of a particular find, inciuding noting ihe sui-
`rounding objects. Consider an electronic field guide that
`assisted the user in recognizing plants orinsects.
`Oneofthe most interesting applications of context-aware
`devices is to support group interaction on a tour or in a
`classroom, for example. Participants in a live demonstra-
`tion of some new technologycould use their personal device
`to help steer the demo using majority voting or consensus
`among the viewers. Each participant could run a person-
`alized version of the same demo by expressing their own
`choices.
`In this case context is which demo a participant
`
`IPR2020-00409
`le EX1009 P
`
`IPR2020-00409
`Apple EX1009 Page 26
`
`

`

`G.D. Abowdet al. / Cyberguide: A mobile context-aware tour guide
`
`423
`
`Wetried to pay attention to the higher level concep-
`tual design of Cyberguide, but we have not been as gen-
`eral in our handling of context-aware mobile objects as has
`Schilit [13].
`
`4. Architecture of Cyberguide
`
`IPR2020-00409
`
`From the beginning, we have viewed Cyberguide as a
`family of prototypes and not just a single prototype, so it
`made sense to think about a conceptual design, or archi-
`tecture, that captured the essence of the mobile tour guide.
`We have divided the system into several independent com-
`ponents, or building, and have found it useful to present
`those components bothin terms of the generic function and
`personified in terms of the people a tourist would like to
`have available while exploring unfamiliar territory. The
`overall system serves as a tour guide, but we can think of
`a tour gui