`
`Page 1 of 28
`
`DESIGNING THE USER INTERFACE
`Strategies for Effective Human-ComputerInteraction / 5th Edition
`
`a
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT1013
`Page 1 of 28
`
`

`

`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTSEXHIBIT 1013
`Page 2 of 28
`Page 2 of 28
`
`

`

`
`
`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 3 of 28
`Page 3 of 28
`
`ic
`
`

`

`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 4 of 28
`Page 4 of 28
`
`

`

`
`
`1
`
`ONLINE ACCESS forDesigning the User Interface:
`Strategies for Effective Human-ComputerInteraction, Fifth Edition
`
`Thank you for purchasing a new copy of Designing the User Interface:
`Strategies for Effective Human-ComputerInteraction, Fifth Edition.
`Your textbookincludes six months of prepaid access to the book's
`Companion Website. This prepaid subscription gives youfull access
`to all student support areas, including:
`
`¢ A blog to keep you up-to-date on current HCl issues
`° Self-assessment quizzes to test your knowledge
`e PowerPoint® slides to reinforce the concepts in the textbook
`* Discussion questions for further exploration
`* Online projects
`¢ Links to related information
`
`a(
`
`+
`
`<<<< YOUR ACCESS CODE
`
`Please see the otherside of this card for registration instructions.
`
`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 5 of 28
`Page 5 of 28
`
`

`

`
`
`
`
`puter with an Internet connec-
`Just a couple of minutes and
`
`i
`i
`You will need to regi
`gister online using
`a com
`tion and a web browser. The Rretaee takes
`only needs to be completed once.
`1. Go to http://www.aw.com/DTUI.
`2. Click on Protected ReaderResources.
`3. Click the Register button.
`4. On the registration Page, enter your student access code found
`beneath the pull tab. Do not type the dashes. You can use lower-
`or uppercase.
`5. Follow the on-screeninstructions.If you need help at anytime during
`the online registration process, simply click the Need Help?icon.
`6. Once your personal Login Name and Passwordare confirmed, you
`can begin using the Designing the UserInterface: Strategies for
`Effective Human-ComputerInteraction, Fifth Edition, Companion
`Website!
`
`To log in after you have registered:
`You only need to register for this Companion Website once A
`)
`. After that, you
`can log in any time at http://www.aw.com/DTUIby providing your Login
`Name and Password when prompted.
`s code can only be used once.This subscription is
`*Important: The acces
`valid for six months upon activation and is not transerae e ee
`code has already been revealed,it may no longetoeerno eer
`you can purchase a subscription by going to http://
`aw.
`and following the on-screen instructions.
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 6 of 28
`Page 6 of 28
`
`

`

`
`
`DESIGNING THE USER INTERFACE
`
`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 7 of 28
`Page 7 of 28
`
`

`

`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 8 of 28
`Page 8 of 28
`
`

`

`Strategiesfor Effective Human-ComputerInteraction / 5th Edition
`
`Ben Shneiderman& Catherine Plaisant
`VENTEaoa telNCoursA OtoleveleMol
`
`Mexico City Munich Paris CapeTown HongKong Montreal
`
`Addison-Wesley
`Boston San Francisco New York
`London Toronto Sydney Tokyo Singapore Madrid
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 9 of 28
`Page 9 of 28
`
`

`

`
`
`n Ferreri
`
`rdinator: Ang’joly
`
`uitserviceProjectManagement:RoseKernan,
`Editor-in-Chiel:MichaelHirsch
`[mage Permission Coo!
`NesbittGraphics,Inc.
`EditorialAssistant:StephanieSellinge™
`CompositionimalTMlustrations:
`ManagingEditor:JeffHolcomb
`NesbittGraphics, ae
`SeniorManufacturingBuyer:CarolMelville
`TextDesigner:jerilynBockorick,
`ArtDirector:LindaKnowles
`NesbittGraphics,rae
`:
`SeniorMedia Producer:BethanyTidd
`coverDesigne®joyceCosentinaWells
`DirectorofMarketing:MargaretWaples
`CoverPhotos:(clockwise,fromtopleft)©Jeff
`MarketingMarinaSD ;
`cage©AtenBecker/ThEImageBank/Getty
`MarketingCoordinator:KathrynFerranth
`rie© Beaemmnrich/TheImageWor
`DirectorofMarketingServices:StaceyAbraham
`©MichaelDeYoung/Aurora/GettyImages;©Jon
`OnlineProductManager:BethanyTidd
`©Misersh/Iconica/GettyTnagess©ete
`Manager,RightsandPermissions:DiannKorta
`Cultura/GettyImages-Background:©Jason
`PencsaeSEoe
`aedPhotodisc1Getty ieanves
`Text Permission Coordinator: DanaWeightman
`Visual Research Manager- Beth Brenzel
`les from our World Wide Website:
`rmation about Addison-Wesley tit
`Accessthe latest info
`d reproduced, with permission,
`highered.com/ cs
`http://www.pearson
`\
`nts borrowed from other sources al
`tter of this book.
`acknowledgme
`tion in the endma
`Credits and
`Jaimed as
`he Acknowledgments sec!
`tionsbymanufactu
`eirproductsareC
`hosedesignationsappeari
`sherwasawareofatrademarkclaim,
`textbook appear int
`rers andsellers to distinguishth
`n this book, and the publi
`Manyof the designa
`all caps.
`trademarks. Wheret
`d trademarks ofthe Microsoft Corporation in the U.S.A. and other
`inted in initial caps OT
`the designations have been pr
`d withpermission from theMicrosoft Corporation. Thisbookis not
`ft® and Windows® are registere
`Microso
`en shots and icons reprinte
`h the Microsoft Corporation.
`countries. Scre
`ffiliated wit
`instructional value. They have
`sponsored oF endorsed by or a
`in this book have been includedfor their
`sher does notoffer any war
`anyparticular purpose. The publi:
`applications presented
`Theprograms and
`ms or applications:
`but are not guaranteed for
`liabilities with respect to the progra
`been tested with care,
`nor doesit accept any
`ranties oF representations,
`-in-Publication Data
`Library of Congress Cataloging
`Shneiderman, Ben.
`
`in this
`
`Designingtheuserinterface / BenShneiderman,CatherinePlaisant;contributors,MaxineCohen,Steven
`
`Jacobs. — 5th ed.
`p- cm.
`Includes bibliographical references and index.
`2. User interfaces (Computer systems) LPlaisant, Catherine. Il. Title.
`ISBN 0-321-53735-1 (alk. paper)
`1. Human-computer interaction.
`QA76.9.H85554 2009
`005.4'37-dce22
`
`2009003477
`
`Copyright © 2010, 2005, 1998 P
`
`earson HigherEducation. All rightsreserved.Manufacturedin theUnited States of
`SoeeeisprotectedbyCopyrightandpermissionsshouldbeobtainedfromthepublisherpriort0
`ay P uction,storageinaretrievalsystem,ortransmissioninanyformorbyanymeans electronic
`unaltcosingdgOPceDepaBNwork
`BBN
`cation,
`RightsandContractsDepartm
`i
`Boston,MA02116,fax(617)671-3447,oronlineathttp://www.pearsonSaeeSaneeeSuite
`
`
`
`
`
`
`
`
`
`
`Addison Wesley
`is an imprint of
`
`eee)ee
`
`ISBN-13:978-0-321-53735°5
`
`ISBN-10: 9-321-53739-1
`10987654321—CRK—13 12 11 10 09
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 10 of 28
`Page 10 of 28
`
`

`

`
`
`To Jenny and Peter;
`Anna, Sara, and Thomas
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 11 of 28
`Page 11 of 28
`
`

`

`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 12 of 28
`Page 12 of 28
`
`

`

`Preface
`
`|
`
`|
`|
`|
`
`:
`
`|
`|
`I
`
`|
`
`
`
`
`
`Designing the UserInterface is written for students, researchers, designers, man-
`agers, and evaluatorsof interactive systems. It presents a broad survey of how
`to develop high-quality user interfaces for interactive systems. Readers with
`backgrounds in computerscience, psychology, sociology, industrial engineer-
`ing, information science/studies/systems, business, education, and communi-
`cations should all find fresh and valuable material. Our goals are to encourage
`greater attention to usability issues and to promote further scientific study of
`human-computer interaction, including the rapidly emerging topic of social
`media participation.
`Since the publication of the first four editions of this book in 1986, 1992, 1998,
`and 2005, HCI practitioners and researchers have grown more numerous and
`influential. The quality of interfaces has improvedgreatly, while the community
`of users andits diversity have grown dramatically. Researchers and designers
`could claim success, but
`today user expectations are higher, applications
`are more demanding, and platforms are more varied. In addition to desktop
`computers, designers now must accommodate web-based services and an
`increasingly diverse set of mobile devices. User interface designers are moving
`in new directions: some innovators provoke us with virtual and augmented
`realities, whereas others offer alluring scenarios for ubiquitous computing,
`embedded devices, and tangible userinterfaces.
`These innovations are important, but much work remains to be done to
`improve the experiences of novice and expert users whostill struggle with too
`many frustrations. These problems must be resolved if we are to achieve
`the goal of universal usability, enabling all citizens in every country to enjoy
`the benefits of these new technologies. This book is meant to inspire students,
`guidedesigners,andprovokeresearcherstoseekthosesolutions.
`Keeping up with the innovations in human-computer interaction is a
`demandingtask, and requests for an update begin arriving soon after the publi-
`cation of each edition. The expansionofthefield led the single authorof thefirst
`three editions, Ben Shneiderman,
`to turn to Catherine Plaisant, a long-time
`valued research partner, for coauthoring help with the fourth andfifth editions.
`In addition, two contributing authorslent their able supportto thisfifth edition:
`Maxine S. Cohen and Steven M.Jacobs have long experience teaching with ear-
`lier editions of the book and provided fresh perspectives that improved the
`quality for all readers and instructors. In preparing for this edition, we har-
`
`vested information from books and journals, scanned the World Wide Web,
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 13 of 28
`Page 13 of 28
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`

`

`Preface
`
`ted with co.
`
`lleagues. Then we returned to
`aa
`snded conferences, and consul
`Beser to write, producing first drafts that served as a starting point to
`1
`e
`Cc
`es H¢
`racti ioners, a id students. he work
`5
`I pte
`1010F
`y
`al
`I
`ger erat
`feedback from ollea ues,
`:
`:
`that went into the final product was intense, but satisfying. We hope you, the
`readers, will put these ideas to good use and produce more innovat:
`to
`report in future editions.
`
`i
`
`ions for us
`
` viii
`
`New in the Fifth Edition
`ragie(aaeRgEoe
`Readers will see the dynamism of human-computer interaction reflected in
`the substantial changesto thisfifth edition. The good news is that most univer-
`sities nowoffer courses in this area, and some require it in computerscience,
`information schools (iSchools), or other disciplines. Courses and degree pro-
`gramsin human-computerinteraction, human-centered computing, interaction
`design,etc. are a growing worldwide phenomenonat every educationallevel.
`Although manyusability practitioners muststill fight to be heard, corporate and
`government commitments to usability engineering grow stronger daily. The
`business casefor usability has been maderepeatedly, and dedicated websites
`describe scores of studies demonstrating strong return on investmentfor usabil-
`ity efforts.
`Comments from instructors who used the previous editions were influential
`in ourrevisions. The main change wasto dramatically expand our coverage of
`social media participation and user-generated content, especially from mobile
`devices. We deleted the chapter on softwaretools, as these change so rapidly
`and Babeoe ee than we could give themina single chapter. Every
`remaining
`chapter
`has been
`i
`i
`i
`ae At ie same Seared earns a Bea ie
`together with older feferentes ire oere ved!)Helinll
`,
`moved.
`aaaspieleen ee the growing issue of ensuring universal
`farts
`tel sate
`8 y liverse users of interactive systems. The second chap-
`r presents
`design guidelines, principles, and theories that have b
`bstan-
`tially updated to reflect new ways
`of
`think
`: otRae
`devia
`5
`ys of
`thinking. Part 2 covers refinements to
`pen _methodologies and evaluation techni ues. Part 3
`i
`Progress in direct Manipulation andits extensions
`at
`isthe ae
`mented reality, as well as changes to menus,
`f
`ai Nas virtual and aug-
`guages brought about by the new platform me yu ond command Tat
`collaboration and social media participati
`S
`(especiall
`pation have bec
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 14 of 28
`Page 14 of 28
`
`

`

`
`
`Preface
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`.
`
`onlinehelp in serving the goal of universal usability. Fin
`andvisualization now have their own chap
`ally, information search
`ters, since webelieve that these top-
`ics have grown dramatically In importance.
`Westrive to give balanced Presentations on controversial topics such as 3D,
`speech, and natural-languageinterfaces. Philosophical controversies such as the
`degree of humancontrol and the role of animated characters are treated care-
`fully to present fairly the viewpoints that differ from our own. We gave col-
`leagues a chance to comment on these sections and madea special effort to
`provide a balanced presentation while making our
`
`succeeded.
`
`these elements are
`Instructors wanted guidelines and Summary tables;
`shown in boxes throughout
`the book. The Practitioner Summaries and
`Researcher Agendas remain popular; they have been updated. Thereferences
`have been expanded and freshened with many New sources, with classicpapers
`still included. We worked hard to select references that were widely available
`and often web-accessible. Figures, especially those showing screen designs, age
`quickly, so many new user interfaces are shown. Printing in full color makes
`these figures valuable as a record of contemporary designstyles.
`
`Waysto UseThis Book
`Buona
`We hopethatpractitioners and researchers who read this book will want to
`keepit on their shelves to consult when they are working on newtopics or seek-
`ing pointersto theliterature,
`Instructors may choose to assign thefull text in the order that we Presentit or
`to makeselectionsfromit. The opening chapteris a good starting point for most
`students, but instructors may take different paths depending on their disci-
`plines. For example, instructors might emphasize the following chapters,listed
`by area:
`* Computerscience: 2,5, 6,7, 8,9, 10, 13, 14
`* Psychology and sociology: 2, 4,5, 9,10, 11, 12
`©
`Industrial engineering: 2, 4,5, 10, 11, 13, 14
`* Library andinformation studies: 2, 4, DEL ISAT4
`¢ Business and information systems:3, 4, 5,9, 10, 12, 13, 14
`¢ Education technology:2, 4, 9, 12, 13, 14
`* Communication arts and media studies:4, D, SalPal?
`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 15 of 28
`Page 15 of 28
`
`* Technical writing and graphic design: 3, 4,5, 11, 12
`
`

`

`ww.aw.com/DTU!)
`Companion Website (w
`’
`©
`pre
`the World Wide Web has a profound effect on researc
`ieeeoer and students. We want to Soeur pag ueote
`Webby membersofall these groups, but the voles neWebiene
`monywith the permanence of printed books. Publishing !
`ous. ees
`URLsin the book would have been risky, because changes are ma
`y.
`For
`these and other reasons, We have established a Companion Website to accom-
`panythis book. Wehopethat every readerwill visit the site, and that you will
`not hesitate to send usideas for improvingit.
`In addition to pointers to current web resources, a variety of supplemental
`materials for this text are available at the book’s Companion Website. The fol-
`lowingare accessible to all readers whoregister using the prepaid access card in
`the front of this book:
`* Links to hundreds of human-computer interaction resources, examples, and
`research studies that enhance and expand on the material in each chapter
`* Chapter/section summaries
`* Self-test questions anddiscussion questions for each chapter
`¢ Homework assignments and projects
`PowerPointlectureslides are also available from Addison-Wesley’s Instruc-
`tor Resource Center (http://www.pearsonhighered.com/irc /). For information
`about accessing these instructor’s supplements,visit the Instructor Resource
`Centeror send an e-mail to computing@aw.com.
`
`ing partnership on the Companipanion Website and fyture editions.
`
`x
`
`Preface
`
`hers
`
`Writing is a lonely process; revising is a social one. We are
`
`Acknowledgments
`aaSeeandstudentswhohavemadesuggestionsforaid:
`aieene ae pene appreciate the strong contributions from Maxine
`aera Ee
`, Y ‘ and 12 and Steven M.Jacobsto Chapters 3, 7, 10,
`eee Cee et elp throughoutthe book. Their experiences both in
`Tyandin teaching with theearlier editions of the book over the course of
`manyyears added valuable perspecti
`eat a
`perspectives to this fifth edition. A
`=
`ieee aek coated smoothly by using e-mail ee aoie
`ae YE or hour-long phonecalls eve
`Is
`t ae k
`eee ae = yous and appropriate esr radeths
`bat
`time constraints. We look forward to a continu-
`
`i
`
`Tsonaliti
`
`n
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 16 of 28
`Page 16 of 28
`
`

`

`Preface
`
`xi
`
`Ourclose daily collaborators at the University of Maryland have a profound
`influence on our work: many thanks to Ben Bederson, Allison Druin, Francois
`Guimbretiére, Kent Norman, Doug Oard, Jennifer Preece, Anne Rose, and Vibha
`Sazawal. Wealso appreciate the undergraduate and graduate students whopro-
`vide encouraging feedback and challenging questions, plus the motivation to
`keep updating this book.
`Extensive comments from the review panel playedastrong role in ourrevi-
`sions. These individuals made numerousconstructive suggestions:
`Harry Hochheiser, Towson University
`Juan Pablo Hourcade, University of Iowa
`Richard D. Manning, Nova Southeastern University
`Chris North, Virginia Tech
`Jeff Offutt, George Mason University
`
`
`
`In addition, several colleagues responded to requests or commented gener-
`ously on certain chapters or sections about which they were especially knowl-
`edgeable: thanks to Christopher Andrews, Patrick Baudisch, Justine Cassell,
`Nick Chen, David Doermann, Cody Dunne, Jean-Daniel Fekete, Dennis Gal-
`letta, Jennifer Golbeck, Art Graesser, Chang Hu, Bonnie John, Lewis Johnson,
`Matt Kirschenbaum,Kari Kraus, Alex Quinn, Kiki Schneider, HyunyoungSong,
`Michael Twidale and Bo Xie.
`Thanks also to Jonathan Feinberg, creator of the clever and free Wordle
`(http://www.wordle.net/), which we used to make the chapter opening graph-
`ics. These graphics are based on word frequencies in each chapter and are used
`per the terms of the Creative CommonsAttribution 3.0 United States License.
`The publisher’s editorial and production staff were actively involved in this
`book from the start. We appreciate the contributions of Michael Hirsch, Jeffrey
`Holcomb,Stephanie Sellinger, Bethany Tidd, Linda Knowles, and Joyce Cosentino
`Wells. At Nesbitt Graphics, we thank Rose Kernan, Paul Fennessy, Risa Clow, and
`Jerilyn Bockorick. The copyeditor for the fourth and fifth editions, Rachel Head,
`taught us a lot about lucid and informative writing. We apologize if we haveleft
`out any other contributors. Finally, a further thanks goes to the students and
`professionals from around the world who have sent us comments and sugges-
`tions. Their provocative questions about our growingdiscipline and profession
`encourageus daily.
`
`Ben Shneiderman (ben@cs.umd.edu)
`Catherine Plaisant(plaisant@cs.umd.edu)
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 17 of 28
`Page 17 of 28
`
`

`

`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 18 of 28
`Page 18 of 28
`
`

`

`Direct Manipulation and Virtual Environments
`CHAPTER 5
`Menu Selection, Form Fill-in, and Dialog Boxes
`CHAPTER 6
`Command and Natural Languages
`271
`CHAPTER 7
`Interaction Devices
`303
`CHAPTER 8
`|
`
`
`CHAPTER 9=Collaboration and Social Media Participation 359
`
`
`
`
`
`
`
`
`
`Brief Contents Preface
`
`vii
`INTRODUCTION 1
`
`
`
`part I
`
`CHAPTER 1
`CHAPTER 2.
`
`3
`Usability of Interactive Systems
`Guidelines, Principles, andTheories
`
`55
`
`part D DEVELOPMENT PROCESSES
`
`95
`
`CHAPTER 3. Managing Design Processes
`CHAPTER 4
`Evaluating Interface Designs
`
`97
`131
`
`PART INTERACTION STYLES
`
`171
`
`173
`225
`
`
`606
`
`part 4 DESIGN ISSUES 403
`
`
`
`405
`CHAPTER 10 Quality of Service
`433
`CHAPTER 11. Balancing Function and Fashion
`CHAPTER 12 User Documentation and Online Help
`CHAPTER 13
`Information Search
`513
`CHAPTER 14
`Information Visualization
`
`537
`
`477
`
`Afterword
`
`563
`
`Societal and Individual Impact of User Interfaces
`Name index
`581
`Subject index 591
`Acknowledgments
`About the Authors
`
`
`|
`
`603
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 19 of 28
`Page 19 of 28
`
`
`
`
`
`
`
`
`
`
`
`

`

`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 20 of 28
`Page 20 of 28
`
`

`

`Contents Preface
`
`vii
`
`part | INTRODUCTION|1
`
`
`CHAPTER |
`Usability of Interactive Systems
`3
`1.1.
`Introduction 4
`
`
`1.2 Usability Goals and Measures
`1.3 Usability Motivations
`15
`
`1.4 Universal Usability 22
`
`1.5 Goals for Our Profession
`37
`Guidelines, Principles, andTheories
`2.1
`Introduction 56
`2.2 Guidelines
`57
`2.3
`Principles
`62
`2.4 Theories
`79
`
`
`
`
`
`
`
`
`
`|
`
`i
`
`;
`
`|
`.
`
`|
`
`CHAPTER 2
`
`13
`
`55
`
`part D DEVELOPMENT PROCESSES 95
`CHAPTER 3 Managing Design Processes
`97
`3.1.
`Introduction
`98
`3.2. Organizational Design to Support Usability
`3.3.
`The Four Pillars of Design
`102
`3.4 Development Methodologies
`3.5 Ethnographic Observation
`111
`3.6
`Participatory Design
`114
`3.7.
`Scenario Development
`116
`3.8
`Social Impact Statement for Early Design Review 119
`3.9 Legallssues
`122
`Evaluating Interface Designs
`4.1.
`Introduction
`132
`
`CHAPTER 4
`
`131
`
`99
`
`108
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`134
`4.2 ExpertReviews
`4.3. UsabilityTesting and Laboratories
`4.4
`Survey lnstruments
`149
`
`
`138
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 21 of 28
`Page 21 of 28
`
`
`
`

`

`171
`PART INTERACTION STYLES
`CHAPTER 2
`Direct Manipulation andVirtual Environments
`5.1
`Introduction
`174
`5.2
`Examples of Direct Manipulation
`175
`5.3. Discussion ofDirect Manipulation
`193
`5.4
`3DInterfaces
`200
`5.5 Teleoperation 205
`5.6 Virtual and AugmentedReality 209
`MenuSelection,Form Fill-in, and Dialog Boxes 225
`6.1.
`Introduction
`226
`6.2
`Task-Related Menu Organization 227
`6.3
`Single Menus
`228
`6.4 Combinations of Multiple Menus
`6.5 Content Organization
`244
`250
`6.6
`Fast Movement through Menus
`6.7 Data Entry with Menus: Form Fill-in, Dialog Boxes,
`and Alternatives
`251
`
`ed Interfaces: Different Place,
`
`286
`
`331
`
`305
`
`281
`Naming and Abbreviations
`Natural Language in Computing
`Interaction Devices 303
`8.1
`Introduction 304
`8.2 Keyboards and Keypads
`8.3
`Pointing Devices
`311
`8.4
`Speech and Auditory Interfaces
`8.5
` Displays-Small and Large
`341
`i
`Collaboration and Soci
`al Media Participati
`9.1
`Introduction
`360
`omker
`9.2
`Goals of Collaborati
`93
`tion
`and Participation
`363
`AsynchronousDi
`stribut
`:
`Di
`ee
`DifferentTime
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 22 of 28
`Page 22 of 28
`
`Contents
`
`154
`
`45 AcceptanceTests
`4.6
`Evaluation During Active Use Be aat om
`47 Controlled Psychologically Oriente
`p
`
`173
`
`236
`
`6.8 Audio Menus and Menus for Small Displays
`
`259
`
`Commandand Natural Languages
`7.1
`Introduction
`272
`72
`Command-Organization Functionality, Strategies, and
`Structure
`276
`
`271
`
`73
`74
`
`cHapter ©
`
`CHAPTER /
`
`CHAPTER 8
`
`CHAPTER 9
`
`

`

`Contents
`
`xvii
`
`9.4
`
`9.5
`
`Synchronous Distributed Interfaces: Different Place,
`SameTime
`383
`
`Face-to-Face Interfaces: Same Place, SameTime
`
`389
`
`part 4 DESIGN ISSUES 403
`cHapTeR 10 Quality of Service 405
`10.1
`Introduction 406
`
`407
`
`422
`
`554
`
`10.2 Models of Response-Time Impacts
`10.3 Expectations andAttitudes
`416
`10.4 User Productivity 420
`10.5 Variability in ResponseTime
`10.6 Frustrating Experiences 423
`CHAPTER | | Balancing Function and Fashion 433
`11.1
`Introduction
`434
`11.2 Error Messages
`435
`11.3 Nonanthropomorphic Design
`11.4 Display Design
`445
`11.55 Web Page Design 451
`11.6 Window Design
`456
`11.7 Color 465
`
`440
`
`CHAPTER 12 User Documentation and Online Help 477
`12.1 Introduction 478
`12.2 Online Versus Paper Documentation 480
`12.3 Reading from Paper Versus from Displays 483
`12.4 Shaping the Content of the Documentation 486
`12.5 Accessing the Documentation 491
`12.6 OnlineTutorials and Animated Demonstrations 499
`12.7. Online Communities for User Assistance
`504
`12.8 The Development Process
`506
`
`CHAPTER 13.
`
`Information Search 513
`13.1 Introduction 514
`13.2 Searching inTextual Documents and Database Querying
`13.3 Multimedia Document Searches
`525
`13.4 AdvancedFiltering and Search Interfaces
`
`527
`
`517
`
`CHAPTER 14.
`
`Information Visualization 537
`14.1 Introduction
`538
`14.2 DataType byTaskTaxonomy 539
`14.3 Challengesfor Information Visualization
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 23 of 28
`Page 23 of 28
`
`

`

`
`
`xviii
`
`Contents
`
`Afterword
`
`
`
`Societal and Individual Impact of UserInterfaces 563
`A.1
`Future Interfaces
`564
`mation Age
`A2
`Ten Plagues of the Infor
`s
`5/73
`A.3 Continuing Controversie
`Name index
`581
`Subjectindex 591
`Acknowledgments
`About the Authors
`
`603
`606
`
`569
`
`
`
`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 24 of 28
`Page 24 of 28
`
`

`

`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 25 of 28
`Page 25 of 28
`
`

`

`456
`
`Chapter 11. Balancing Function and Fashion
`
`zoomable mash-up of Google Maps and Microsoft's Virtual Earth™, Mash-
`upsarepart of an ongoing shift towards a more interactiveand participatory
`World Wide Web aimed at enhancing creativity, collaboration, and function-
`ality. The Web offers an ever-increasing selection of user-generated content
`and services.
`Mash-ups are often created using Ajax, a group of
`interrelated web-
`developmenttechniques used for creating interactive web applications orrich
`Internet applications. With Ajax, web applications can retrieve data from the
`server asynchronously in the background withoutinterfering with the display
`and behaviorof the existing page.
`The recent emergence of web mash-ups and open-source softwareis driving
`the developmentof newpractices in software and systems development(Jones
`et al., 2007). In the area of user-generated content, designers can rapidly create
`website applications by combining pre-existing software components. Current
`World Wide Webtechnologies suchas these permit rapid user interface proto-
`typing and application development, reduce the development risk, and reduce
`the time-to-market for new websites.
`
`11.6 Window Design
`
`
`
`Computer users frequently have to consult documents, forms, e-mail mes
`sages, web pages, and more to complete their tasks. For example, a travel
`agent may jump from reviewinga client’s e-mail request to viewing the pro-
`posed itinerary to reviewing calendars and flight schedules to choosing seat
`assignments andselecting hotels. Even with large desktop displays, there is a
`limit to how many documentscan be displayed simultaneously. An increasing
`numberofusersare adoptinglarge, multi-monitor displays, but without suffi-
`cient visual cues on such display workstations, they can they miss details
`(Hoffmanet al., 2008).
`Designers havelong struggled with strategiesto offer users sufficient informa-
`tion andflexibility to accomplish their tasks while reducing window-housekeeping
`actions and minimizing distracting clutter. If users’ tasks are well understood
`and regular, there is a good chancethat an effective multiple-window display
`strategy can be developed. The travel agent, for example, might start a client-
`itinerary window,review flight segmentsin a schedule window, and dragselect
`flight segments to theitinerary window. Windowslabeled eCalendar 1 UGeat Selec
`tion,” “Food Preferences,” and “Hotels” might appear as needed with a charg
`card information window appearingat the end to complete the transaction.
`If window-housekeeping actions can be reduced, users can complete their
`tasks more rapidly, and probably with fewer micas The visual nature of wit
`
`
`
`
`
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 26 of 28
`Page 26 of 28
`
`

`

`
`
`11.6 Window Design
`
`457
`
`seedesigners toapplydirect-manipulationstrategies ( Chapter5)
`,
`dow ae
`has led m
`i
`‘
`;
`to windowactions.To stretch, move, and scroll a wind
`:
`inte icone een d
`,
`: Ow, Users can point at
`OOOOed
`e window border and simply click on the mouse button
`and drAe since the dynamics of windows havea strong effect on user percep-
`tions, the animations for transitions (zooming boxes, Trepainting when a window
`is openedorclosed,blinking outlines, or highlighting during dragging) must be
`designedcarefully,
`Window design evolved rapidly in the 1980s from influential designs at
`Xerox PARC to innovative syntheses by Apple for the Macintosh (Fig. 1.1) and
`finally Microsoft’s modestrefinements, which led to the highly successful Win-
`dowsseries (1.0, 2.0, 3.1, 95, 98, 2000, NT, ME, XP, and Vista; Fig. 1.2), Overlap-
`ping, draggable, resizable windows on a broad desktop have become the
`standard for most users. Advanced users who work on multiple tasks can
`switch amongcollections of windowscalled “workspaces” or “rooms”; each
`workspace holds several windows whose states are saved, allowing easy
`resumption ofactivity. Much progress has been made,butthereisstill an Oppor-
`tunity to reduce dramatically the housekeeping chores tied to individual win-
`dowsandto providetask-related multiple-window coordination.
`
`11.6.1 Coordinating multiple windows
`Designers may break throughto the next generation of window managers by
`developing coordinated windows: windows that appear, change contents, and
`close as a direct result of user actions in the task domain. For example, ina
`medical insurance claims-processing application, when the agentretrieves
`information abouta client, suchfieldsasthe client’s address, telephone num-
`ber, and membership number should be automatically filled ao on the display.
`Simultaneously, and with no additional commands,the client s medical saat
`might appear in a second window,and the record of previous wee mig ;
`appearin a third window.A fourth window might contain a form ai : .soe
`to complete to indicate payment or exceptions. Scrollingthe me igthsory
`window might produce a synchronized scroll of the previous-c ane yen
`to show related information. Whenthe claim is completed, atwin owe ae
`should be saved andall the windows should be closed with one
`.
`i
`or by users with end-user
`sequencesof actions can be established by designersorDy
`nO
`ing
`tools.
`lyorriganan
`waae Poes a of then synchronously to com-
`click. Then, it should be possible to explore allo eeing2
`Whe eae Gesephon lesan ae ie and the other four should
`When onepositionis selected,it shouldfill the screen,
`close automatically.
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT 1013
`Page 27 of 28
`Page 27 of 28
`
`

`

`Designing the User Interface: Strategies for Effective Human-
`Computer. Interaction provides a comprehensiveintroduction to the
`CoMaeetuattom itloo UaeTomoCclalinncclevaio GUC)BYATMoor-Tiretete leytrtaye
`USI<cmnoeleal|lle] industry and academic experienceto this latest
`edition. Practical techniques, research-supported design guidelines, and
`a multitude of current CTToSLTemreAlCcMStet good design princi-
`ples and practices, effectively guiding readers LUlColdm usta Tesal Ol
`design projects.
`
`Page 28 of 28
`
`|SBN-13; 978-0
`Rah
`es
`
`| |
`
`> a
`
`UNIFIED PATENTS EXHIBIT 1013
`UNIFIED PATENTS EXHIBIT1013
`Page 28 of 28
`
`ben snneiderman & Catherine Plaisant
`written in collaboration with Maxine $. Cohen & Steven M. Jacobs
`
`TheFifth Edition addresses the profound changes engendered Ie
`SUTehte Retellainomenete} Participation, which increase the
`heed for CorelaaToYAIITAeam Stela=401a-tete Topics covered include:
`
`Current HCl issues, with balanced emphasis on mobile devices,
`the Web, and desktop platforms
`Innovations in social media and social networking
`°
`SCOR OMEeat quality of user-generated content
`° Universal usability, sustainable oC MLC CUSET
`Spam,privacy, security, and other CLOlanleeTay mouees
`Internationalization issues and customization of CSTte
`electronics
`MCCUTCHEONMelalrery| products
`
`The Companion Website (www.aw.com/DTUI) includes quizzes,links,
`discussion questions, additional practice opportunities, and LEMON(eX45
`for both students and professors.
`
`Addison-Wesley
`isanimprint of
`
`r
`f
`A
`Visit www.pearsonhighered.com/cs for more information
`our products, contact our customer service department
`5+ (g00) 824-7799 or (201) 767-5021 outside of the
`U.S., or visit your campus bookstore.
`
`aboutAddison-Wesleycomputingbooks.Toorderanyof
`
`PYreuy4
`RFsTaeCeMm OU eye(Cc)
`
`99000
`
`>
`
`|
`
`