`
`IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`In re Patent of: Magnus Goertz
`U.S. Patent No.:
`8,095,879 Attorney Docket No.: 50095-0015IP1
`Issue Date:
`January 10, 2012
`
`Appl. Serial No.: 10/315,250
`
`Filing Date:
`December 10, 2002
`
`Title:
`USER INTERFACE FOR MOBILE HANDHELD COMPUTER
`UNIT
`
`DECLARATION OF DR. BENJAMIN B. BEDERSON
`
`Page 1
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`
`TABLE OF CONTENTS
`
`
`INTRODUCTION .......................................................................................... 7
`I.
`BACKGROUND AND QUALIFICATIONS ................................................ 7
`II.
`INFORMATION CONSIDERED ............................................................... 21
`III.
`IV. RELEVANT LEGAL STANDARDS .......................................................... 24
`A.
`Claim Interpretation ........................................................................... 24
`B.
`Perspective of One of Ordinary Skill in the Art ................................ 24
`
`Anticipation ........................................................................................ 25
`C.
`D. Obviousness ....................................................................................... 25
`SUMMARY OF MY OPINIONS ................................................................ 28
`V.
`VI. THE ’879 PATENT ..................................................................................... 29
`A. Alleged Invention ............................................................................... 29
`B.
`The ’879 Patent Prosecution History ................................................. 34
`C.
`Priority Date ....................................................................................... 37
`D.
`Level of Ordinary Skill in the Art ...................................................... 38
`E.
`Claim Construction ............................................................................ 39
`VII. The Prior Art ................................................................................................ 39
`A. Well Known Devices and User Interface Design Considerations ..... 39
`B.
`Ren (EX1004) .................................................................................... 43
`C.
`Hirayama307 (EX1006) ..................................................................... 45
`
`D.
`E.
`
`Tanaka (EX1005) ............................................................................... 48
`Allard (EX1010) and IBM Simon (EX1011) ..................................... 50
`
`Page 2
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`Henckel (EX1013) ............................................................................. 52
`F.
`G. Hirayama878 (EX1009) ..................................................................... 53
`H. Motivation to Combine Ren, Tanaka, Hirayama307,
`Hirayama878, and Allard ................................................................... 53
`Jermyn (EX1014) ............................................................................... 54
`I.
`VIII. DETAILED EXPLANATION OF UNPATENTABILITY ......................... 58
`A.
`Claims 1, 14, 15, 16, and 17 are rendered obvious by the
`combination of Ren and Tanaka ........................................................ 58
`1.
`Claim 1 .................................................................................... 58
`
`4.
`
`5.
`
`B.
`
`2.
`
`3.
`
`Claim 14: The computer readable medium of claim 1,
`wherein the touch sensitive area is 2-3 inches in diagonal
`dimension. ................................................................................ 84
`Claim 15: The computer readable medium of claim 1,
`characterised in, that said computer program code is
`adapted to function as a shell upon an operating system. ........ 85
`Claim 16: The computer readable medium of claim 1,
`wherein the representation is finger-sized. .............................. 87
`Claim 17: The computer readable medium of claim 1,
`wherein the location where the representation is provided
`does not provide touch functionality for a different
`function. ................................................................................... 88
`Claims 2, 4, and 5 are rendered obvious by the combination of
`Ren, Tanaka, and Hirayama307 ......................................................... 90
`1.
`Claim 2: The computer readable medium of claim 1,
`wherein the function, when activated, causes the user
`interface to display icons representing different services
`or settings for a currently active application. .......................... 90
`Claim 4: The computer readable medium of claim 1,
`wherein the function, when activated, causes the user
`interface to display a keyboard and a text field. ...................... 92
`Page 3
`EX1002
`
`2.
`
`

`

`3.
`
`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`Claim 5: The computer readable medium of claim 4,
`wherein said text field is used for inputting and editing of
`text through said keyboard. ..................................................... 95
`Claim 3 is rendered obvious by the combination of Ren,
`Tanaka, Hirayama307, and alternatively Hirayama878 .................... 97
`1.
`Claim 3: The computer readable medium of claim 2,
`wherein the user interface is characterised in, that a
`selection of a preferred service or setting is done by
`tapping on a display icon corresponding to the preferred
`service or setting. ..................................................................... 97
`Claims 6 and 13 are rendered obvious by the combination of
`Ren, Tanaka, and Allard .................................................................. 101
`1.
`Claim 6: The computer readable medium of claim 1,
`wherein the function, when activated, causes the user
`interface to display a list with a library of available
`applications and files on the mobile handheld computer
`unit. ........................................................................................ 101
`Claim 13: The computer readable medium of claim 1,
`wherein the user interface is characterised in, that said
`representation of said function is located at the bottom of
`said touch sensitive area. ....................................................... 104
`Claim 12 is rendered obvious by the combination of Ren,
`Tanaka, and Henckel ........................................................................ 107
`1.
`Claim 12: The computer readable medium of claim 1,
`wherein the user interface is characterised in, that an
`active application, function, service or setting is
`advanced one step by gliding the object along the touch
`sensitive area from left to right, and that the active
`application, function, service or setting is closed or
`backed one step by gliding the object along the touch
`sensitive area from right to left. ............................................. 107
`Claims 1, 2, 4, 5, 14, 15, 16, and 17 are rendered obvious by the
`combination of Hirayama307 and Ren ............................................ 109
`
`2.
`
`C.
`
`D.
`
`E.
`
`F.
`
`Page 4
`EX1002
`
`

`

`1.
`2.
`
`3.
`
`4.
`
`5.
`
`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`Claim 1 .................................................................................. 109
`Claim 2: The computer readable medium of claim 1,
`wherein the function, when activated, causes the user
`interface to display icons representing different services
`or settings for a currently active application. ........................ 126
`Claim 4: The computer readable medium of claim 1,
`wherein the function, when activated, causes the user
`interface to display a keyboard and a text field. .................... 128
`Claim 5: The computer readable medium of claim 4,
`wherein said text field is used for inputting and editing of
`text through said keyboard. ................................................... 129
`Claim 14: The computer readable medium of claim 1,
`wherein the touch sensitive area is 2-3 inches in diagonal
`dimension. .............................................................................. 131
`Claim 15: The computer readable medium of claim 1,
`characterised in, that said computer program code is
`adapted to function as a shell upon an operating system. ...... 132
`Claim 16: The computer readable medium of claim 1,
`wherein the representation is finger-sized. ............................ 133
`Claim 17: The computer readable medium of claim 1,
`wherein the location where the representation is provided
`does not provide touch functionality for a different
`function. ................................................................................. 135
`Claim 3 is rendered obvious by the combination of
`Hirayama307, Ren, and Hirayama878 ............................................. 136
`1.
`Claim 3: The computer readable medium of claim 2,
`wherein the user interface is characterised in, that a
`selection of a preferred service or setting is done by
`tapping on a display icon corresponding to the preferred
`service or setting. ................................................................... 136
`Claims 6 and 13 are rendered obvious by the combination of
`Hirayama307, Ren, and Allard ........................................................ 140
`Page 5
`EX1002
`
`6.
`
`7.
`
`8.
`
`G.
`
`H.
`
`

`

`1.
`
`2.
`
`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`Claim 6: The computer readable medium of claim 1,
`wherein the function, when activated, causes the user
`interface to display a list with a library of available
`applications and files on the mobile handheld computer
`unit. ........................................................................................ 140
`Claim 13: The computer readable medium of claim 1,
`wherein the user interface is characterised in, that said
`representation of said function is located at the bottom of
`said touch sensitive area. ....................................................... 142
`
`I.
`
`J.
`
`Claim 12 is rendered obvious by the combination of
`Hirayama307, Ren, and Henckel ..................................................... 145
`1.
`Claim 12: The computer readable medium of claim 1,
`wherein the user interface is characterised in, that an
`active application, function, service or setting is
`advanced one step by gliding the object along the touch
`sensitive area from left to right, and that the active
`application, function, service or setting is closed or
`backed one step by gliding the object along the touch
`sensitive area from right to left. ............................................. 145
`Claims 1, 14, and 15 are rendered obvious by Jermyn .................... 147
`1.
`Claim 1 .................................................................................. 147
`2.
`Claim 14: The computer readable medium of claim 1,
`wherein the touch sensitive area is 2-3 inches in diagonal
`dimension. .............................................................................. 160
`Claim 15: The computer readable medium of claim 1,
`characterised in, that said computer program code is
`adapted to function as a shell upon an operating system. ...... 162
`IX. CONCLUSION .......................................................................................... 164
`
`
`
`3.
`
`
`
`Page 6
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`I, Dr. Benjamin B. Bederson, declare as follows:
`
`1.
`
`I.
`
`INTRODUCTION
`2.
`I have been retained by Samsung Electronics Co., Ltd., and Samsung
`
`Electronics America, Inc. and Apple Inc. (collectively, “Petitioners”) as an
`
`independent expert consultant in this inter partes review (“IPR”) proceeding
`
`before the United States Patent and Trademark Office (“PTO”).
`
`3.
`
`I have been asked by Petitioners’ counsel (“Counsel”) to consider
`
`whether certain references teach or suggest the features recited in Claims 1-6, and
`
`12-17 of U.S. Patent No. 8,095,879, (“the ’879 Patent”) (EX1001). My opinions
`
`and the bases for my opinions are set forth below.
`
`4.
`
`I am being compensated at my ordinary and customary consulting rate
`
`for my work, which is $600 per hour. My compensation is in no way contingent
`
`on the nature of my findings, the presentation of my findings in testimony, or the
`
`outcome of this or any other proceeding. I have no other financial interest in this
`
`proceeding.
`
`II. BACKGROUND AND QUALIFICATIONS
`5.
`All of my opinions stated in this declaration are based on my own
`
`personal knowledge and professional judgment. In forming my opinions, I have
`
`relied on my knowledge and experience in designing, developing, researching, and
`
`teaching the technology referenced in this declaration.
`
`Page 7
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`I am over 18 years of age and, if I am called upon to do so, I would be
`
`6.
`
`competent to testify as to the matters set forth herein. I understand that a copy of
`
`my current curriculum vitae, which details my education and professional and
`
`academic experience, is being submitted as EX1008. The following provides a
`
`brief overview of some of my experience that is relevant to the matters set forth in
`
`this declaration.
`
`7.
`
`I am currently Professor Emeritus of Computer Science at the
`
`University of Maryland (“UMD”). From 2014 to 2018, I was the Associate
`
`Provost of Learning Initiatives and Executive Director of the Teaching and
`
`Learning Transformation Center at the UMD. I am a member and previous
`
`director of the Human-Computer Interaction Lab (“HCIL”), the oldest and one of
`
`the best known Human-Computer Interaction (“HCI”) research groups in the
`
`country. I was also co-founder and Chief Scientist of Zumobi, Inc. from 2006 to
`
`2014, a Seattle-based startup that is a publisher of content applications and
`
`advertising platforms for smartphones. I am also co-founder and co-director of the
`
`International Children’s Digital Library (“ICDL”), a web site launched in 2002 that
`
`provides the world’s largest collection of freely available online children’s books
`
`from around the world with an interface aimed to make it easy for children and
`
`adults to search and read children’s books online. I am also cofounder and Chief
`
`Technology Officer of Hazel Analytics, a data analytics company to improve food
`
`Page 8
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`safety and better public health whose product sends alerts in warranted
`
`circumstances. In addition, I have for more than 25 years consulted for numerous
`
`companies in the area of user interfaces, including Hillcrest Labs, Lockheed
`
`Martin, Logitech, Microsoft, NASA Goddard Space Flight Center, the Palo Alto
`
`Research Center, and Sony.
`
`8.
`
`The devices and methods claimed in the ’879 Patent generally relate
`
`to user interface technology for electronic devices. For more than 30 years, I have
`
`studied, designed, and worked in the field of computer science and HCI. My
`
`experience includes 30 years of teaching and research, with research interests in
`
`HCI and the software and technology underlying today’s interactive computing
`
`systems. This includes the design and implementation of hardware and software
`
`systems including the use of capacitive and other sensors, and interactive
`
`applications on a range of devices, including embedded systems, controllers, smart
`
`phones and PDAs.
`
`9.
`
`At UMD, I am focused primarily on the area of HCI, a field that
`
`relates to the development and understanding of computing systems to serve users’
`
`needs. Researchers and practitioners in this field are focused on making
`
`universally usable, useful, efficient, and appealing systems to support people in
`
`their wide range of activities. My approach is to balance the development of
`
`innovative technology that serves people’s practical needs. Example systems
`
`Page 9
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`following this approach that I have built include Cortex-I (1992 embedded
`
`computer vision system that sensed licensed plates with custom motor, camera and
`
`controller), Audio Augmented Reality (1995 embedded system for sensing a user’s
`
`location and playing audio suited to that location), Fisheye Menus (2000 software
`
`for sensing movement within and selection of linear list of items in a menu),
`
`PhotoMesa (2001 software for end users to browse personal photos), DateLens
`
`(2002 software for end users to use their mobile devices to efficiently access their
`
`calendar information), SlideBar (2005 linear sensor to control scrolling),
`
`LaunchTile (2005 “home screen” software for mobile devices to allow users to
`
`navigate apps in a zoomable environment), SpaceTree (2001 software for end users
`
`to efficiently browse very large hierarchies), ICDL (as described above), and
`
`StoryKit (a 2009 iPhone app for children to create stories).
`
`10. Throughout the 1990s and 2000s, I worked on a range of “zoomable
`
`user interfaces,” which are systems that support the multi-scale and spatial
`
`organization of and magnification-based navigation among multiple documents or
`
`visual objects. I built several different “ZUI” systems over the years, including
`
`Pad++, Jazz and Piccolo. In those systems, I used a range of solutions to allow
`
`users to control zooming through the information space. The most common
`
`approach for systems with three button mice was to use the middle button for
`
`zooming in and the right button for zooming out. The user would hold the button
`
`Page 10
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`down, and the system would smoothly animate zooming in or out – so that the user
`
`controlled how much the system zoomed based on the duration that the button was
`
`pressed.1
`
`11.
`
`In 1995 and 1996, I supervised graduate student David Rogers and
`
`other students in the development of a user interface approach that allowed a user
`
`to “toss” an object across long distances on their screen with their mouse.
`
`Motivated by increasingly large computer screens, we recognized a need to help
`
`users move items long distances without necessarily having to drag the item that
`
`entire distance manually. Instead, we calculated the speed and direction that the
`
`user dragged an object with their mouse. When a user released the mouse button,
`
`if the speed was greater than a threshold, our code calculated the path of where to
`
`animate the object based on several factors including the speed and direction of the
`
`mouse at the time of mouse button release. The figure below from a paper we
`
`wrote in 1996 shows the path of a tossed object. This resulted in David Rogers’s
`
`
`
` Benjamin B. Bederson & James D. Hollan, Pad++: A Zooming Graphical
`
` 1
`
`Interface for Exploring Alternate Interface Physics, USIT ’94 Proceedings of the
`
`7th Annual ACM Symposium on User Interface Software and Technology 17
`
`(1994), DOI: http://dx.doi.org/10.1145/192426.192435 (EX1015).
`
`Page 11
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`masters thesis in 1995 and a paper that we submitted to the 1996 Conference on
`
`Human Factors in Computing Systems (CHI 1996)2.
`
`Exemplar Figure of Tossing3.
`
`12.
`
`In 1999 and 2000, I worked on a mechanism to address the challenge
`
`
`
`
`
` David Rogers et al., Tossing Objects in a Desktop Environment, submitted to
`
` 2
`
`Conference on Human Factors in Computing Systems (1996) (EX1016).
`
`3 EX1016.
`
`Page 12
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`that users faced when selecting one item from a long menu. As I described in a
`
`paper entitled “Fisheye Menus” that I published in the 2000 Proceedings of the
`
`ACM Symposium on User Interface Software and Technology,4 existing
`
`techniques typically involved lengthy and slow scrolling techniques. I created an
`
`alternative solution that fit all of the elements onto a single screen thereby
`
`completely eliminating the need to scroll. This approach used the concept of
`
`“fisheye distortion” to shrink some of the elements, while keeping the elements
`
`that are under the cursor to be full size so the user could easily see and select them.
`
`This approach as depicted in the figure below and described further at EX1017,
`
`was later used in a number of commercial products such as the Apple MacOS
`
`Dock.
`
`Page 13
`EX1002
`
`
`
` Benjamin B. Bederson, Fisheye Menus, UCIT ’00 Proceedings of ACM
`
` 4
`
`Conference on User Interface Software and Technology 217 (2000), DOI:
`
`10.1145/354401.317382 (EX1017).
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`
`EX1017 at Figure 2.
`
`
`
`13. Starting in 2000, I supervised graduate student Leslie Chipman who
`
`was working on a general solution to improve the user experience of people
`
`scrolling long documents on computers. Our solution relied on a passive haptic
`
`physical linear input device we called the “Slidebar.” The Slidebar was designed
`
`to sit on either side of the keyboard to be used with the non-dominant hand for
`
`scanning and rough positioning, and then if the user wanted to switch to reading,
`
`the dominant hand could be used for more accurate positioning. With a physical
`
`range of motion of approximately two inches, the full range could be accessed by
`
`moving just the fingers without moving the entire hand. This took advantage of
`
`Page 14
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`human proprioception¾the fact that people have excellent ability to know where
`
`their body is¾and allowed the user to scroll long documents completely eyes-free.
`
`They did not need to look at the device or the screen to, for example, move a
`
`mouse pointer to a graphical scroll bar. Instead they could focus on their primary
`
`task of reading. This work was published in 2004.5
`
`14.
`
`In April 2000, I visited Professors Wayne Westerman and John Elias
`
`at the University of Delaware and gave a talk entitled “Zoomable User Interfaces
`
`and Single Display Groupware.” This resulted in a collaboration with Professor
`
`Westerman, graduate student Hilary Browne, and others where we used their
`
`FingerWorks capacitive Multi-Touch Surface as the input device for a multi-touch
`
`finger painting program for children. The project used this input device to support
`
`a computer painting program that allowed children to paint with their fingers by
`
`directly touching the sensing surface. In contrast to the mouse input more typically
`
`used in this time period, this approach enabled us to create a more natural
`
`interaction environment. This work, depicted in the figure below, was published in
`
`
`
` Leslie E Chipman et al., SlideBar: Analysis of a Linear Input Device, 23
`
` 5
`
`Behaviour & Info. Tech. 1 (2004), DOI: 10.1080/01449290310001638487
`
`(EX1018).
`
`Page 15
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`
`a September 2000 technical report.6
`
`
`
`EX1025, Figure 1.
`
`
`
`15. Throughout the 2000’s, I worked on a range of interfaces for mobile
`
`devices with a focus on interface design for touch interfaces, including those with
`
`capacitive sensors. During this period, it became apparent that some positions on a
`
`screen were easier to access than others, especially when used with a single hand.
`
`To understand this issue, I led a range of studies that resulted in two papers
`
`
`
` Hilary Browne et al., Designing a Collaborative Finger Painting Application for
`
` 6
`
`Children, HCIL-2000-17, CS-TR-4184, UMIACS-TR-2000-66 (Sept. 2000),
`
`available at https://hcil.umd.edu/pub-perm-link/?id=2000-17 (EX1019).
`
`Page 16
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`published in 20067 and 20078. The following figure summarizes the results of one
`
`of the studies, and shows that generally speaking, when using a single hand, the
`
`center of the screens were easier for users to touch than the edges of the screen,
`
`and that the corners of the screen were the hardest positions to touch.
`
`
`
` Pekka Parhi, Amy K. Karlson, and Benjamin B. Bederson. 2006. Target size
`
` 7
`
`study for one-handed thumb use on small touchscreen devices. In Proceedings of
`
`the 8th Conference on Human-Computer Interaction with Mobile Devices and
`
`Services (MobileHCI ’06). Association for Computing Machinery, New York, NY,
`
`USA, 203–210. DOI:https://doi.org/10.1145/1152215.1152260 (EX1020).
`
`8 Karlson, Amy & Bederson, Benjamin & Contreras-Vidal, José. (2008).
`
`Understanding One-Handed Use of Mobile Devices. Handbook of Research on
`
`User Interface Design and Evaluation for Mobile Technology. 86-101.
`
`DOI:10.4018/978-1-59904-871-0.ch006 (EX1021).
`
`Page 17
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`
`
`
`EX1021 at Table 2.
`
`16. This work on touch screen mobile devices led to my creation of
`
`Zumobi in 2006, where I was responsible for investigating new software platforms
`
`and developing new user interface designs that provide efficient and engaging
`
`interfaces to permit end users to access a wide range of content on mobile
`
`platforms (including the iPhone and Android-based devices). For example, I
`
`Page 18
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`designed and implemented software called “Ziibii,” a “river” of news for iPhone
`
`that used a capacitive sensor for controlling linear movement through news;
`
`software called “ZoomCanvas,” a zoomable user interface for several iPhone apps;
`
`and iPhone apps including “Inside Xbox” for Microsoft and Snow Report for REI.
`
`At the ICDL, I have since 2002 been the technical director responsible for the
`
`design and implementation of the web site, www.childrenslibrary.org (originally at
`
`www.icdlbooks.org). In particular, I have been closely involved in designing the
`
`user interface as well as the software architecture for the web site since its
`
`inception in 2002.
`
`17. Beginning in the mid-1990s, I have been responsible for the design
`
`and implementation of numerous other web sites in addition to the ICDL. For
`
`example, I designed and built my own professional web site when I was an
`
`Assistant Professor of Computer Science at the University of New Mexico in 1995
`
`and have continued to design, write the code for, and update both that site (which I
`
`moved to the UMD in 1998, currently at http://www.cs.umd.edu/~bederson/) as
`
`well as numerous project web sites, such as Pad++,
`
`http://www.cs.umd.edu/hcil/pad++/. I received the Janet Fabri Memorial Award
`
`for Outstanding Doctoral Dissertation for my Ph.D. work in robotics and computer
`
`vision. I have combined my hardware and software skills throughout my career in
`
`HCI research, building various interactive electrical and mechanical systems that
`
`Page 19
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`couple with software to provide an innovative user experience.
`
`18. My work has been published extensively in more than 160 technical
`
`publications, and I have given about 100 invited talks, including 9 keynote
`
`lectures. I have won a number of awards including the Brian Shackel Award for
`
`“outstanding contribution with international impact in the field of HCI” in 2007,
`
`and the Social Impact Award in 2010 from the Association for Computing
`
`Machinery’s (“ACM”) Special Interest Group on Computer Human Interaction
`
`(“SIGCHI”). ACM is the primary international professional community of
`
`computer scientists, and SIGCHI is the primary international professional HCI
`
`community. I have been honored by both professional organizations. I am an
`
`“ACM Distinguished Scientist,” which “recognizes those ACM members with at
`
`least 15 years of professional experience and 5 years of continuous Professional
`
`Membership who have achieved significant accomplishments or have made a
`
`significant impact on the computing field.” I am a member of the “CHI
`
`Academy,” which is described as follows: “The CHI Academy is an honorary
`
`group of individuals who have made substantial contributions to the field of HCI.
`
`These are the principal leaders of the field, whose efforts have shaped the
`
`disciplines and/or industry, and led the research and/or innovation in human-
`
`computer interaction.” The criteria for election to the CHI Academy are: (1)
`
`cumulative contributions to the field; (2) impact on the field through development
`
`Page 20
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`of new research directions and/or innovations; and (3) influence on the work of
`
`others.
`
`19.
`
`I have appeared on radio shows numerous times to discuss issues
`
`relating to user interface design and people’s use and frustration with common
`
`technologies, web sites, and mobile devices. My work has been discussed and I
`
`have been quoted by mainstream media around the world over 120 times, including
`
`by the New York Times, the Wall Street Journal, the Washington Post, Newsweek,
`
`the Seattle Post Intelligencer, the Independent, Le Monde, NPR’s All Things
`
`Considered, New Scientist Magazine, and MIT’s Technology Review.
`
`20.
`
`I have designed, programmed, and publicly deployed dozens of user-
`
`facing software products that have cumulatively had millions of users. My work is
`
`cited by several major companies, including Amazon, Apple, Facebook, Google,
`
`and Microsoft. I am a named inventor on 12 U.S. patents and 18 U.S. patent
`
`applications. The patents are generally directed to user interfaces/experience.
`
`21.
`
`I received a B.S. degree in Computer Science with a minor in
`
`Electrical Engineering in 1986 from the Rensselaer Polytechnic Institute. I
`
`received M.S. and Ph.D. degrees in Computer Science in 1989 and 1992, both
`
`from New York University.
`
`III.
`
`INFORMATION CONSIDERED
`22.
`In preparing this declaration, I have considered the materials
`
`Page 21
`EX1002
`
`

`

`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`discussed in this declaration, including, for example, the ’879 Patent, the
`
`references cited by the ’879 Patent, the prosecution histories of the ’879 Patent and
`
`applications derived therefrom (including the references cited therein), various
`
`background articles and materials referenced in this declaration, and the prior art
`
`references identified in this declaration. In addition, my opinions are further based
`
`on my education, training, experience, and knowledge in the relevant field.
`
`Description
`Exhibit No.
`Exhibit 1001 U.S. Patent No. 8,095,879 (“the ’879 patent”)
`Exhibit 1002 Declaration of Benjamin B. Bederson
`Exhibit 1003
`File History for U.S. Patent No. 8,095,879
`Exhibit 1004 Xiangshi Ren & Shinji Moriyama, “Improving Selection on Pen-
`Based Systems: A Study of Pen-Based Interaction for Selection
`Tasks,” ACM Transactions on Computer-Human Interaction,
`Vol. 7, No. 3, September 2000, pp. 384-416 (“Ren”)
`Exhibit 1005 U.S. Patent No. 5,249,296 (“Tanaka”)
`Exhibit 1006 U.S. Patent No. 5,406,307 (“Hirayama307”)
`Exhibit 1007 U.S. Patent No. 5,949,418 (“Shields”)
`Exhibit 1008 CV of Benjamin B. Bederson
`Exhibit 1009 U.S. Patent No. 6,100,878 (“Hirayama878”)
`Exhibit 1010 U.S. Patent No. 5,615,384 (“Allard”)
`Exhibit 1011
`IBM Simon Users Manual (1994)
`Exhibit 1012 Andrew Sears, et al., “A new era for touchscreen applications:
`High precision, dragging icons, and refined feedback,”
`ADVANCES IN HUMAN-COMPUTER INTERACTION, Vol. 3, R.
`Hartson, D. Hix, Ed. 1992 (“Sears”)
`Exhibit 1013 U.S. Patent No. 5,463,725 (“Henckel”)
`Exhibit 1014
`Jermyn, et al., “The Design and Analysis of Graphical
`Passwords,” Proceedings of the 8th USENIX Security
`Symposium, Washington, DC, USA, August 23-26, 1999
`(“Jermyn”)
`Exhibit 1015 Benjamin B. Bederson & James D. Hollan, Pad++: A Zooming
`Graphical Interface for Exploring Alternate Interface Physics,
`
`Page 22
`EX1002
`
`

`

`Exhibit 1020
`
`Declaration of Dr. Benjamin B. Bederson
`U.S. Patent No. 8,095,879
`USIT ’94 Proceedings of the 7th Annual ACM Symposium on
`User Interface Software and Technology 17 (1994), DOI:
`http://dx.doi.org/10.1145/192426.192435
`Exhibit 1016 David Rogers et al., Tossing Objects in a Desktop Environment,
`submitted to Conference on Human Factors in Computing
`Systems (1996)
`Exhibit 1017 Benjamin B. Bederson, Fisheye Menus, UCIT ’00 Proceedings
`of ACM Conference on User Interface Software and Technology
`217 (2000), DOI: 10.1145/354401.317382
`Exhibit