`
`____________
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
` ____________
`
`SONY COMPUTER ENTERTAINMENT AMERICA LLC
`Petitioner
`
`v.
`
`APLIX IP HOLDINGS CORPORATION
`Patent Owner
`
`____________
`
`Case No. IPR2015-00230
`Patent 7,463,245
` ____________
`
`
`
`SUPPLEMENTAL DECLARATION OF DR. GREGORY F. WELCH
`
`
`
`
`
`SCEA Ex. 1042 Page 1
`
`
`
`
`
`I, Gregory F. Welch, hereby declare the following:
`1.
`I have been asked to respond to certain issues raised by Patent Owner
`
`(“PO”) and their experts, Dr. Karon MacLean and Mr. Peng Lim, in Patent Owner
`
`Aplix IP Holdings Corporation’s Response to the Petition dated August 6, 2015
`
`(“Paper No. 19”). All of my opinions expressed in my original declaration dated
`
`November 7, 2014 (Ex. 1010) remain the same. I have reviewed the following
`
`additional materials in connection with preparing this supplemental declaration:
`
`•
`
`•
`
`•
`•
`
`•
`
`•
`
`•
`
`•
`
`•
`
`•
`
`•
`
`Paper No. 16, Decision Institution of Inter Partes Review dated May
`14, 2015;
`Paper No. 19, Patent Owner Aplix IP Holdings Corporation’s
`Response to the Petition dated August 6, 2015;
`Ex. 1026, Pen Computer Technology, Fujitsu PC Corporation (2002);
`Ex. 1029, Stylistic® ST4000 Series Tablet PC Technical Reference
`Guide, Fujitsu PC Corporation (2002);
`Ex. 1030, Paul Thurrott, Windows XP Tablet PC Edition Review (June
`25, 2002);
`Ex. 1039, Ben Chiu, Microsoft Flight Simulator 2000 Strategies &
`Secrets, Sybex, Inc. (1999);
`Ex. 1041, Transcript of the deposition of Peng Lim taken in IPR2015-
`00230, October 28, 2015;
`Ex. 1043, Ben Shneiderman. Designing the User Interface: Strategies
`for Effective Human-Computer
`Interaction. Addison-Wesley
`Longman Publishing Co., Inc., Boston, MA, USA, 3rd edition, 1997;
`Ex. 1044, Peter Tarasewich, “Wireless Devices
`for Mobile
`Commerce: User Interface Design and Usability”, Mobile Commerce:
`Technology, Theory, and Applications, Idea Group Publishing (2002);
`Ex.
`1045,
`Newton,
`Reconsidered,
`Harry McCracken,
`http://techland.time.com/2012/06/01/newton-reconsidered/print,
`accessed 11/23/15;
`Ex. 1046, Corin R. Anderson, Pedro Domingos, Daniel S. Weld, Web
`Site Personalizers for Mobile Devices, IJCAI Workshop on Intelligent
`Techniques for Web Personalization (ITWP) (2001);
`
`
`
`1
`
`SCEA Ex. 1042 Page 2
`
`
`
`
`
`I.
`
`•
`
`•
`
`•
`
` Ex. 1047, Parisa Eslambolchilar and Roderick Murray-Smith. Tilt-
`based automatic zooming and scaling in mobile devices – a state-
`space implementation. In S. Brewster and M. Dunlop, editors, Mobile
`Human-Computer Interaction - MobileHCI 2004, volume 3160 of
`Lecture Notes in Computer Science, pages 120–131. Springer Berlin
`Heidelberg, 2004;
`Ex. 1048, Jun Rekimoto. “Tilting operations for small screen
`interfaces.” In Proceedings of the 9th annual ACM symposium on
`User interface software and technology, UIST ’96, pages 167–168,
`New York, NY, USA, October 7–10 1996. ACM;
`Ex. 1049, Ken Hinckley, Jeff Pierce, Mike Sinclair, and Eric Horvitz.
`“Sensing techniques for mobile interaction.” In Proceedings of the
`13th Annual ACM Symposium on User Interface Software and
`Technology, UIST ’00, pages 91–100, New York, NY, USA, 2000.
`ACM;
`Ex. 1050, Joel Bartlett. “Rock ’n’ scroll is here to stay.” Computer
`Graphics and Applications, IEEE, 20(3):40–45, May 2000;
`Ex. 2003, Declaration of Dr. Karon MacLean dated August 6, 2015;
`Ex. 2005, Declaration of Peng Lim dated August 6, 2015;
`Ex. 2023, Excerpt from The History of Tablet Computers – a
`Timeline,
`http://www.zdnet.com/article/the-history-of-tablet-
`computers-a-timeline, accessed 8/4/15; and
`Ex. 2024, Fujitsu Stylistic 2300, Pen Computing Magazine, April
`1999.
`
`OPINION
`A. The ‘245 Patent Does Not Require the Application to “Draw” the
`Delineated Active Areas
`
`•
`
`•
`•
`•
`
`•
`
`2. With regard to Claim 1 (and also Claim 12) of the ‘245 Patent, Dr.
`
`MacLean opines that the claim limitation “a second surface including at least a
`
`second input element having a sensor pad comprising a selectively configurable
`
`sensing surface that provides more than one delineated active area based on the
`
`selected application” requires the application “to specify the spatial demarcations
`
`
`
`2
`
`SCEA Ex. 1042 Page 3
`
`
`
`
`
`of the delineations according to the applications specific needs.” Ex. 2003 at ¶ 87.
`
`Dr. MacLean further opines “disclosure of ‘245’s Claim 1 clearly requires these
`
`delineations to be determined by the application and its specific requirements, not
`
`by the hardware or operating system.” Id. at ¶ 90. Dr. MacLean also suggests that
`
`the claim term “providing” means “drawing/defining” the delineated active areas.
`
`Id. at ¶ 101 (“I list two examples from the ‘245 specification where ‘245 sets its
`
`standard from both of providing (i.e. drawing/defining) rather than just selecting of
`
`system-defined delineations . . . .”). For reasons described below, I respectfully
`
`disagree with these opinions.
`
`3.
`
`I have been informed that in proceedings before the USPTO the claims
`
`of an unexpired patent are to be given their broadest reasonable interpretation in
`
`view of the specification from the perspective of one skilled in the art. The
`
`broadest reasonable
`
`interpretation does not mean
`
`the broadest possible
`
`interpretation. Rather, the meaning given to a claim term must be consistent with
`
`the ordinary and customary meaning of the term (unless the term has been given a
`
`special definition in the specification), and must be consistent with the use of the
`
`claim term in the specification and drawings. Further, the broadest reasonable
`
`interpretation of the claims must be consistent with the interpretation that those
`
`skilled in the art would reach. I have been informed that the ‘245 Patent has not
`
`
`
`3
`
`SCEA Ex. 1042 Page 4
`
`
`
`
`
`expired. It is also my understanding the Board has not expressly construed any
`
`terms in Claims 1 and 12 to date.
`
`4. Dr. MacLean’s opinion is inconsistent with the ordinary and customary
`
`meaning of the claim term “a selectively configurable sensing surface that provides
`
`more than one delineated active area based on the selected application.” Dr.
`
`MacLean opines “I see a distinction between an application’s ‘selecting’ from a set
`
`of basic delineations provided by the hardware or operating system and ‘providing’
`
`delineations with spatial boarders that are potentially unique to that application as
`
`required by the ‘245 patent.” Ex. 2003 at ¶ 87 (emphasis in original). However,
`
`Claim 1 does not recite that the application “provides” the delineated active areas.
`
`Rather, the plain language of the claim recites that the “selectively configurable
`
`sensing surface” – not the application – “provides the more than one delineated
`
`active areas.”
`
`5.
`
`I see nothing in the ‘245 Patent specification that would have led a
`
`person having ordinary skill in the art to conclude that the spatial boundaries of the
`
`delineated active areas must be drawn or defined by the application in order to be
`
`“based on the selected application.” Figure 3d of the ‘245 Patent depicts a
`
`configuration of multiple delineated active areas arranged on a pressure senor pad:
`
`
`
`4
`
`SCEA Ex. 1042 Page 5
`
`
`
`
`
`
`
`Ex. 1001 at Fig. 3d; see also, id. at 9:20-23 (“As shown in FIG. 3d, the pressure
`
`sensor pad 354 may be configured in software to represent one or more delineated
`
`active areas corresponding to different programmable functions depending on the
`
`application.”). The ‘245 Patent also describes two applications, a text application
`
`and a game application, that are both mapped to the same delineated active areas
`
`shown in Figure 3d.
`
`6.
`
`In particular, the inverted U-shaped active area 360 with vertical sides
`
`362 and horizontal side 364 may be mapped to shifting functions in a text
`
`application and game character movement controls in a game application. Id. at
`
`11:34-39 (“Another method to implement full keyboard capability . . . is map in
`
`software the delineated active areas of the second input assembly 350 as follows:
`
`left vertical side 362 of the inverted U-shaped active area 360 to be shift position 1;
`
`anywhere along the horizontal side 364 to be shift position 2 . . . .”); 12:9-14 (“In
`
`
`
`5
`
`SCEA Ex. 1042 Page 6
`
`
`
`
`
`this implementation, the vertical side 362 of the inverted U-shaped active area 360
`
`may be programmed to represent the y-directional (vertical) movement of control
`
`of a character in a game, while the horizontal side 364 of the U-shaped active area
`
`360 may be programmed to represent the x-directional (horizontal) movement.”).
`
`The five oblong shaped areas 372 may be mapped to indexing or shifting functions
`
`in a text application and weapon fire functions in a game application. Id. at 10:48-
`
`50 (“For example, going from left to right, each oblong-shaped active area 372
`
`may be mapped to represent a separate index or shift position . . . .”); 12:17-20
`
`(“Rapid firing of weapons may be accomplished by using . . . one of the five
`
`oblong-shaped active areas 372, with each one representing a different weapon or
`
`action.”). Finally, the rectangular-shaped areas 374, 376, 378, 380 may be mapped
`
`to shifting functions in a text application and field of view controls in a game
`
`application. Id. at 11:34-44 (“Another method to implement full keyboard
`
`capability . . . is map . . . the top-left rectangular-shaped active area 378 to be shift
`
`position 3; the top-right rectangular-shaped active area 374 to be shift position 4;
`
`the bottom left rectangular-shaped active area 380 to be shift position 5; and, if
`
`needed,
`
`the bottom-right rectangular-shaped active area 376.”); 12:14-17
`
`(“Movement into or out of the field of view may be controlled by the left and right
`
`rectangular buttons 374, 376, 378, 380, thereby allowing 3-D control.”)
`
`
`
`6
`
`SCEA Ex. 1042 Page 7
`
`
`
`
`
`7.
`
`The fact that two different applications utilize the same delineated
`
`active areas also comports with the understanding of a person of ordinary skill. It
`
`was well understood by skilled artisans at the time of the ‘245 Patent that
`
`consistency was (and still is) a fundamental rule of user interface design for all
`
`computers including mobile devices. For example, in his famous book Designing
`
`the User Interface: Strategies for Effective Human-Computer Interaction, Prof.
`
`Ben Shneiderman discusses the importance of consistency. Ex. 1043, Shneiderman
`
`at p. 13 (“Consistency primarily refers to common action sequences, terms, units,
`
`layouts, color, typography, and so on within an application program. Consistency
`
`is a strong determinant of success of systems. It is naturally extended to include
`
`compatibility across application programs and compatibility with paper or non-
`
`computer-based systems.”) (emphasis added). In fact consistency is the first of
`
`Prof. Shneiderman’s very widely-cited “Eight Golden Rules of Interface Design”
`
`from that book. Id. at p. 74. (“1. Strive for consistency. This rule is the most
`
`frequently violated one, but following it can be tricky because there are many
`
`forms of consistency. Consistent sequences of actions should be required in similar
`
`situations; identical terminology should be used in prompts, menus, and help
`
`screens; and consistent color, layout, capitalization, fonts, and so on should be
`
`employed throughout.”) (emphasis added). Those rules appeared in the first edition
`
`of his book (1986), have persisted through four subsequent editions of the book,
`
`
`
`7
`
`SCEA Ex. 1042 Page 8
`
`
`
`
`
`and remain popular and relevant today. The rules apply generally to interface
`
`design, and a person of ordinary skill would have understood they would apply to
`
`mobile devices. Ex. 1044, Tarasewich at p. 5 (“Likewise, many of the current
`
`principles of interface design can be transferred to newer devices, although
`
`soundly applying these principles may be more difficult due to the unique nature of
`
`mobile systems and devices. Fundamental rules such as consistency, shortcuts for
`
`advanced users, the use of feedback, error prevention, easy reversal of actions, and
`
`minimization of short term memory requirements (Shneiderman, 1998) will
`
`undoubtedly transfer to mobile applications.”) (emphasis added), where the citation
`
`“(Shneiderman, 1998)” is referring to the same 3rd edition of Prof. Shneiderman’s
`
`book that I cited above (Designing the User Interface: Strategies for Effective
`
`Human-Computer Interaction) and the “[f]undamental rules” would indicate
`
`Shneiderman’s “Golden Rules.” Thus, Dr. MacLean’s requirement that each
`
`application must redefine spatial boundaries of the delineated active areas is not
`
`supported by the ‘245 Patent specification and would also be contrary to the basic
`
`understanding of a skilled artisan at the time of the ‘245 Patent.
`
`8. Based on the above disclosures and analyses, a person having ordinary
`
`skill would understand that the mappings of application functions to the delineated
`
`active areas may change “based on the selected application.” However, the ‘245
`
`
`
`8
`
`SCEA Ex. 1042 Page 9
`
`
`
`
`
`Patent does not include any requirement that the spatial boundaries of the
`
`delineated active areas themselves must change from application to application.
`
`9.
`
` Dr. MacLean relies on two examples of different configurations of
`
`delineated active areas in the ‘245 Patent that, in her opinion, “describe a number
`
`of different delineation shape sets of the second surface sensor pad (354) active
`
`areas.” Ex. 2003 at ¶ 101-102. And, I agree that the ‘245 Patent is not limited to
`
`any particular configuration of delineated active areas. I also agree with Dr.
`
`MacLean’s conclusion that the “delineations may be determined at the application
`
`level.” Id. at ¶ 103 (emphasis added). However, I do not agree that the spatial
`
`boundaries of the delineations must be drawn or defined by the application.
`
`10. The ‘245 Patent discloses “computational aspects described here can
`
`be implemented in analog or digital electronic circuitry, or in computer hardware,
`
`firmware, software, or in combinations of them.” Ex. 1001 at 14:45-48. A person
`
`of ordinary skill would understand this to teach a common sense (reasonable)
`
`choice of realization of the computational aspects. Correspondingly, in the context
`
`of the second surface sensor pad, the term “software” is used very generally
`
`throughout the ‘245 Patent without system-level, application-level, or any other
`
`limitations. Id. at 4:66-5:1 (“These delineated active areas likewise can be
`
`configured in software to represent one or more input functions.”) (emphasis
`
`added); 8:56-58 (“The second input assembly 350 includes a pressure sensor pad
`
`
`
`9
`
`SCEA Ex. 1042 Page 10
`
`
`
`
`
`354 having a plurality of software configurable active areas . . . .”) (emphasis
`
`added); 9:20-22 (“As shown in FIG. 3d, the pressure sensor pad 354 may be
`
`configured in software to represent one or more delineated 25 active areas . . . .”)
`
`(emphasis added); 11:57-63 (“A method of implementing the functionality of a
`
`game controller is . . . to map in software 65 the delineated active areas of the
`
`pressure sensor pad 354 of the second input assembly 350 analog control”)
`
`(emphasis added). This is in contrast to places where a distinction to “application
`
`software” or “software application” is indicated. Id. at 5:24-29 (“Sensing circuitry
`
`. . . may be provided to . . . convert those signals in a form suitable to be received
`
`by a processor running application software,”) (emphasis added); 5:6-10 (“force
`
`producing unit . . . may provide tactile feedback to the user . . . in response to
`
`events occurring in a software application running on a processor.”) (emphasis
`
`added). Thus, a skilled artisan would have appreciated that analog or digital
`
`circuitry, hardware, firmware, any form of software (system-level or application-
`
`level), or any combinations could determine the spatial boundaries of the
`
`delineated active areas.
`
`B. Liebenow’s information appliance is not limited to “vertically
`integrated” devices
`
`11. As a preliminary matter, Mr. Lim’s characterization of Liebenow’s
`
`digital information appliances as “tablet” computers (Ex. 2005 at ¶ 66), and the
`
`form factor implications arising from the examples provided in “The History of the
`
`
`
`10
`
`SCEA Ex. 1042 Page 11
`
`
`
`
`
`Tablet Computer” section of his declaration (Id. at ¶ 37-44), are both subjective
`
`and seemingly chosen to pigeonhole the Liebenow devices into a single category
`
`serving only a particular “vertical market” that matches Mr. Lim’s expertise.
`
`There is no universally accepted formal classification scheme for computing
`
`devices in general, and all informal classifications that I am aware of are based on
`
`relatively vague criteria, resulting in more of a continuum of capabilities and
`
`characteristics than rigid “bins” of computer types. Indeed, the section titled “A
`
`TAXONOMY OF TABLETS” in Ex. 2023 cited by Mr. Lim states “Tablets come
`
`in a number of shapes and sizes, and since the form factor largely determines the
`
`use case, it's useful to set out the various subcategories. There are no 'canonical'
`
`definitions here, but hopefully this list isn't too far off the mark.” Ex. 2023
`
`(emphasis added). The article goes on to list the following examples: “Phablet,”
`
`“Small-tablet,” “Medium-sized tablet,” “Large tablet,” and “Hybrid/convertible.”
`
`Id. These proposed categories span size and capabilities ranging from “6-7in.
`
`screens” that “sit mid-way between smartphones and small tablets” to “keyboard-
`
`equipped touchscreen devices, usually with 10in. screens or larger, that have
`
`some sliding, twisting or keyboard-removal mechanism that allows them to
`
`switch between laptop and tablet modes.” Id. (emphasis added). This range of
`
`sizes and capabilities is quite broad. As an example of the subjectivity involved in
`
`any such classification, the 1993 Apple Newton MessagePad is included in Mr.
`
`
`
`11
`
`SCEA Ex. 1042 Page 12
`
`
`
`
`
`Lim’s examples of “tablets” and yet the Newton was the device used to coin the
`
`term “personal digital assistant.” Ex. 1045, McCracken. Conversely the currently
`
`available Apple iPhone 6 Plus, which might be called a “smartphone” by some, is
`
`also often called a “phablet” (see e.g., http://www.cnet.com/news/iphone-6-plus-
`
`leads-phablet-sales-in-us/) which would include it in the taxonomy given in Ex.
`
`2023, and thus classify the iPhone 6 Plus as a “tablet.”
`
`12. After narrowly characterizing “tablet” computers in his background
`
`section, and then pigeonholing the digital information appliance taught by
`
`Liebenow into that category, Mr. Lim opines that a person of ordinary skill in the
`
`art would not have wanted to add game functionality. Ex. 2005 at ¶ 97. As
`
`support for his opinion, Mr. Lim relies on a series of assumptions including: (1) if
`
`the device of Liebenow were commercialized, it would be identified in the same
`
`category as other tablet computers on the market at the time; (2) tablets computers,
`
`such as those manufactured by Fujitsu, were targeted at professional and vertical
`
`markets, not general consumers; (3) gaming is banned in most corporate
`
`environments. Id. at ¶ 95. I disagree with Mr. Lim’s narrow classifications, his
`
`assumptions, and his conclusion.
`
`13. First, I disagree with the assumption that a person of ordinary skill in
`
`the art would consider the digital information appliance of Liebenow to be strictly
`
`limited to any one device category such as the “tablet” devices as characterized by
`
`
`
`12
`
`SCEA Ex. 1042 Page 13
`
`
`
`
`
`Mr. Lim. Liebenow includes a list of exemplary digital information appliances
`
`including “electronic books, personal digital assistants (PDAs) and portable
`
`information handling systems.” Ex. 1003 at [0002]. As I opined in my original
`
`declaration, it was common for users to install games on their PalmPilot PDA
`
`devices well before the priority date of the ‘245 Patent. Ex. 1010 at ¶¶ 27-28. In
`
`his deposition, Mr. Lim, who was an executive at Palm from 1999 to 2001, agreed
`
`that people played games on their Palm devices. Ex. 1041 at 46:4-5 (“Yes, people
`
`play games on Palm PDA, I believe people play games of it. I was aware of it.”).
`
`Based on Liebenow’s disclosure that the digital information application could be a
`
`PDA and based on the prevalence of games on PDAs at the time, a skilled artisan
`
`at the time of the ‘245 Patent would have recognized that games could similarly be
`
`provided on Liebenow.
`
`14. Mr. Lim’s assumption
`
`that
`
`tablet computers were
`
`limited
`
`to
`
`professional and vertical markets seems to be at least partially based on his
`
`experiences at Fujitsu. Ex. 2005 at ¶ 95 (“The Liebenow text input digital
`
`information appliance, much like the products I made at Fujitsu (the leader in this
`
`segment of the market), would have been understood in the early 2000s to be a
`
`type of device that traditionally targeted professional and vertical markets.”). Mr.
`
`Lim also cites to an April 1999 article from Pen Computing regarding the Fujitsu
`
`Stylistic 2300. Ex. 2024. Mr. Lim was employed at Fujitsu from 1997 to 1999.
`
`
`
`13
`
`SCEA Ex. 1042 Page 14
`
`
`
`
`
`Ex. 2005 at ¶ 11. In his deposition, Mr. Lim admitted that he was not aware of
`
`Fujitsu’s activities after his departure in 1999. Ex. 1041 at 22:12-23:5.
`
`15. There were key-shifts in the tablet computing market in the time after
`
`Mr. Lim’s departure from Fujitsu in 1999 up until October 2003. As referenced by
`
`Mr. Lim, Microsoft released its Windows XP Tablet PC operating system in 2002.
`
`Ex. 2005 at ¶ 43. Windows XP Tablet PC edition was based on the Windows XP
`
`operating system and also
`
`included specialized features and applications
`
`specifically designed for tablet computers. Ex. 1030, Thurrott at p. 2 (“Tablet PCs
`
`ship with a special version of Windows XP called Windows XP Tablet PC Edition.
`
`This XP version is available only with Tablet PCs, and is based on Windows XP
`
`Professional”). Included among the tablet PC applications was a game called
`
`InkBall. Id. at p. 4 (“Windows XP Tablet PC Editions ships with a decent game
`
`called Inkball . . . . The goal is to drive two bouncing balls into the correct holes,
`
`and you draw little walls with the stylus to guide the balls; each time a ball hits a
`
`wall, the wall disappears and the ball ricochets into the correct direction.”). At that
`
`time, Microsoft has also planned to release Tablet PC downloads including
`
`additional games. Id. at p. 2 (“Microsoft says that it will also issue a number of
`
`free Tablet PC downloads to its Web site, including more games and some
`
`PowerToys, once the software is complete.”). Therefore, at least as of 2002,
`
`games were available on tablet computers running Windows XP Tablet PC edition.
`
`
`
`14
`
`SCEA Ex. 1042 Page 15
`
`
`
`
`
`16.
`
`In a white paper entitled “Pen Computer Technology” published by
`
`Fujitsu in 2002, Fujitsu identified the target market of several pen computer
`
`product categories, including the tablet PC, as “Consumer & Enterprise:”
`
`
`
` Ex. 1026 at p. 2. The aforementioned Fujitsu Tablet PC directed toward the
`
`consumer and enterprise markets was to run the Windows XP Tablet PC operating
`
`system. Id. The “Technical Reference Guide” for the Fujitsu Stylistic ® ST 4000
`
`Series Tablet PCs, which has a copyright date of 2002, states that the device was
`
`distributed with Microsoft Windows XP Tablet PC Edition preinstalled. Ex. 1029
`
`at p. 2.
`
`17. Therefore, even if Liebenow were limited to some form of tablet
`
`computers, which I disagree with, a skilled artisan in October 2003 would have
`
`known that such tablet computers, including Fujitsu’s tablet computers, were being
`
`actively marketed to consumers. A skilled artisan would have also known that
`
`
`
`15
`
`SCEA Ex. 1042 Page 16
`
`
`
`
`
`operating systems included on these tablet computers, such as Windows XP Tablet
`
`PC edition, included games and allowed users to download and install additional
`
`games on their tablets as desired. For this reason, it would have been obvious to
`
`similarly install games on the information appliance described by Liebenow.
`
`C. Combining Liebenow with Andrews Would Yield Predictable
`Results
`
`18. Regarding the combination of Liebenow and Andrews, Mr. Lim opines
`
`that without connecting a peripheral input device to the Liebenow device “the
`
`genre
`
`information will not be available for Andrews’ mapper or
`
`the
`
`application/game software. Without the external peripheral and the stored game
`
`genre, the application/game software will not be able to run properly and the
`
`results will be unpredictable.” Ex. 2005 at ¶ 107. I first would like to point out
`
`that
`
`this opinion assumes an
`
`incorrect characterization of
`
`the proposed
`
`combination of Liebenow and Andrews.
`
`19. As I opined in my original declaration, Andrews teaches exemplary
`
`mappings of game functions to input elements and also teaches applying these
`
`mappings to games running on handheld devices. Ex. 1010 at ¶ 39. Based on
`
`these teachings, my opinion was (and still is) that “it would have been obvious to a
`
`person having ordinary skill in the art at the time of the ‘245 Patent to combine the
`
`teachings of Liebenow and Andrews to modify the handheld device of Liebenow
`
`to ‘comprise a game application’ as recited by Claims 2 and 13.” Id. at ¶ 40.
`
`
`
`16
`
`SCEA Ex. 1042 Page 17
`
`
`
`
`
`20.
`
`It is certainly true that the input elements described by Andrews
`
`correspond to input elements on peripheral input devices. Ex. 1004 at 1:11-13
`
`(“This invention relates generally to the use of peripheral input devices with
`
`software applications and more specifically to the use of genres in conjunction
`
`with such input devices and software applications.”). However, a person of
`
`ordinary skill and creativity would have appreciated that, to the extent these input
`
`elements are already present on the device running the game application, these
`
`input elements could similarly be mapped to the game functions using the method
`
`taught by Andrews without needing to rely on the complete input device mapper
`
`software taught by Andrews. For example, Andrews teaches mapping keys of a
`
`peripheral keyboard to certain game functions. Ex. 1004 at 21:14-16 (“For
`
`example, the auxiliary input used to implement the ‘change dash display’ action
`
`correlated with the ‘DASHBOARD’ semantic in driving game 36a could be the
`
`‘D’ key on keyboard 40 (not shown in Fig. 8)”); 14:26-15:5 (“For example, even
`
`though game controller 66 does not have a control correlated with the
`
`‘DASHBOARD’ semantic, driving game 36a may still correlate its ‘change dash
`
`display’ action with the semantic ‘DASHBOARD,’ and input device mapper 39
`
`will locate an appropriate auxiliary input for that action, In mapping 220, auxiliary
`
`input 501 is selected by input device mapper 39 to implement the ‘DASHBOARD’
`
`semantic. Auxiliary input 501 may be a key on keyboard 40 . . . .”); Fig. 1
`
`
`
`17
`
`SCEA Ex. 1042 Page 18
`
`
`
`
`
`(showing keyboard 40 is a peripheral keyboard). A person of ordinary skill would
`
`have appreciated that the information appliance of Liebenow already has an
`
`emulated keyboard (e.g., Ex. 1003 at Fig. 15) so no peripheral keyboard would be
`
`needed.
`
`21. Regarding Liebenow’s emulated keyboard, Mr. Lim opines “The
`
`Liebenow keyboard simulator was developed for text purposes only, instead of
`
`game applications, so the game genre information will not be available on
`
`Liebenow’s keyboard.” Ex. 2005 at ¶ 108. I again disagree. Prior to the October
`
`2003, many games running on general purpose computing devices mapped game
`
`functions to keyboards. For example, the well-known Microsoft Flight Simulator
`
`PC game made extensive use of keyboard inputs, including plain alphabetic keys
`
`such as “H,” “E,” “M,” “J,” “G,” “L,” and “O;” function keys, and modifier keys
`
`such as “CTRL” (the “control” keys) and “SHIFT” (the “shift” keys). Ex. 1039,
`
`Chiu at Appendix C, Keyboard Command Reference. As cited above, Andrews
`
`also teaches mapping keyboard keys (e.g., the “D” key) to game inputs (Dashboard
`
`function of a driving game). A person having ordinary skill in the art would have
`
`understood that the emulated keyboard of Liebenow could similarly be used to
`
`provide game inputs. A skilled artisan would have understood that the game
`
`application would interpret key presses of the emulated keyboard in the same way
`
`that Liebenow’s text and calculator applications interpreted key presses. Thus, no
`
`
`
`18
`
`SCEA Ex. 1042 Page 19
`
`
`
`
`
`further modifications to Liebenow would be necessary to enable it to execute game
`
`applications.
`
`D. Obvious to Combine Liebenow and Hedberg
`22. With regard to the combination of Liebenow and Hedberg, Dr.
`
`MacLean opines “Hedberg’s utility (pan/zoom control of a graphical portal on the
`
`image displayed by a different device) is quite specific, and it is unrelated to the
`
`device uses taught by Liebenow.” Ex. 2003 at ¶ 112. I respectfully disagree at
`
`least because Dr. MacLean’s analysis appears to be omitting a relevant
`
`embodiment of Hedberg.
`
`23. Hedberg teaches a “hand-held display device for use with an electronic
`
`device, said display device being suitable for the purpose of a hand-held date entry
`
`device as well as for both landscape and portrait presentations of a full-page word
`
`processing document.” Ex. 1005 at 3:6-11. The handheld display device includes
`
`an inertial sensor such as an accelerometer or a gyroscope. Id. at Abstract
`
`(“Further, a gyroscope (6) is incorporated in said display device (1) . . . .”), 3:26-30
`
`(“These objects are accomplished by a display device having movement sensitive
`
`means such as a micro gyroscope, strain gauge, piezo-electric, or equilibrium of
`
`force accelerometer etc information in said display device, thereby being
`
`responsive to movements in space . . . .”). In the embodiment referenced by Dr.
`
`MacLean, the handheld display device is used with an electronic device, such as a
`
`
`
`19
`
`SCEA Ex. 1042 Page 20
`
`
`
`
`
`desktop computer, “to display a complete or a determined part of a screen image.”
`
`Id. at 3:15-18; see also, id. at Abstract, Fig. 3 (showing electronic device 13 as a
`
`desktop computer separate from handheld display device 1). However, in another
`
`embodiment, which was not addressed by Dr. MacLean, the handheld display
`
`device is “incorporated in an electronic device such as a mobile telephone, PDA
`
`(Personal Digital Assistant), and organizer, a data terminal to display a complete or
`
`a determined part of a screen image in a proper size with regard to the current
`
`needs or requirements of the user.” Id. at 3:20-25; see also, 6:34-7:7 (“For
`
`example, in another embodiment of the invention the different parts: display
`
`screen, movement sensitive means, control buttons, electronic circuits and/or
`
`connection means, of said display devices can be incorporated as a single nit or as
`
`separate parts in an electronic device such as a mobile telephone, a PDA (Personal
`
`Digital Assistant), an organizer, data terminal, or a handheld computer, wherein the
`
`operations described above are performed in a similar manner.”); Fig. 5 (showing
`
`electric device 13 as a mobile phone). In this embodiment, “these kinds of
`
`electronic devices, provided with a display device of the invention, can work as
`
`stand alone devices . . . .” Id. at 7:10-12 (emphasis added).
`
`24. Liebenow teaches a digital information appliance such as a PDA. Ex.
`
`1003 at [0002] (“Digital information appliances such as electronic books, personal
`
`digital assistants (PDAs) and portable information handling systems . . . .”).
`
`
`
`20
`
`SCEA Ex. 1042 Page 21
`
`
`
`
`
`Therefore, the embodiment taught by Hedberg where the standalone handheld
`
`electronic device, such as a PDA, includes an inertial sensor is directly related to
`
`Liebenow’s digital information appliance, which may also be a PDA.
`
`25. Dr. MacLean also opines that Liebenow does not teach any uses that
`
`would benefit from using inertial sensors to effect panning/zooming of the
`
`graphical display as taught by Hedberg. Ex. 2003 at ¶¶ 115-116. To the contrary,
`
`Liebenow teaches an embodiment where the digital information appliance includes
`
`a web browser. Ex. 1003 at [0051] (“In an exemplary embodiment, the digital
`
`information appliance 300 may be configured for use with an information network
`
`such as the Internet. In such an em