throbber
UNITED STATES PATENT AND TRADEMARK OFFICE
`
`____________
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
` ____________
`
`SONY COMPUTER ENTERTAINMENT AMERICA LLC
`Petitioner
`
`v.
`
`APLIX IP HOLDINGS CORPORATION
`Patent Owner
`
`____________
`
`Case No. IPR2015-00230
`Patent 7,463,245
` ____________
`
`
`
`SUPPLEMENTAL DECLARATION OF DR. GREGORY F. WELCH
`
`
`
`
`
`SCEA Ex. 1042 Page 1
`
`

`
`
`
`I, Gregory F. Welch, hereby declare the following:
`1.
`I have been asked to respond to certain issues raised by Patent Owner
`
`(“PO”) and their experts, Dr. Karon MacLean and Mr. Peng Lim, in Patent Owner
`
`Aplix IP Holdings Corporation’s Response to the Petition dated August 6, 2015
`
`(“Paper No. 19”). All of my opinions expressed in my original declaration dated
`
`November 7, 2014 (Ex. 1010) remain the same. I have reviewed the following
`
`additional materials in connection with preparing this supplemental declaration:
`
`•
`
`•
`
`•
`•
`
`•
`
`•
`
`•
`
`•
`
`•
`
`•
`
`•
`
`Paper No. 16, Decision Institution of Inter Partes Review dated May
`14, 2015;
`Paper No. 19, Patent Owner Aplix IP Holdings Corporation’s
`Response to the Petition dated August 6, 2015;
`Ex. 1026, Pen Computer Technology, Fujitsu PC Corporation (2002);
`Ex. 1029, Stylistic® ST4000 Series Tablet PC Technical Reference
`Guide, Fujitsu PC Corporation (2002);
`Ex. 1030, Paul Thurrott, Windows XP Tablet PC Edition Review (June
`25, 2002);
`Ex. 1039, Ben Chiu, Microsoft Flight Simulator 2000 Strategies &
`Secrets, Sybex, Inc. (1999);
`Ex. 1041, Transcript of the deposition of Peng Lim taken in IPR2015-
`00230, October 28, 2015;
`Ex. 1043, Ben Shneiderman. Designing the User Interface: Strategies
`for Effective Human-Computer
`Interaction. Addison-Wesley
`Longman Publishing Co., Inc., Boston, MA, USA, 3rd edition, 1997;
`Ex. 1044, Peter Tarasewich, “Wireless Devices
`for Mobile
`Commerce: User Interface Design and Usability”, Mobile Commerce:
`Technology, Theory, and Applications, Idea Group Publishing (2002);
`Ex.
`1045,
`Newton,
`Reconsidered,
`Harry McCracken,
`http://techland.time.com/2012/06/01/newton-reconsidered/print,
`accessed 11/23/15;
`Ex. 1046, Corin R. Anderson, Pedro Domingos, Daniel S. Weld, Web
`Site Personalizers for Mobile Devices, IJCAI Workshop on Intelligent
`Techniques for Web Personalization (ITWP) (2001);
`
`
`
`1
`
`SCEA Ex. 1042 Page 2
`
`

`
`
`
`I.
`
`•
`
`•
`
`•
`
` Ex. 1047, Parisa Eslambolchilar and Roderick Murray-Smith. Tilt-
`based automatic zooming and scaling in mobile devices – a state-
`space implementation. In S. Brewster and M. Dunlop, editors, Mobile
`Human-Computer Interaction - MobileHCI 2004, volume 3160 of
`Lecture Notes in Computer Science, pages 120–131. Springer Berlin
`Heidelberg, 2004;
`Ex. 1048, Jun Rekimoto. “Tilting operations for small screen
`interfaces.” In Proceedings of the 9th annual ACM symposium on
`User interface software and technology, UIST ’96, pages 167–168,
`New York, NY, USA, October 7–10 1996. ACM;
`Ex. 1049, Ken Hinckley, Jeff Pierce, Mike Sinclair, and Eric Horvitz.
`“Sensing techniques for mobile interaction.” In Proceedings of the
`13th Annual ACM Symposium on User Interface Software and
`Technology, UIST ’00, pages 91–100, New York, NY, USA, 2000.
`ACM;
`Ex. 1050, Joel Bartlett. “Rock ’n’ scroll is here to stay.” Computer
`Graphics and Applications, IEEE, 20(3):40–45, May 2000;
`Ex. 2003, Declaration of Dr. Karon MacLean dated August 6, 2015;
`Ex. 2005, Declaration of Peng Lim dated August 6, 2015;
`Ex. 2023, Excerpt from The History of Tablet Computers – a
`Timeline,
`http://www.zdnet.com/article/the-history-of-tablet-
`computers-a-timeline, accessed 8/4/15; and
`Ex. 2024, Fujitsu Stylistic 2300, Pen Computing Magazine, April
`1999.
`
`OPINION
`A. The ‘245 Patent Does Not Require the Application to “Draw” the
`Delineated Active Areas
`
`•
`
`•
`•
`•
`
`•
`
`2. With regard to Claim 1 (and also Claim 12) of the ‘245 Patent, Dr.
`
`MacLean opines that the claim limitation “a second surface including at least a
`
`second input element having a sensor pad comprising a selectively configurable
`
`sensing surface that provides more than one delineated active area based on the
`
`selected application” requires the application “to specify the spatial demarcations
`
`
`
`2
`
`SCEA Ex. 1042 Page 3
`
`

`
`
`
`of the delineations according to the applications specific needs.” Ex. 2003 at ¶ 87.
`
`Dr. MacLean further opines “disclosure of ‘245’s Claim 1 clearly requires these
`
`delineations to be determined by the application and its specific requirements, not
`
`by the hardware or operating system.” Id. at ¶ 90. Dr. MacLean also suggests that
`
`the claim term “providing” means “drawing/defining” the delineated active areas.
`
`Id. at ¶ 101 (“I list two examples from the ‘245 specification where ‘245 sets its
`
`standard from both of providing (i.e. drawing/defining) rather than just selecting of
`
`system-defined delineations . . . .”). For reasons described below, I respectfully
`
`disagree with these opinions.
`
`3.
`
`I have been informed that in proceedings before the USPTO the claims
`
`of an unexpired patent are to be given their broadest reasonable interpretation in
`
`view of the specification from the perspective of one skilled in the art. The
`
`broadest reasonable
`
`interpretation does not mean
`
`the broadest possible
`
`interpretation. Rather, the meaning given to a claim term must be consistent with
`
`the ordinary and customary meaning of the term (unless the term has been given a
`
`special definition in the specification), and must be consistent with the use of the
`
`claim term in the specification and drawings. Further, the broadest reasonable
`
`interpretation of the claims must be consistent with the interpretation that those
`
`skilled in the art would reach. I have been informed that the ‘245 Patent has not
`
`
`
`3
`
`SCEA Ex. 1042 Page 4
`
`

`
`
`
`expired. It is also my understanding the Board has not expressly construed any
`
`terms in Claims 1 and 12 to date.
`
`4. Dr. MacLean’s opinion is inconsistent with the ordinary and customary
`
`meaning of the claim term “a selectively configurable sensing surface that provides
`
`more than one delineated active area based on the selected application.” Dr.
`
`MacLean opines “I see a distinction between an application’s ‘selecting’ from a set
`
`of basic delineations provided by the hardware or operating system and ‘providing’
`
`delineations with spatial boarders that are potentially unique to that application as
`
`required by the ‘245 patent.” Ex. 2003 at ¶ 87 (emphasis in original). However,
`
`Claim 1 does not recite that the application “provides” the delineated active areas.
`
`Rather, the plain language of the claim recites that the “selectively configurable
`
`sensing surface” – not the application – “provides the more than one delineated
`
`active areas.”
`
`5.
`
`I see nothing in the ‘245 Patent specification that would have led a
`
`person having ordinary skill in the art to conclude that the spatial boundaries of the
`
`delineated active areas must be drawn or defined by the application in order to be
`
`“based on the selected application.” Figure 3d of the ‘245 Patent depicts a
`
`configuration of multiple delineated active areas arranged on a pressure senor pad:
`
`
`
`4
`
`SCEA Ex. 1042 Page 5
`
`

`
`
`
`
`
`Ex. 1001 at Fig. 3d; see also, id. at 9:20-23 (“As shown in FIG. 3d, the pressure
`
`sensor pad 354 may be configured in software to represent one or more delineated
`
`active areas corresponding to different programmable functions depending on the
`
`application.”). The ‘245 Patent also describes two applications, a text application
`
`and a game application, that are both mapped to the same delineated active areas
`
`shown in Figure 3d.
`
`6.
`
`In particular, the inverted U-shaped active area 360 with vertical sides
`
`362 and horizontal side 364 may be mapped to shifting functions in a text
`
`application and game character movement controls in a game application. Id. at
`
`11:34-39 (“Another method to implement full keyboard capability . . . is map in
`
`software the delineated active areas of the second input assembly 350 as follows:
`
`left vertical side 362 of the inverted U-shaped active area 360 to be shift position 1;
`
`anywhere along the horizontal side 364 to be shift position 2 . . . .”); 12:9-14 (“In
`
`
`
`5
`
`SCEA Ex. 1042 Page 6
`
`

`
`
`
`this implementation, the vertical side 362 of the inverted U-shaped active area 360
`
`may be programmed to represent the y-directional (vertical) movement of control
`
`of a character in a game, while the horizontal side 364 of the U-shaped active area
`
`360 may be programmed to represent the x-directional (horizontal) movement.”).
`
`The five oblong shaped areas 372 may be mapped to indexing or shifting functions
`
`in a text application and weapon fire functions in a game application. Id. at 10:48-
`
`50 (“For example, going from left to right, each oblong-shaped active area 372
`
`may be mapped to represent a separate index or shift position . . . .”); 12:17-20
`
`(“Rapid firing of weapons may be accomplished by using . . . one of the five
`
`oblong-shaped active areas 372, with each one representing a different weapon or
`
`action.”). Finally, the rectangular-shaped areas 374, 376, 378, 380 may be mapped
`
`to shifting functions in a text application and field of view controls in a game
`
`application. Id. at 11:34-44 (“Another method to implement full keyboard
`
`capability . . . is map . . . the top-left rectangular-shaped active area 378 to be shift
`
`position 3; the top-right rectangular-shaped active area 374 to be shift position 4;
`
`the bottom left rectangular-shaped active area 380 to be shift position 5; and, if
`
`needed,
`
`the bottom-right rectangular-shaped active area 376.”); 12:14-17
`
`(“Movement into or out of the field of view may be controlled by the left and right
`
`rectangular buttons 374, 376, 378, 380, thereby allowing 3-D control.”)
`
`
`
`6
`
`SCEA Ex. 1042 Page 7
`
`

`
`
`
`7.
`
`The fact that two different applications utilize the same delineated
`
`active areas also comports with the understanding of a person of ordinary skill. It
`
`was well understood by skilled artisans at the time of the ‘245 Patent that
`
`consistency was (and still is) a fundamental rule of user interface design for all
`
`computers including mobile devices. For example, in his famous book Designing
`
`the User Interface: Strategies for Effective Human-Computer Interaction, Prof.
`
`Ben Shneiderman discusses the importance of consistency. Ex. 1043, Shneiderman
`
`at p. 13 (“Consistency primarily refers to common action sequences, terms, units,
`
`layouts, color, typography, and so on within an application program. Consistency
`
`is a strong determinant of success of systems. It is naturally extended to include
`
`compatibility across application programs and compatibility with paper or non-
`
`computer-based systems.”) (emphasis added). In fact consistency is the first of
`
`Prof. Shneiderman’s very widely-cited “Eight Golden Rules of Interface Design”
`
`from that book. Id. at p. 74. (“1. Strive for consistency. This rule is the most
`
`frequently violated one, but following it can be tricky because there are many
`
`forms of consistency. Consistent sequences of actions should be required in similar
`
`situations; identical terminology should be used in prompts, menus, and help
`
`screens; and consistent color, layout, capitalization, fonts, and so on should be
`
`employed throughout.”) (emphasis added). Those rules appeared in the first edition
`
`of his book (1986), have persisted through four subsequent editions of the book,
`
`
`
`7
`
`SCEA Ex. 1042 Page 8
`
`

`
`
`
`and remain popular and relevant today. The rules apply generally to interface
`
`design, and a person of ordinary skill would have understood they would apply to
`
`mobile devices. Ex. 1044, Tarasewich at p. 5 (“Likewise, many of the current
`
`principles of interface design can be transferred to newer devices, although
`
`soundly applying these principles may be more difficult due to the unique nature of
`
`mobile systems and devices. Fundamental rules such as consistency, shortcuts for
`
`advanced users, the use of feedback, error prevention, easy reversal of actions, and
`
`minimization of short term memory requirements (Shneiderman, 1998) will
`
`undoubtedly transfer to mobile applications.”) (emphasis added), where the citation
`
`“(Shneiderman, 1998)” is referring to the same 3rd edition of Prof. Shneiderman’s
`
`book that I cited above (Designing the User Interface: Strategies for Effective
`
`Human-Computer Interaction) and the “[f]undamental rules” would indicate
`
`Shneiderman’s “Golden Rules.” Thus, Dr. MacLean’s requirement that each
`
`application must redefine spatial boundaries of the delineated active areas is not
`
`supported by the ‘245 Patent specification and would also be contrary to the basic
`
`understanding of a skilled artisan at the time of the ‘245 Patent.
`
`8. Based on the above disclosures and analyses, a person having ordinary
`
`skill would understand that the mappings of application functions to the delineated
`
`active areas may change “based on the selected application.” However, the ‘245
`
`
`
`8
`
`SCEA Ex. 1042 Page 9
`
`

`
`
`
`Patent does not include any requirement that the spatial boundaries of the
`
`delineated active areas themselves must change from application to application.
`
`9.
`
` Dr. MacLean relies on two examples of different configurations of
`
`delineated active areas in the ‘245 Patent that, in her opinion, “describe a number
`
`of different delineation shape sets of the second surface sensor pad (354) active
`
`areas.” Ex. 2003 at ¶ 101-102. And, I agree that the ‘245 Patent is not limited to
`
`any particular configuration of delineated active areas. I also agree with Dr.
`
`MacLean’s conclusion that the “delineations may be determined at the application
`
`level.” Id. at ¶ 103 (emphasis added). However, I do not agree that the spatial
`
`boundaries of the delineations must be drawn or defined by the application.
`
`10. The ‘245 Patent discloses “computational aspects described here can
`
`be implemented in analog or digital electronic circuitry, or in computer hardware,
`
`firmware, software, or in combinations of them.” Ex. 1001 at 14:45-48. A person
`
`of ordinary skill would understand this to teach a common sense (reasonable)
`
`choice of realization of the computational aspects. Correspondingly, in the context
`
`of the second surface sensor pad, the term “software” is used very generally
`
`throughout the ‘245 Patent without system-level, application-level, or any other
`
`limitations. Id. at 4:66-5:1 (“These delineated active areas likewise can be
`
`configured in software to represent one or more input functions.”) (emphasis
`
`added); 8:56-58 (“The second input assembly 350 includes a pressure sensor pad
`
`
`
`9
`
`SCEA Ex. 1042 Page 10
`
`

`
`
`
`354 having a plurality of software configurable active areas . . . .”) (emphasis
`
`added); 9:20-22 (“As shown in FIG. 3d, the pressure sensor pad 354 may be
`
`configured in software to represent one or more delineated 25 active areas . . . .”)
`
`(emphasis added); 11:57-63 (“A method of implementing the functionality of a
`
`game controller is . . . to map in software 65 the delineated active areas of the
`
`pressure sensor pad 354 of the second input assembly 350 analog control”)
`
`(emphasis added). This is in contrast to places where a distinction to “application
`
`software” or “software application” is indicated. Id. at 5:24-29 (“Sensing circuitry
`
`. . . may be provided to . . . convert those signals in a form suitable to be received
`
`by a processor running application software,”) (emphasis added); 5:6-10 (“force
`
`producing unit . . . may provide tactile feedback to the user . . . in response to
`
`events occurring in a software application running on a processor.”) (emphasis
`
`added). Thus, a skilled artisan would have appreciated that analog or digital
`
`circuitry, hardware, firmware, any form of software (system-level or application-
`
`level), or any combinations could determine the spatial boundaries of the
`
`delineated active areas.
`
`B. Liebenow’s information appliance is not limited to “vertically
`integrated” devices
`
`11. As a preliminary matter, Mr. Lim’s characterization of Liebenow’s
`
`digital information appliances as “tablet” computers (Ex. 2005 at ¶ 66), and the
`
`form factor implications arising from the examples provided in “The History of the
`
`
`
`10
`
`SCEA Ex. 1042 Page 11
`
`

`
`
`
`Tablet Computer” section of his declaration (Id. at ¶ 37-44), are both subjective
`
`and seemingly chosen to pigeonhole the Liebenow devices into a single category
`
`serving only a particular “vertical market” that matches Mr. Lim’s expertise.
`
`There is no universally accepted formal classification scheme for computing
`
`devices in general, and all informal classifications that I am aware of are based on
`
`relatively vague criteria, resulting in more of a continuum of capabilities and
`
`characteristics than rigid “bins” of computer types. Indeed, the section titled “A
`
`TAXONOMY OF TABLETS” in Ex. 2023 cited by Mr. Lim states “Tablets come
`
`in a number of shapes and sizes, and since the form factor largely determines the
`
`use case, it's useful to set out the various subcategories. There are no 'canonical'
`
`definitions here, but hopefully this list isn't too far off the mark.” Ex. 2023
`
`(emphasis added). The article goes on to list the following examples: “Phablet,”
`
`“Small-tablet,” “Medium-sized tablet,” “Large tablet,” and “Hybrid/convertible.”
`
`Id. These proposed categories span size and capabilities ranging from “6-7in.
`
`screens” that “sit mid-way between smartphones and small tablets” to “keyboard-
`
`equipped touchscreen devices, usually with 10in. screens or larger, that have
`
`some sliding, twisting or keyboard-removal mechanism that allows them to
`
`switch between laptop and tablet modes.” Id. (emphasis added). This range of
`
`sizes and capabilities is quite broad. As an example of the subjectivity involved in
`
`any such classification, the 1993 Apple Newton MessagePad is included in Mr.
`
`
`
`11
`
`SCEA Ex. 1042 Page 12
`
`

`
`
`
`Lim’s examples of “tablets” and yet the Newton was the device used to coin the
`
`term “personal digital assistant.” Ex. 1045, McCracken. Conversely the currently
`
`available Apple iPhone 6 Plus, which might be called a “smartphone” by some, is
`
`also often called a “phablet” (see e.g., http://www.cnet.com/news/iphone-6-plus-
`
`leads-phablet-sales-in-us/) which would include it in the taxonomy given in Ex.
`
`2023, and thus classify the iPhone 6 Plus as a “tablet.”
`
`12. After narrowly characterizing “tablet” computers in his background
`
`section, and then pigeonholing the digital information appliance taught by
`
`Liebenow into that category, Mr. Lim opines that a person of ordinary skill in the
`
`art would not have wanted to add game functionality. Ex. 2005 at ¶ 97. As
`
`support for his opinion, Mr. Lim relies on a series of assumptions including: (1) if
`
`the device of Liebenow were commercialized, it would be identified in the same
`
`category as other tablet computers on the market at the time; (2) tablets computers,
`
`such as those manufactured by Fujitsu, were targeted at professional and vertical
`
`markets, not general consumers; (3) gaming is banned in most corporate
`
`environments. Id. at ¶ 95. I disagree with Mr. Lim’s narrow classifications, his
`
`assumptions, and his conclusion.
`
`13. First, I disagree with the assumption that a person of ordinary skill in
`
`the art would consider the digital information appliance of Liebenow to be strictly
`
`limited to any one device category such as the “tablet” devices as characterized by
`
`
`
`12
`
`SCEA Ex. 1042 Page 13
`
`

`
`
`
`Mr. Lim. Liebenow includes a list of exemplary digital information appliances
`
`including “electronic books, personal digital assistants (PDAs) and portable
`
`information handling systems.” Ex. 1003 at [0002]. As I opined in my original
`
`declaration, it was common for users to install games on their PalmPilot PDA
`
`devices well before the priority date of the ‘245 Patent. Ex. 1010 at ¶¶ 27-28. In
`
`his deposition, Mr. Lim, who was an executive at Palm from 1999 to 2001, agreed
`
`that people played games on their Palm devices. Ex. 1041 at 46:4-5 (“Yes, people
`
`play games on Palm PDA, I believe people play games of it. I was aware of it.”).
`
`Based on Liebenow’s disclosure that the digital information application could be a
`
`PDA and based on the prevalence of games on PDAs at the time, a skilled artisan
`
`at the time of the ‘245 Patent would have recognized that games could similarly be
`
`provided on Liebenow.
`
`14. Mr. Lim’s assumption
`
`that
`
`tablet computers were
`
`limited
`
`to
`
`professional and vertical markets seems to be at least partially based on his
`
`experiences at Fujitsu. Ex. 2005 at ¶ 95 (“The Liebenow text input digital
`
`information appliance, much like the products I made at Fujitsu (the leader in this
`
`segment of the market), would have been understood in the early 2000s to be a
`
`type of device that traditionally targeted professional and vertical markets.”). Mr.
`
`Lim also cites to an April 1999 article from Pen Computing regarding the Fujitsu
`
`Stylistic 2300. Ex. 2024. Mr. Lim was employed at Fujitsu from 1997 to 1999.
`
`
`
`13
`
`SCEA Ex. 1042 Page 14
`
`

`
`
`
`Ex. 2005 at ¶ 11. In his deposition, Mr. Lim admitted that he was not aware of
`
`Fujitsu’s activities after his departure in 1999. Ex. 1041 at 22:12-23:5.
`
`15. There were key-shifts in the tablet computing market in the time after
`
`Mr. Lim’s departure from Fujitsu in 1999 up until October 2003. As referenced by
`
`Mr. Lim, Microsoft released its Windows XP Tablet PC operating system in 2002.
`
`Ex. 2005 at ¶ 43. Windows XP Tablet PC edition was based on the Windows XP
`
`operating system and also
`
`included specialized features and applications
`
`specifically designed for tablet computers. Ex. 1030, Thurrott at p. 2 (“Tablet PCs
`
`ship with a special version of Windows XP called Windows XP Tablet PC Edition.
`
`This XP version is available only with Tablet PCs, and is based on Windows XP
`
`Professional”). Included among the tablet PC applications was a game called
`
`InkBall. Id. at p. 4 (“Windows XP Tablet PC Editions ships with a decent game
`
`called Inkball . . . . The goal is to drive two bouncing balls into the correct holes,
`
`and you draw little walls with the stylus to guide the balls; each time a ball hits a
`
`wall, the wall disappears and the ball ricochets into the correct direction.”). At that
`
`time, Microsoft has also planned to release Tablet PC downloads including
`
`additional games. Id. at p. 2 (“Microsoft says that it will also issue a number of
`
`free Tablet PC downloads to its Web site, including more games and some
`
`PowerToys, once the software is complete.”). Therefore, at least as of 2002,
`
`games were available on tablet computers running Windows XP Tablet PC edition.
`
`
`
`14
`
`SCEA Ex. 1042 Page 15
`
`

`
`
`
`16.
`
`In a white paper entitled “Pen Computer Technology” published by
`
`Fujitsu in 2002, Fujitsu identified the target market of several pen computer
`
`product categories, including the tablet PC, as “Consumer & Enterprise:”
`
`
`
` Ex. 1026 at p. 2. The aforementioned Fujitsu Tablet PC directed toward the
`
`consumer and enterprise markets was to run the Windows XP Tablet PC operating
`
`system. Id. The “Technical Reference Guide” for the Fujitsu Stylistic ® ST 4000
`
`Series Tablet PCs, which has a copyright date of 2002, states that the device was
`
`distributed with Microsoft Windows XP Tablet PC Edition preinstalled. Ex. 1029
`
`at p. 2.
`
`17. Therefore, even if Liebenow were limited to some form of tablet
`
`computers, which I disagree with, a skilled artisan in October 2003 would have
`
`known that such tablet computers, including Fujitsu’s tablet computers, were being
`
`actively marketed to consumers. A skilled artisan would have also known that
`
`
`
`15
`
`SCEA Ex. 1042 Page 16
`
`

`
`
`
`operating systems included on these tablet computers, such as Windows XP Tablet
`
`PC edition, included games and allowed users to download and install additional
`
`games on their tablets as desired. For this reason, it would have been obvious to
`
`similarly install games on the information appliance described by Liebenow.
`
`C. Combining Liebenow with Andrews Would Yield Predictable
`Results
`
`18. Regarding the combination of Liebenow and Andrews, Mr. Lim opines
`
`that without connecting a peripheral input device to the Liebenow device “the
`
`genre
`
`information will not be available for Andrews’ mapper or
`
`the
`
`application/game software. Without the external peripheral and the stored game
`
`genre, the application/game software will not be able to run properly and the
`
`results will be unpredictable.” Ex. 2005 at ¶ 107. I first would like to point out
`
`that
`
`this opinion assumes an
`
`incorrect characterization of
`
`the proposed
`
`combination of Liebenow and Andrews.
`
`19. As I opined in my original declaration, Andrews teaches exemplary
`
`mappings of game functions to input elements and also teaches applying these
`
`mappings to games running on handheld devices. Ex. 1010 at ¶ 39. Based on
`
`these teachings, my opinion was (and still is) that “it would have been obvious to a
`
`person having ordinary skill in the art at the time of the ‘245 Patent to combine the
`
`teachings of Liebenow and Andrews to modify the handheld device of Liebenow
`
`to ‘comprise a game application’ as recited by Claims 2 and 13.” Id. at ¶ 40.
`
`
`
`16
`
`SCEA Ex. 1042 Page 17
`
`

`
`
`
`20.
`
`It is certainly true that the input elements described by Andrews
`
`correspond to input elements on peripheral input devices. Ex. 1004 at 1:11-13
`
`(“This invention relates generally to the use of peripheral input devices with
`
`software applications and more specifically to the use of genres in conjunction
`
`with such input devices and software applications.”). However, a person of
`
`ordinary skill and creativity would have appreciated that, to the extent these input
`
`elements are already present on the device running the game application, these
`
`input elements could similarly be mapped to the game functions using the method
`
`taught by Andrews without needing to rely on the complete input device mapper
`
`software taught by Andrews. For example, Andrews teaches mapping keys of a
`
`peripheral keyboard to certain game functions. Ex. 1004 at 21:14-16 (“For
`
`example, the auxiliary input used to implement the ‘change dash display’ action
`
`correlated with the ‘DASHBOARD’ semantic in driving game 36a could be the
`
`‘D’ key on keyboard 40 (not shown in Fig. 8)”); 14:26-15:5 (“For example, even
`
`though game controller 66 does not have a control correlated with the
`
`‘DASHBOARD’ semantic, driving game 36a may still correlate its ‘change dash
`
`display’ action with the semantic ‘DASHBOARD,’ and input device mapper 39
`
`will locate an appropriate auxiliary input for that action, In mapping 220, auxiliary
`
`input 501 is selected by input device mapper 39 to implement the ‘DASHBOARD’
`
`semantic. Auxiliary input 501 may be a key on keyboard 40 . . . .”); Fig. 1
`
`
`
`17
`
`SCEA Ex. 1042 Page 18
`
`

`
`
`
`(showing keyboard 40 is a peripheral keyboard). A person of ordinary skill would
`
`have appreciated that the information appliance of Liebenow already has an
`
`emulated keyboard (e.g., Ex. 1003 at Fig. 15) so no peripheral keyboard would be
`
`needed.
`
`21. Regarding Liebenow’s emulated keyboard, Mr. Lim opines “The
`
`Liebenow keyboard simulator was developed for text purposes only, instead of
`
`game applications, so the game genre information will not be available on
`
`Liebenow’s keyboard.” Ex. 2005 at ¶ 108. I again disagree. Prior to the October
`
`2003, many games running on general purpose computing devices mapped game
`
`functions to keyboards. For example, the well-known Microsoft Flight Simulator
`
`PC game made extensive use of keyboard inputs, including plain alphabetic keys
`
`such as “H,” “E,” “M,” “J,” “G,” “L,” and “O;” function keys, and modifier keys
`
`such as “CTRL” (the “control” keys) and “SHIFT” (the “shift” keys). Ex. 1039,
`
`Chiu at Appendix C, Keyboard Command Reference. As cited above, Andrews
`
`also teaches mapping keyboard keys (e.g., the “D” key) to game inputs (Dashboard
`
`function of a driving game). A person having ordinary skill in the art would have
`
`understood that the emulated keyboard of Liebenow could similarly be used to
`
`provide game inputs. A skilled artisan would have understood that the game
`
`application would interpret key presses of the emulated keyboard in the same way
`
`that Liebenow’s text and calculator applications interpreted key presses. Thus, no
`
`
`
`18
`
`SCEA Ex. 1042 Page 19
`
`

`
`
`
`further modifications to Liebenow would be necessary to enable it to execute game
`
`applications.
`
`D. Obvious to Combine Liebenow and Hedberg
`22. With regard to the combination of Liebenow and Hedberg, Dr.
`
`MacLean opines “Hedberg’s utility (pan/zoom control of a graphical portal on the
`
`image displayed by a different device) is quite specific, and it is unrelated to the
`
`device uses taught by Liebenow.” Ex. 2003 at ¶ 112. I respectfully disagree at
`
`least because Dr. MacLean’s analysis appears to be omitting a relevant
`
`embodiment of Hedberg.
`
`23. Hedberg teaches a “hand-held display device for use with an electronic
`
`device, said display device being suitable for the purpose of a hand-held date entry
`
`device as well as for both landscape and portrait presentations of a full-page word
`
`processing document.” Ex. 1005 at 3:6-11. The handheld display device includes
`
`an inertial sensor such as an accelerometer or a gyroscope. Id. at Abstract
`
`(“Further, a gyroscope (6) is incorporated in said display device (1) . . . .”), 3:26-30
`
`(“These objects are accomplished by a display device having movement sensitive
`
`means such as a micro gyroscope, strain gauge, piezo-electric, or equilibrium of
`
`force accelerometer etc information in said display device, thereby being
`
`responsive to movements in space . . . .”). In the embodiment referenced by Dr.
`
`MacLean, the handheld display device is used with an electronic device, such as a
`
`
`
`19
`
`SCEA Ex. 1042 Page 20
`
`

`
`
`
`desktop computer, “to display a complete or a determined part of a screen image.”
`
`Id. at 3:15-18; see also, id. at Abstract, Fig. 3 (showing electronic device 13 as a
`
`desktop computer separate from handheld display device 1). However, in another
`
`embodiment, which was not addressed by Dr. MacLean, the handheld display
`
`device is “incorporated in an electronic device such as a mobile telephone, PDA
`
`(Personal Digital Assistant), and organizer, a data terminal to display a complete or
`
`a determined part of a screen image in a proper size with regard to the current
`
`needs or requirements of the user.” Id. at 3:20-25; see also, 6:34-7:7 (“For
`
`example, in another embodiment of the invention the different parts: display
`
`screen, movement sensitive means, control buttons, electronic circuits and/or
`
`connection means, of said display devices can be incorporated as a single nit or as
`
`separate parts in an electronic device such as a mobile telephone, a PDA (Personal
`
`Digital Assistant), an organizer, data terminal, or a handheld computer, wherein the
`
`operations described above are performed in a similar manner.”); Fig. 5 (showing
`
`electric device 13 as a mobile phone). In this embodiment, “these kinds of
`
`electronic devices, provided with a display device of the invention, can work as
`
`stand alone devices . . . .” Id. at 7:10-12 (emphasis added).
`
`24. Liebenow teaches a digital information appliance such as a PDA. Ex.
`
`1003 at [0002] (“Digital information appliances such as electronic books, personal
`
`digital assistants (PDAs) and portable information handling systems . . . .”).
`
`
`
`20
`
`SCEA Ex. 1042 Page 21
`
`

`
`
`
`Therefore, the embodiment taught by Hedberg where the standalone handheld
`
`electronic device, such as a PDA, includes an inertial sensor is directly related to
`
`Liebenow’s digital information appliance, which may also be a PDA.
`
`25. Dr. MacLean also opines that Liebenow does not teach any uses that
`
`would benefit from using inertial sensors to effect panning/zooming of the
`
`graphical display as taught by Hedberg. Ex. 2003 at ¶¶ 115-116. To the contrary,
`
`Liebenow teaches an embodiment where the digital information appliance includes
`
`a web browser. Ex. 1003 at [0051] (“In an exemplary embodiment, the digital
`
`information appliance 300 may be configured for use with an information network
`
`such as the Internet. In such an em

This document is available on Docket Alarm but you must sign up to view it.


Or .

Accessing this document will incur an additional charge of $.

After purchase, you can access this document again without charge.

Accept $ Charge
throbber

Still Working On It

This document is taking longer than usual to download. This can happen if we need to contact the court directly to obtain the document and their servers are running slowly.

Give it another minute or two to complete, and then try the refresh button.

throbber

A few More Minutes ... Still Working

It can take up to 5 minutes for us to download a document if the court servers are running slowly.

Thank you for your continued patience.

This document could not be displayed.

We could not find this document within its docket. Please go back to the docket page and check the link. If that does not work, go back to the docket and refresh it to pull the newest information.

Your account does not support viewing this document.

You need a Paid Account to view this document. Click here to change your account type.

Your account does not support viewing this document.

Set your membership status to view this document.

With a Docket Alarm membership, you'll get a whole lot more, including:

  • Up-to-date information for this case.
  • Email alerts whenever there is an update.
  • Full text search for other cases.
  • Get email alerts whenever a new case matches your search.

Become a Member

One Moment Please

The filing “” is large (MB) and is being downloaded.

Please refresh this page in a few minutes to see if the filing has been downloaded. The filing will also be emailed to you when the download completes.

Your document is on its way!

If you do not receive the document in five minutes, contact support at support@docketalarm.com.

Sealed Document

We are unable to display this document, it may be under a court ordered seal.

If you have proper credentials to access the file, you may proceed directly to the court's system using your government issued username and password.


Access Government Site

We are redirecting you
to a mobile optimized page.





Document Unreadable or Corrupt

Refresh this Document
Go to the Docket

We are unable to display this document.

Refresh this Document
Go to the Docket