`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`ZTE (USA), Inc.
`
`Google LLC Petitioner
`
`V.
`
`Cywee Group Ltd.
`
`(record) Patent Owner
`
`IPR2018IPR20 I
`9-0125700525
`Patent No. 8,552,978
`
`PETITION FOR INTER PAR TES REVIEW
`UNDER 35 U.S.C. §§311-319 AND 37 C.F.R. §42.100 ET. SEQ
`
`I
`
`ZTE Exhibit 1050
`Page 1 of 87
`
`
`
`TABLE OF CONTENTS
`
`TABLE OF EXHIBITS ............................................................................................. 4
`
`NOTICE OF LEAD AND BACKUP COUNSEL ..................................................... 5
`
`NOTICE OF THE REAL-PARTIES-IN-INTEREST ............................................... 5
`
`NOTICE OF RELATED MATTERS ........................................................................ 6
`
`NOTICE OF SERVICE INFORMATION ................................................................ 7
`
`GROUNDS FOR STANDING .................................................................................. 7
`
`STATEMENT OF PRECISE RELIEF REQUESTED .............................................. 8
`
`THRESHOLD REQUIREMENT FOR INTER PAR TES REVIEW ........................ 8
`
`I.
`
`INTRODUCTION ........................................................................................... 8
`
`A.
`
`Prosecution History and Issued Claims .............................................. 12
`
`II.
`
`CLAIM CONSTRUCTION .......................................................................... 15
`
`A.
`
`B.
`
`Claim 10-"spatial reference frame" and similar terms ..................... 15
`
`Claim 10-"rotation output" ............................................................... 19
`
`GROUNDS .............................................................................................................. 19
`
`Ground 1. Claims 10 and 12 are obvious over Zhang in view of
`
`Bachmann ........................................................................................... 19
`
`Overview of the Combination ............................................................. 20
`
`Rationale for the Combination ............................................................ 31
`
`Ability to Implement and Reasonable Expectation of Success ............ 38
`
`Graham Factors ..................................................................................... 40
`
`Claim Mapping ...................................................................................... 40
`
`2
`
`ZTE Exhibit 1050
`Page 2 of 87
`
`
`
`Ground 2. Claims 10 and 12 are unpatentable over Liberty in view
`
`of Bachmann ....................................................................................... 61
`
`Overview of the Combination ............................................................. 62
`
`Rationale for the Combination ............................................................. 69
`
`Ability to Implement and Reasonable Expectation of Success ............ 7 5
`
`Difference Between the Combination and Prior Discussion of
`
`Liberty .................................................................................................. 77
`
`Graham Factors .................................................................................... 77
`
`Claim Mapping ..................................................................................... 7 8
`
`CERTIFICATE OF SERVICE ................................................................................ 86
`
`CERTIFICATE OF WORD COUNT ...................................................................... 87
`
`3
`
`ZTE Exhibit 1050
`Page 3 of 87
`
`
`
`TABLE OF EXHIBITS
`
`Exhibit No.
`
`Description
`
`1001
`
`1002
`
`1003
`
`1004
`
`1005
`
`1006
`
`1007
`
`1008
`
`1009
`
`1010
`
`1011
`
`U.S. Pat. No. 8,552,978 ("the '978 patent").
`
`Declaration of Professor Majid Sarrafzadeh.
`
`C.V. of Professor Majid Sarrafzadeh.
`
`U.S. Pat. No. 7,089,148 ("Bachmann").
`
`U.S. Pat. App. Pub. 2004/0095317 ("Zhang").
`
`U.S. Pat. 7,158,118 ("Liberty").
`
`Return of Service for Cywee Group Ltd. v. Google, Inc., Case No.
`l-18-cv-00571, (D. Del.).
`
`Return of Service for Cywee Group Ltd. v. Huawei Technologies
`Co., Inc. et al., Case No. 2-l 7-cv-00495, (E.D. Tex.).
`
`File History of U.S. Pat. App. 13/176,771.
`
`Joint Claim Construction and Prehearing Statement in Cywee
`Group Ltd. v. Samsung Electronics Co. Ltd. et al., Case No. 2-17-
`cv-00140, (E.D. Tex.).
`
`Exhibit E (Claim chart with of U.S. Pat. No. 8,552,978) to
`CyWee's Complaint in Cywee Group Ltd. v. Google, Inc., Case
`No. l-18-cv-00571, (D. Del.)
`
`1012-1049
`
`Reserved
`
`1050 - -
`
`1051 - -
`
`1052 - -
`
`Comoarison between the Current Petition and Petition in IPR2018-
`01257
`
`Claim Construction Order. Cvwee Grouv Ltd. v. Motorola Mobilitv
`LLC. l 7-cv-00780. Jan. 4.2019
`
`Declaration of Andrea Shoffstall
`
`4
`
`ZTE Exhibit 1050
`Page 4 of 87
`
`
`
`Petitioner ZTE (USA), Inc. ("Petitioner" or "ZTE") respectfully requests
`
`inter partes review under 35 U.S.C. §311 of claims 10 and 12 of U.S. Pat. No.
`
`8,552,978 ("the '978 patent").
`
`NOTICE OF LEAD AND BACKUP COUNSEL
`
`Lead Counsel: James R . Sobieraj ~4atthew A . Smith (Reg. No. 4 9,00330,805);
`
`Tel: 202 .669 .6207312 .32 l .4200
`
`Backup Counsel: Andrew 8 . BaluchJon H . Beaupre (Reg. No. 57,50354,729);
`
`Tel: 847 .863.1645734 .302.6000
`
`Backup Counsel: Yuezhong Feng Christopher ~4. Colice (Reg. No.
`
`65,63458,657); Tel: 312.321.4200
`
`Backup Counsel: Andrea L. Shoffstall (Reg. No. 75,426); Tel: 312 .321.4200
`
`617 .947 .7280 .
`
`Address oflead counsel: Brinks Gilson & Lione, NBC Tower, Suite 3600, 455
`
`N . Cityfront Plaza Dr., Chicago, Illinois 6061 l-55998mith Baluch
`
`LLP, 1100 Alma St., Ste 109, ~fonlo
`
`Park, CA 94025 .
`
`NOTICE OF THE REAL-PARTIES-IN-INTEREST
`
`The real-parties-in-interest for this petition are ZTE Corporation and ZTE
`
`(USA), IncGoogle LLC and Huawei Device USA, Inc., Huawei Device Co . Ltd.,
`
`Huawei Technologies Co . Ltd., Huawei De,vice (Dongguan) Co. Ltd., Huav1ei
`
`5
`
`ZTE Exhibit 1050
`Page 5 of 87
`
`
`
`Investment & Holding Co. Ltd., Huav1ei Tech. Investment Co. Ltd., Huawei Device
`
`(Hong Kong) Co. Ltd.
`
`NOTICE OF RELATED MATTERS
`
`The '978 patent is asserted in the following matters:
`
`• Cywee Group Ltd. v. Google, Inc., Case No. l-18-cv-00571, (D. Del.);
`
`• Cywee Group Ltd. v. ZTE Corporation et al., Case No. 3-l 7-cv-02130,
`
`(S.D. Cal.);
`
`• Cywee Group Ltd. v. HTC Corporation et al., Case No. 2-l 7-cv-00932,
`
`(W.D. Wash.);
`
`• Cywee Group Ltd. v. Motorola Mobility LLC, Case No. l-l 7-cv-00780,
`
`(D. Del.);
`
`• Cywee Group Ltd. v. Huawei Technologies Co., Inc. et al., Case No. 2-
`
`l 7-cv-00495, (E.D. Tex.);
`
`• Cywee Group Ltd. v. LG Electronics, Inc. et al., Case No. 3-17-cv-
`
`01102, (S.D. Cal.);
`
`• Cywee Group Ltd. v. Samsung Electronics Co. Ltd. et al., Case No. 2-
`
`l 7-cv-00140, (E.D. Tex.);
`
`!...._Cywee Group Ltd. v. Apple Inc., Case No. 4-14-cv-01853, (N.D. Cal.t
`
`• Google LLC v. Cywee Group Ltd., IPR2018-01257; and
`
`6
`
`ZTE Exhibit 1050
`Page 6 of 87
`
`
`
`• Samsung Electronics Co., Ltd. et al v. CyWee Group Ltd., IPR2019-
`
`00534 (filed concurrently with a motion for joinder to IPR2018-01257).
`
`NOTICE OF SERVICE INFORMATION
`
`Please address all correspondence to the lead counsel at the addresses shown
`
`above.
`
`Petitioners
`
`consents
`
`to
`
`electronic
`
`service
`
`by
`
`
`at:
`
`ZTE CyweeIPRs@brinksgilson.com;
`
`j sobieraj@brinksgilson.com,
`
`jbeaupre@brinksgilson.com,
`
`yfeng@brinksgilson.com,
`
`and
`
`ashoffstall@brinksgilson.com.smith@smithbaluch.com,
`
`baluch@smithbaluch.com,
`
`GROUNDS FOR STANDING
`
`Petitioner hereby certifies that the patent for which review is sought is
`
`available for inter partes review, and that the Petitioner is not barred or estopped
`
`from requesting an inter partes review on the grounds identified in the petition. Ift
`
`particular, This Petition is being submitted concurrently with a Motion for Joinder
`
`and Petitioner requests institution and joinder with Google LLC v. Cywee Group
`
`Ltd., IPR2018-01257 ("the Google IPR"), which the Board instituted on December
`
`11, 2018 . the-The district court suit against Petitioner Google LLC was served on
`
`April 19, 2018 (Ex. 1007), while the suit against certain Huawei entities was served
`
`on June 14, 2017 (Ex. 1008).
`
`7
`
`ZTE Exhibit 1050
`Page 7 of 87
`
`
`
`STATEMENT OF PRECISE RELIEF REQUESTED
`
`Petitioner respectfully requests that claims 10 and 12 of the '978 patent be
`
`canceled based on the following grounds:
`
`Ground 1: Claims 10 and 12 are obvious over Zhang and Bachmann.
`
`Ground 2: Claims 10 and 12 are obvious over Liberty and Bachmann.
`
`THRESHOLD REQUIREMENT FOR INTER PARTES REVIEW
`
`This petition presents "a reasonable likelihood that the Petitioners would
`
`prevail with respect to at least one of the claims challenged in the petition", 35 U.S.C.
`
`§314(a), as shown in the Grounds explained below.
`
`I.
`
`INTRODUCTION
`
`The present petition is supported by the declaration of Prof. Majid Sarrafzadeh
`
`(Ex. 1002). Professor Sarrafzadeh holds the title of Distinguished Professor of
`
`Computer Science & Electrical Engineering at the University of California, Los
`
`Angeles. Professor Sarrafzadeh's CV is included as Exhibit 1003.
`
`The '978 patent relates to 3D pointing devices. (Ex. 1001, Title). The '978
`
`patent describes the function of a 3D pointing device as "detecting motions of the
`
`device and translating the detected motions to a cursor display such as a cursor
`
`pointing on the screen ... of a 2D display device .... " (Ex. 1001, l:3 l-33)(Ex. 1002,
`
`if26). For example, a 3D pointing device could be a kind of computer mouse that
`
`detects movements and rotations of the mouse in three dimensions, allowing the
`
`movements and rotations to be translated into actions on a computer. (Ex. 1001,
`8
`
`ZTE Exhibit 1050
`Page 8 of 87
`
`
`
`l:52-6l)(Ex. 1002, if26). An example of such a device 110 (and a corresponding
`
`display 120) is shown in Fig. 1 of the '978 patent, reproduced below:
`
`122
`
`Zp
`FIG. 1 (RELATED ART)
`
`To keep track of the motions and rotations of a 3D pointing device, the '978
`
`patent proposes using three kinds of sensors: rotation sensors (for detecting the
`
`angular velocity of rotation), accelerometers (for detecting axial accelerations), and
`
`magnetometers (for detecting the local magnetic field). (Ex. 1001, Fig. 4)(Ex. 1002,
`
`if27). These sensors are mounted in or on the 3D pointing device, and provide
`
`information on the movements and rotations of the device. (Ex. 1002, if27).
`
`9
`
`ZTE Exhibit 1050
`Page 9 of 87
`
`
`
`The '978 patent also purports to provide methods of using data output from
`
`the rotation sensors, accelerometers and magnetometers to calculate the orientation
`
`of the 3D pointing device. (Ex. 1001, 4:15-57)(Ex. 1002, if28). The "orientation"
`
`of the device ( also called the "attitude" or "tilt" of the device) is the direction of the
`
`device, e.g. the angles between the device and the axes of any given coordinate
`
`system. 1 (Ex. 1001, l:62-64)(Ex. 1002, if28). For example, Fig. 2 of the '978 patent
`
`shows the same device 110 in a different "orientation", having been rotated about
`
`the x-axis by 90 degrees:
`
`Zo
`
`Xo
`
`120
`
`122
`
`Yp
`
`Yo
`
`Xp
`
`113
`
`Zp
`
`(Ex. 1001, 2:ll-14)(Ex.
`
`FIG. 2 (RELATED ART)
`
`1002,
`
`if28).
`
`1 Orientation may be expressed in a number of equivalent ways, such as with a
`
`quaternion. (Ex. 1002, ifif30-32).
`
`10
`
`ZTE Exhibit 1050
`Page 10 of 87
`
`
`
`While the '978 patent acknowledges the existence of prior-art 3D pointers
`
`using sensors to detect and calculate orientation, the '978 patent criticizes the
`
`specific devices mentioned as allegedly unable to calculate orientation accurately.
`
`(Ex.1001,2:41-3:52)(Ex. 1002, if33). The '978patentpurportstoprovideasolution
`
`to the alleged deficiencies of the prior art, by using additional sensors and
`
`"compensating" the output of the sensors to improve the accuracy of the orientation
`
`calculation.
`
`(Ex. 1001, 1:22-27).
`
`To "compensate" the output of the sensors, the '978 patent discloses a
`
`mathematical method using quaternions. (Ex. 1001, 16:5 et seq.)(Ex. 1002, if34).
`
`As explained by Professor Sarrafzadeh, a "quaternion" is a way to represent an
`
`orientation (rotation angles) using a four-valued vector.
`
`(Ex. 1002, ifif30-32).
`
`Quaternion math operations (such as multiplication) are defined differently than for
`
`standard vectors, and can sometimes be used for efficient calculation of rotations.
`
`(Ex. 1002, ifif30-32).
`
`A basic sketch of the '978 patent method can be seen in Fig. 7, which is
`
`reproduced at right. The method
`
`705
`
`Initialize an initial-value
`set
`
`715
`
`Obtain measured angular
`velocities at T
`
`ZTE Exhibit 1050
`Page 11 of 87
`
`
`
`of Fig. 7 obtains measured angular
`
`velocities at step 715 (Ex. 1001,
`
`16:27-30) and measured axial
`
`accelerations in step 725 (Ex. 1001,
`
`16:60-64).
`
`The method then
`
`calculates a predicted set of axial
`
`accelerations at step 730. (Ex. 1001,
`
`17:2-9). By comparing the actual
`
`and predicted accelerations (step
`
`735),
`
`the method purports
`
`to
`
`improve the estimate of orientation
`
`(called the "updated state (3rd quaternion)" in box 735). (Ex. 1001, 18:25-55)(Ex.
`
`1002, if34).
`
`A.
`
`Prosecution History and Issued Claims
`
`This petition challenges independent claim 10 and dependent claim 12. As
`
`originally filed, claim 10 (then numbered claim 12), read as follows:
`
`"12. A method for compensating rotations of a 3D pointing device,
`
`compnsmg:
`
`generating an orientation output associated with an orientation of
`
`the 3D pointing device associated with three coordinate axes of a global
`
`reference frame associated with Earth;
`
`12
`
`ZTE Exhibit 1050
`Page 12 of 87
`
`
`
`generating a rotation output associated with a rotation of the 3D
`
`pointing device associated with three coordinate axes of a spatial
`
`reference frame associated with the 3D pointing device; and
`
`using the orientation output and the rotation output to generate a
`
`transformed output associated with a fixed reference frame associated
`
`with a display device."
`
`(Ex. 1009, p. 044-045). The claim was thus directed to generating a rotation output
`
`(i.e. output of rotation sensors), calculating orientation output, and then somehow
`
`"using" orientation output and rotation output to generate a "transformed output".
`
`The Examiner initially rejected all original claims for double patenting, and
`
`as anticipated or obvious over U.S. Pat. Pub 2009/0262074 to Nasiri. (Ex. 1009, pp.
`
`071-089). The applicants responded by requesting an interview. (Ex. 1009, pp. 060-
`
`066). In the interview request, the applicants' representative argued that Nasiri did
`
`not teach using a global reference frame associated with Earth, and that Nasiri "only
`
`briefly talks about 'magnetometers"' (Ex. 1009, pp. 060-066).
`
`The applicants then submitted an amendment. (Ex. 1009, pp. 040-055). In
`
`the amendment, the applicants modified claim 12 to add several limitations. First,
`
`the applicants added language to claim 12 requiring generating signal sets associated
`
`with accelerometers and magnetometers. (Ex. 1009, pp. 044-045). Second, the
`
`applicants specified that the "orientation output" must be "based on the first signal
`
`set, the second signal set and the rotation output or based on the first signal set and
`
`13
`
`ZTE Exhibit 1050
`Page 13 of 87
`
`
`
`the second signal set". (Id.). Third, the applicants specified that "the orientation
`
`output and the rotation output is generated by a nine-axis motion sensor module",
`
`and that a "resultant deviation including a plurality of deviation angles" must be
`
`obtained "using" a "plurality of measured magnetisms Mx, My, Mz and a plurality
`
`of predicted magnetism Mx', My' and Mz' for the second signal set." (Id.).
`
`Following the amendment, the Examiner allowed the claims without
`
`further comment. (Ex. 1009, pp. 024-027). As issued, independent claim 10
`
`reads as follows:
`
`"l O. A method for compensating rotations of a 3D pointing device,
`
`compnsmg:
`
`generating an orientation output associated with an orientation of
`
`the 3D pointing device associated with three coordinate axes of a global
`
`reference frame associated with Earth;
`
`generating [sic] a first signal set comprising axial accelerations
`
`associated with movements and rotations of the 3D pointing device in
`
`the spatial reference frame;
`
`generating a second signal set associated with Earth's magnetism;
`
`generating the orientation output based on the first signal set, the
`
`second signal set and the rotation output or based on the first signal set
`
`and the second signal set;
`
`generating a rotation output associated with a rotation of the 3D
`
`pointing device associated with three coordinate axes of a spatial
`
`reference frame associated with the 3D pointing device; and
`
`14
`
`ZTE Exhibit 1050
`Page 14 of 87
`
`
`
`using the orientation output and the rotation output to generate a
`
`transformed output associated with a fixed reference frame associated
`
`with a display device, wherein the orientation output and the rotation
`
`output is generated by a nine-axis motion sensor module;
`
`obtaining one or more resultant deviation including a plurality of
`
`deviation angles using a plurality of measured magnetisms Mx, My, Mz
`
`and a plurality of predicted magnetism Mx', My' and Mz' for the second
`
`signal set."
`
`II. CLAIM CONSTRUCTION
`
`"A claim in an unexpired patent shall be given its broadest reasonable
`
`construction in light of the specification of the patent in which it appears". 37 C.F.R.
`
`§42.IOO(b); Cuozzo Speed Techs., LLC v. Lee, 195 L. Ed. 2d 423 (2016). For this
`
`proceeding, claim terms are presumed to take on their broadest reasonable ordinary
`
`meaning, which is explained in certain instances below. The constructions below
`
`are for the purpose of this petition only, and Petitioner reserves the right to change
`
`these constructions as appropriate in future proceedings. Petitioner also does not
`
`concede, by seeking this petition, that the challenged claims are of definite scope or
`
`properly described under 35 U.S.C. § 112. Petitioner hereby discloses a recent claim
`
`construction order in Cywee v. Motorola, l 7-cv-00780 (Ex. 1051), which does not
`
`construe any claim terms construed in this Petition.
`
`A.
`
`Claim 10-"spatial reference frame" and similar terms
`
`Claim 10 uses the phrases "spatial reference frame" and "spatial reference
`
`15
`
`ZTE Exhibit 1050
`Page 15 of 87
`
`
`
`frame associated with the 3D pointing device". These phrases should be interpreted
`
`to mean "a reference frame associated with the 3D pointing device, which always
`
`has its origin at the same point in the device and in which the axes are always fixed
`
`with respect to the device". (Ex. 1002, if37).
`
`The '978 patent states as follows concerning the spatial reference frame:
`
`"There are two reference frames, such as the spatial pointer
`
`reference frame and the display frame, associated with the pointing
`
`device 110 and the display device 120, respectively. The first
`
`reference frame or spatial pointer reference frame associated with the
`
`pointing device 110 is defined by the coordinate axes Xp, Y p and Zp
`
`as shown in FIG. l ."
`
`(Ex. 1001, 1:39-1 :45)(Emphasis added)(Ex. 1002, if40). Thus, the "spatial pointer
`
`reference frame" is shown by the coordinate axes Xp, Yp and Zp in Fig. 1. Figure 1
`
`16
`
`ZTE Exhibit 1050
`Page 16 of 87
`
`
`
`is reproduced here:
`
`Zo
`
`120
`
`122
`
`111
`
`lp
`FIG. 1 (RELATED ART)
`
`(Ex. 1002, if4 l ). As can be seen from Fig. 1, the spatial pointer reference frame is a
`
`reference frame associated with the 3D pointing device, which has its origin at a
`
`point in the device. (Ex. 1002, ifif4 l-45).
`
`Furthermore, as shown in Fig. 2, when the device is rotated, the axes Xp, Yp
`
`and Zp rotate with the device. (Ex. 1002, ifif 45-46). Figure 2 is reproduced below,
`
`and shows a 90-degree roll of the device, with correspondingly rotated axes Yp and
`
`17
`
`ZTE Exhibit 1050
`Page 17 of 87
`
`
`
`Zo
`
`120
`
`122
`
`Yp
`
`FIG. 2 (RELATED ART)
`
`(Ex. 1002, ,r,r42-43). For that reason, in the spatial pointer reference frame, the
`
`origin and axes of the frame stay fixed with respect to the device. (Ex. 1002, ifif 42-
`
`46). Note that the '978 patent treats each of the phrases "spatial reference frame"
`
`and "spatial pointer reference frame" as referring to a device-centered frame of
`
`reference analogous to the Xp, Yp and Zp axes. (Ex. 1001, 9:19-20, 1:39-47, 3:6-
`
`7)(Ex. 1002, if39-42). Because "spatial reference frame" already refers to a frame
`
`with its origin in the device, the longer phrase "spatial reference frame associated
`
`with the 3D pointing device" has the same meaning, as Cy Wee concedes. (Ex. 1002,
`
`ifif38-4 l; Ex. 1010, p. 2).
`
`Thus, the phrases "spatial reference frame" and "spatial reference frame
`
`associated with the 3D pointing device" should both be interpreted to mean "a
`
`reference frame associated with the 3D pointing device, which always has its origin
`
`18
`
`ZTE Exhibit 1050
`Page 18 of 87
`
`
`
`at the same point in the device and in which the axes are always fixed with respect
`
`to the device" (Ex. 1002, ,rip 7-4 7). Cywee agreed to these constructions during a
`
`co-pending litigation. (Ex. 1010, p. 2).
`
`B.
`
`Claim 10-"rotation output"
`
`Claim 10 uses the phrase "rotation output". In the specification, the '978
`
`patent makes clear that the rotation output is the output of a rotation sensor ( a sensor
`
`that detects rotation). For example, the '978 patent states:
`
`"The rotation sensor generates a rotation output associated with a
`
`rotation of the 3D pointing device associated with three coordinate
`
`axes of a spatial reference frame associated with the 3D pointing
`
`device."
`
`(Ex. 1001, 7:61-64)(Emphasis added)(Ex. 1002, if50).
`
`Thus, "rotation output" should be interpreted m accordance with the
`
`specification as "output of a rotation sensor". (Ex. 1002, ifif48-52).
`
`GROUNDS
`
`Ground 1. Claims 10 and 12 are obvious over Zhang in view of Bachmann.
`
`Claims 10 and 12 are unpatentable as obvious over U.S. Pat. App. Pub.
`
`2004/0095317 ("Zhang")(Ex. 1005), in view of U.S. Pat. No. 7,089,148
`
`("Bachmann")(Ex. 1004).
`
`Zhang was published on May 20, 2004, and is thus prior art under pre-AIA
`
`35 U.S.C. §102(b). Bachmann issued on August 8, 2006, and is thus also prior art
`
`19
`
`ZTE Exhibit 1050
`Page 19 of 87
`
`
`
`underpre-AIA35 U.S.C. §102(b). Zhang and Bachmann are analogous art, because
`
`they are in the same field and reasonably related to the problems facing the named
`
`inventors, as shown by the discussion below.
`
`Neither Zhang nor Bachmann are listed as prior art of record on the face of
`
`the '978 patent.
`
`Overview of the Combination
`
`Claim 10 is directed to a method for compensating rotations of a 3D pointing
`
`device. The combination of Zhang and Bachmann, broadly speaking, uses Zhang 's
`
`3D pointing device together with Bachmann 's extra sensors and method for
`
`compensating rotations.
`
`Zhang teaches a (sic) "a handheld pointing device" that is used for a
`
`"computer pointing control system". (Ex. 1005, Abstract)(Ex. 1002, if 53). Such
`
`a computer pointing control system is shown, for example, in Fig. 2 of Zhang
`
`(reproduced below), where the handheld device (a 3D pointer) has reference numeral
`
`100:
`
`20
`
`ZTE Exhibit 1050
`Page 20 of 87
`
`
`
`710 ~
`
`720
`
`\
`\
`\
`\
`\
`\
`\
`\
`\
`
`\ 'v 10
`
`\
`\
`\
`
`50
`J
`
`200
`
`600 '\. D r1-i .
`5~;;
`-
`
`· r
`
`./ 620
`
`700'-
`
`D
`D
`- - -'--.---"'e:.---- D
`
`,_._ _ __.__.
`
`FIG.2
`
`Inside Zhang' s device 100, there are several sensors that detect the orientation
`
`of the device. Zhang explains:
`
`"A universal pointing control system for televisions and computer
`
`displays is disclosed. The system is comprised of a remote handheld
`
`device, a display control unit and a command delivery unit. The
`
`remote handheld device includes a set of orientation sensors that
`
`detect the device's current orientation."
`
`(Ex. 1005, if0008)(Emphasis added)(Ex. 1002, if54).
`
`21
`
`ZTE Exhibit 1050
`Page 21 of 87
`
`
`
`Zhang discloses that the device 100 has several different orientation sensors.
`
`The orientation sensors are arranged on a circuit board in the housing of the device,
`
`as shown m Fig. 3 of Zhang,
`
`101
`
`102 103
`
`reproduced at right.
`
`In Fig. 3,
`
`numeral 160 is the circuit board,
`
`y
`
`while numerals 120 and 130 are
`
`sensors.
`
`(Ex. 1005,
`
`if0025)(Ex.
`
`1002, ifif55-56). Numeral 120 is "a
`
`two-axis magnetic field sensor 120
`
`[that] is used to detect the device's
`
`FIG. 3
`
`orientation relative to the direction of the earth's magnetic field 25." (Ex. 1005,
`
`if0026)(Ex. 1002, ifif57-58). Numeral 130 is an "accelerometer sensor 130 [that]
`
`contains two orthogonally arranged acceleration detectors." (Ex. 1005, if0027)(Ex.
`
`1002, ifif57-58). Numeral 110 is amicrocontrollerforperformingcalculations. (Ex.
`
`1005, if0025)(Ex. 1002, if59).
`
`A system diagram of Zhang's device 100 is shown in Fig. 5, reproduced below
`
`at right. (Ex. 1005, if0029)(Ex. 1002, if59). In Fig. 5, the two sets of two sensors
`
`(magnetometers 120 and accelerometers 130) are shown on the left
`
`22
`
`ZTE Exhibit 1050
`Page 22 of 87
`
`
`
`----0
`
`(°)-
`
`100
`
`101 \l_
`
`\
`t\ 140
`50 8 Transmitter
`
`side (the Petitioner has placed a red(cid:173)
`
`dashed box around the numerals 120
`
`and 130). These sensors output signals
`
`to circuits 111-112, 121-124 and 131-
`
`134.
`
`(Ex. 1005, if0029)(Ex. 1002,
`
`if60).
`
`These circuits condition the
`
`sensor output, convert it to digital
`
`102\.L
`
`103\l_
`
`----0
`
`0----
`
`----0
`
`I Modu~t r
`113
`
`MCU
`
`110
`
`112
`
`171
`
`(
`
`Battery
`Manage
`Unit
`
`170
`
`l r·
`
`134
`
`FIG. 5
`
`format, and pass the digital data to the
`
`microcontroller (MCU) 110.
`
`(Ex.
`
`,-----:, 131
`
`I~ -~
`
`1005,
`
`if0029)(Ex. 1002, if60). The
`
`MCU 110 determines the device's
`
`orientation, including azimuth and
`
`inclination angles (yaw and pitch). (Ex. 1005, if0029)(Ex. 1002, if60). These angles
`
`are shown in Figs. 4(a) and 4(b ), reproduced below.
`
`23
`
`ZTE Exhibit 1050
`Page 23 of 87
`
`
`
`~
`
`25
`
`N
`
`300
`~
`
`320
`(
`
`I
`
`s
`120
`
`y
`
`X
`
`C ()
`
`tUJO
`
`FIG. 4a
`
`y
`
`~-r---"
`
`J
`130
`
`0
`
`3
`~
`
`320
`
`(
`
`)
`
`£-£
`
`-
`
`-- I
`1- -
`--~~ ---
`- _,_
`__ z~31 - - --
`i--- 32
`'
`
`-
`
`-
`
`-- -
`
`- -
`<a
`
`[][II]
`
`)
`
`/
`
`26
`
`FIG.4b
`
`(Ex. 1002, if58). After Zhang's device calculates its own orientation, Zhang's
`
`system translates those angles into a display command (e.g. moving a cursor), by
`
`translating the angles into screen coordinates. (Ex. 1005, ,r,r0024, 0030)(Ex. 1002,
`
`if60).
`
`Zhang's primary embodiment has a four-axis sensor module (compared to the
`
`"nine-axis sensor module" required by claim 10). Zhang explains that more sensors
`
`can be used, and that different kinds of sensors can be used. For example, Zhang
`
`24
`
`ZTE Exhibit 1050
`Page 24 of 87
`
`
`
`states that gyro sensors ( angular rate sensors that measure "rotation output") could
`
`be used:
`
`"The orientation sensors' mechanisms are shown in FIGS. 4a and 4b.
`
`The orientation sensor demonstrated in FIG. 4a is a magnetic field
`
`sensor, whereas the one in FIG. 4b is an accelerometer sensor.
`
`However, the orientation detection may not be limited to these
`
`types of sensors. Other sensors, for example, a gyro sensor, can also
`
`be used in the pointing control system."
`
`(Ex. 1005, if0026)(Emphasis added)(Ex. 1002, if61). Zhang also mentions that
`
`accelerometers, magnetometers and gyro ( angular rate) sensors can be used in
`
`combination. (Ex. 1005, ifif0006, 0026, claim 2)(Ex. 1002, if62).
`
`Bachmann, in tum, provides an example of a nine-axis sensor system that
`
`combines accelerometers, magnetometers and angular rate detectors ( e.g.
`
`gyroscopes), as suggested by Zhang. Bachmann, for example, states:
`
`"In
`
`another
`
`sensor
`
`embodiment,
`
`the magnetometers
`
`and
`
`accelerometers are supplemented with angular rate detectors
`
`configured to detect the angular velocity of the sensor ( comprising so(cid:173)
`
`called Magnetic, Angular Rate, Gravity (MARG) sensors). Each
`
`MARG sensor contains angular rate detectors, accelerometers, and
`
`magnetometers."
`
`(Ex. 1004, 7:34-4l)(Emphasis added)(Ex. 1002, if64). In Bachmann's system, each
`
`type of sensor is a three-axis sensor, making the entire system (3 sensor types x 3
`
`25
`
`ZTE Exhibit 1050
`Page 25 of 87
`
`
`
`axes per type) a nine-axis system. (Ex. 1002, if65).
`
`Bachmann teaches combining sensor data using an attitude estimation filter to
`
`produce an estimate of the orientation of a tracked object. Bachmann explains:
`
`"[T]he filter inputs are from a three-axis accelerometer (h 1 h2 h3) 31,
`a three-axis magnetometer (b 1 b2 b3) 32, and a three-axis angular
`rate sensor (p, q, r) 33. Its output is a quaternion representation of the
`orientation of the tracked object q 39."
`
`(Ex. 1004, 10:10-14)(Emphasis added)(Ex. 1002, if66). Bachmann thus takes the
`
`output of accelerometer, magnetometer and angular rate sensors, and uses these
`
`sensor outputs to calculate an orientation of a tracked device.
`
`(Ex. 1002, if 67).
`
`To calculate the orientation from sensor inputs, Bachman uses a filter.
`
`Bachmann' s filter mirrors
`
`the claimed calculations of
`
`the '978 patent. (Ex. 1002,
`
`if 68). A control diagram of
`
`Bachmann' s filter process is
`
`shown in Fig. 3, reproduced
`
`at
`
`right, where
`
`the
`
`Petitioner has drawn a red-
`
`dashed box around the
`
`output, q, in the lower right.
`
`/l',#&"c'M.e' -
`;.;11e 5E#~·&><""l.----i f ,f{o,LJ~ ,r)
`{Pt7/- )
`
`26
`
`ZTE Exhibit 1050
`Page 26 of 87
`
`
`
`(Ex. 1004, Fig. 3)(Ex. 1002, if68). The output q is a quaternion representing the
`
`orientation of the tracked object in space. (Ex. 1004, 10: 10-14 )(Ex. 1002, if 68).
`
`Bachmann's filter as shown in Fig. 3 receives inputs from three sets of sensors
`
`( accelerometers, magnetometers and angular-rate sensors) marked 31, 3 2 and 3 3, on
`
`the left side of Fig. 3. These sensors are shown in red-dashed boxes, below:
`
`I -4//&"o"b?R (cid:173)
`I ~~ ~R~__._--.1 f '7(o,P9' r)
`{P9'/")
`I
`~-------
`
`(Ex. 1002, if 69).
`
`The output of the angular rate sensors (33) is used to calculate the orientation
`
`of the device q. The calculation is shown in the boxes along the red-dashed line that
`
`has been added to the lower portion of Fig. 3, below:
`
`27
`
`ZTE Exhibit 1050
`Page 27 of 87
`
`
`
`A'#6F0-44R -
`?4'ff .5E.4'~~.-a j ,f(o~~ r)
`(/.)~/")
`
`I
`)
`
`(Ex. 1002, if70). In the figure, the output of the angular rate sensors (33) is a set of
`
`measured angular rates of rotation (p, q, r) about three axes. (Ex. 1004, 10:10-
`
`14)(Ex. 1002, if70). These rates are converted,in box 37, to a rate quaternionq. (Ex.
`
`1004, 10: l 5-36)(Ex. 1002, if70). To the rate quaternion q is added a correction factor
`,.
`q 0 (which will be explained below), to yield a corrected rate quaternion 'i .
`.
`(Ex. 1004, 10:15-65)(Ex. 1002, ifif70-74). The corrected rate quaternion 'iis
`
`then integrated in box 42 and normalized to a unit length in box 43, to yield the
`
`orientation quaternion at the output, q.
`
`(Ex. 1004, 10:15-65)(Ex. 1002, ifif70-74).
`
`Bachmann's filter shown in Fig. 3 takes advantage of extra sensor
`
`28
`
`ZTE Exhibit 1050
`Page 28 of 87
`
`
`
`measurements from the accelerometers and magnetometers via the previously(cid:173)
`
`mentioned correction factor, Cfo. Bachmann calculates this correction factor Cfo in
`
`steps 34-41 of Fig. 3. There, Bachmann first obtains actual sensor measurements
`
`from the accelerometers2 (31) and magnetometers (32), forming a six-valued
`
`measurement vector (h1 h2 h3 b1 b2 b3), as shown in box 34. (Ex. 1004, 10:10-14,
`
`3:13-17, 8:47-5l)(Ex. 1002, if72). These six measurement values include three
`
`measurements of acceleration along the X, Y and Z axes of the sensors, and three
`
`measurements for magnetism, also along the X, Y and Z axes of the sensors. (Id.).
`
`The six actual measurements are then compared to six predicted measurements
`
`found in the vector y( q), by subtracting the predicted measurements y( q) from the
`
`actual measurements (h 1 h2 h3 b1 b2 b3). (Ex. 1004, 8:63-9: 18, 17: 12-22)(Ex. 1002,
`
`if72). This forms a six-valued error vector E{q), numbered 36.
`
`(Ex. 1004, 17: 12-
`
`22, 9:9-14)(Ex. 1002, if72).
`
`The six-valued error vector E{q) is essentially a measure of how actual
`
`accelerometer and magnetometer measurements differ from what the filter predicts
`
`those measurements should be based on the angular rate sensor output. (Ex. 1004,
`
`17: 12-22, 9:9-14)(Ex. 1002, if73). The difference E{q) is utilized in boxes 38 and 41.
`
`2 The accelerometer measurements are first low-pass filtered to remove sudden
`
`accelerations. (Ex. 1004, 8: 12-20)(Ex. 1002, ifl25).
`
`29
`
`ZTE Exhibit 1050
`Page 29 of 87
`
`
`
`There, the fi